AuroraMiddleware/glibc
1
0
Fork 0
mirror of https://sourceware.org/git/glibc.git synced 2024-12-04 02:40:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
7f3e7c262c
glibc/benchtests/scripts/benchout.schema.json

52 lines
1.6 KiB
JSON
Raw Normal View History

Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
{
"title": "benchmark",
"type": "object",
"properties": {
"timing_type": {
"type": "string"
},
"functions": {
"title": "Associative array of functions",
"type": "object",
"patternProperties": {
"^[_a-zA-Z][_a-zA-Z0-9]+$": {
"title": "Function names",
"type": "object",
"patternProperties": {
benchtests: Expand range of tests names in schema.json When executing bench-math the benchmark output is invalid with this error msg: Invalid benchmark output: 'workload-spec2006.wrf' does not match any of the regexes: '^[_a-zA-Z0-9]*$¹ or Invalid benchmark output: Additional properties are not allowed ('workload-spec2006.wrf' was unexpected) The error was seen when running the test: workload-spec2006.wrf, 'stack=1024,guard=1' and 'stack=1024,guard=2'. The problem is that the current regex's do not accept the hyphen, dot, equal and comma in the output. This patch changes the regex in benchout.schema.json to accept symbols in benchmark tests names. ChangeLog: * benchtests/scripts/benchout.schema.json: Fix regex to accept a wider range of tests names. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:22:57 +00:00
"^[_a-zA-Z0-9,=.-]*$": {
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"title": "Function variants",
"type": "object",
"properties": {
"duration": {"type": "number"},
"iterations": {"type": "number"},
benchtests: Adjust valid and accepted properties Benchmark workload-spec2006.wrf does not produce max, min or mean results but instead produce throughput. This is represented in benchtests/bench-skeleton.c. This patch adjust benchout.schema.json to consider bench.out from bench-math benchmarks as valid ChangeLog: * benchtests/scripts/benchout.schema.json: Add throughput as accepted result from property and remove "max", min" and "mean" from required properties based on benchtests/bench-skeleton.c. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:19:59 +00:00
"throughput": {"type": "number"},
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"max": {"type": "number"},
"min": {"type": "number"},
"mean": {"type": "number"},
[benchtests] Add workload test properties to schema Add the workload test properties (max-throughput, latency, etc.) to the schema to prevent benchmark output validation from failing. * benchtests/scripts/benchout.schema.json (properties): Add new properties.
2018-08-11 13:24:46 +00:00
"latency": {"type": "number"},
"min-throughput": {"type": "number"},
"max-throughput": {"type": "number"},
"reciprocal-throughput": {"type": "number"},
benchtests: Fix pthread-locks test to produce valid json The benchtests json allows {function {variant}} categorization of results whereas the pthread-locks tests had {function {variant {subvariant}}}, which broke validation. Fix that by serializing the subvariants as variant-subvariant. Also update the schema to recognize the new benchmark attributes after fixing the naming conventions.
2021-04-18 07:19:54 +00:00
"min-outlier": {"type": "number"},
"max-outlier": {"type": "number"},
"wall-sec": {"type": "number"},
"stdev": {"type": "number"},
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"timings": {
"type": "array",
"items": {"type": "number"}
}
},
benchtests: Adjust valid and accepted properties Benchmark workload-spec2006.wrf does not produce max, min or mean results but instead produce throughput. This is represented in benchtests/bench-skeleton.c. This patch adjust benchout.schema.json to consider bench.out from bench-math benchmarks as valid ChangeLog: * benchtests/scripts/benchout.schema.json: Add throughput as accepted result from property and remove "max", min" and "mean" from required properties based on benchtests/bench-skeleton.c. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:19:59 +00:00
"required": ["duration", "iterations"],
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"additionalProperties": false
}
},
"additionalProperties": false
}
},
"minProperties": 1
}
},
"required": ["timing_type", "functions"],
"additionalProperties": false
}
Reference in New Issue Copy Permalink