AuroraMiddleware/glibc
1
0
Fork 0
mirror of https://sourceware.org/git/glibc.git synced 2024-11-26 06:50:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
d1876749a8
glibc/benchtests/scripts/benchout.schema.json

48 lines
1.4 KiB
JSON
Raw Normal View History

Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
{
"title": "benchmark",
"type": "object",
"properties": {
"timing_type": {
"type": "string"
},
"functions": {
"title": "Associative array of functions",
"type": "object",
"patternProperties": {
"^[_a-zA-Z][_a-zA-Z0-9]+$": {
"title": "Function names",
"type": "object",
"patternProperties": {
benchtests: Expand range of tests names in schema.json When executing bench-math the benchmark output is invalid with this error msg: Invalid benchmark output: 'workload-spec2006.wrf' does not match any of the regexes: '^[_a-zA-Z0-9]*$¹ or Invalid benchmark output: Additional properties are not allowed ('workload-spec2006.wrf' was unexpected) The error was seen when running the test: workload-spec2006.wrf, 'stack=1024,guard=1' and 'stack=1024,guard=2'. The problem is that the current regex's do not accept the hyphen, dot, equal and comma in the output. This patch changes the regex in benchout.schema.json to accept symbols in benchmark tests names. ChangeLog: * benchtests/scripts/benchout.schema.json: Fix regex to accept a wider range of tests names. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:22:57 +00:00
"^[_a-zA-Z0-9,=.-]*$": {
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"title": "Function variants",
"type": "object",
"properties": {
"duration": {"type": "number"},
"iterations": {"type": "number"},
benchtests: Adjust valid and accepted properties Benchmark workload-spec2006.wrf does not produce max, min or mean results but instead produce throughput. This is represented in benchtests/bench-skeleton.c. This patch adjust benchout.schema.json to consider bench.out from bench-math benchmarks as valid ChangeLog: * benchtests/scripts/benchout.schema.json: Add throughput as accepted result from property and remove "max", min" and "mean" from required properties based on benchtests/bench-skeleton.c. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:19:59 +00:00
"throughput": {"type": "number"},
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"max": {"type": "number"},
"min": {"type": "number"},
"mean": {"type": "number"},
[benchtests] Add workload test properties to schema Add the workload test properties (max-throughput, latency, etc.) to the schema to prevent benchmark output validation from failing. * benchtests/scripts/benchout.schema.json (properties): Add new properties.
2018-08-11 13:24:46 +00:00
"latency": {"type": "number"},
"min-throughput": {"type": "number"},
"max-throughput": {"type": "number"},
"reciprocal-throughput": {"type": "number"},
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"timings": {
"type": "array",
"items": {"type": "number"}
}
},
benchtests: Adjust valid and accepted properties Benchmark workload-spec2006.wrf does not produce max, min or mean results but instead produce throughput. This is represented in benchtests/bench-skeleton.c. This patch adjust benchout.schema.json to consider bench.out from bench-math benchmarks as valid ChangeLog: * benchtests/scripts/benchout.schema.json: Add throughput as accepted result from property and remove "max", min" and "mean" from required properties based on benchtests/bench-skeleton.c. Signed-off-by: Victor Rodriguez <victor.rodriguez.bahena@intel.com> Reviewed-By: Siddhesh Poyarekar <siddhesh@sourceware.org>
2017-11-28 14:19:59 +00:00
"required": ["duration", "iterations"],
Validate bench.out against a JSON schema This patch adds a JSON schema for the benchmark output file and also adds a script that validates the generated output against the schema.
2014-06-11 08:46:29 +00:00
"additionalProperties": false
}
},
"additionalProperties": false
}
},
"minProperties": 1
}
},
"required": ["timing_type", "functions"],
"additionalProperties": false
}
Reference in New Issue Copy Permalink