5e6a1fec93
testing. +rmistry for reviewing the scripts +egdaniel for reviewing the Vulkan outpout. Below are the three types of analysis done so far, showing Test, Perf, and Vulkan jobs that are not being run: $ make missing_test_jobs cpu_or_gpu_value,model Snapdragon808,Nexus5x $ make missing_perf_jobs cpu_or_gpu_value,model AVX,VMware7.1 Rome,GCE Snapdragon821,Pixel SwiftShader,GCE $ make missing_vulkan_jobs cpu_or_gpu_value,model AVX,VMware7.1 AVX2,GCE AVX2,MacBookPro11.5 AVX2,NUC5i7RYH AVX512,GCE AVX512,Golo Adreno330,Nexus5 Adreno418,Nexus5x AppleA11,iPhone8 AppleA13,iPhone11 AppleM1,MacMini9.1 IntelBayTrail,NUCDE3815TYKHE IntelHD2000,ShuttleA IntelHD4400,NUCD34010WYKH IntelHD6000,MacBookAir7.2 IntelHD615,MacBook10.1 IntelIris5100,MacMini7.1 IntelIris6100,NUC5i7RYH IntelUHDGraphics605,Sparky360 Mali400MP2,AndroidOne MaliT760,GalaxyS6 PowerVRGE8320,TecnoSpark3Pro PowerVRGT7600,iPhone7 PowerVRGT7800,iPadPro PowerVRGX6450,iPhone6 RadeonHD8870M,MacBookPro11.5 RadeonVega3,Spin514 Rome,GCE Snapdragon800,Nexus5 Snapdragon808,Nexus5x Snapdragon821,Pixel SwiftShader,GCE Tegra3,Nexus7 Change-Id: I18c1688fa20c73bfbaf36221596d7784dc0f1212 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/414442 Commit-Queue: Joe Gregorio <jcgregorio@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com> |
||
|---|---|---|
| .. | ||
| axis.sh | ||
| create-alljobs.sh | ||
| Makefile | ||
| missing.sh | ||
| README.md | ||
Job Analysis
A set of scripts that analyzes jobs.json to look for possible holes in our
testing.
Requirements
To run the scripts you need to have both jq and mlr installed on your
machine.
$ sudo apt install jq miller
Running
The Makefile contains common queries that can be run against the data.
For example, to find all cpu_or_gpu_values that we currently don't run Perf tests on you would run:
$ make missing_perf_jobs
See https://miller.readthedocs.io/en/latest/reference-dsl.html more details on the the kinds of queries that can be done against CSV files.