skia2/infra/bots/recipes
Chris Dalton 9278f10795 Add "AllPathsVolatile" skpbench bots
Also adds GalaxyS20 to the mix, which wasn't running skpbench
previously.

Also removes the skpbench logic to fail if we don't recognize the
hardware or have specific scripts for it. We don't have time to reverse
engineer every new piece of hardware we want to run on and the general
android script is quite helpful already.

Bug: skia:10419
Change-Id: I0e139cdd4bc2e7ca0e2e14c715d319664fa8c949
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/319143
Commit-Queue: Chris Dalton <csmartdalton@google.com>
Reviewed-by: Greg Daniel <egdaniel@google.com>
Reviewed-by: Kevin Lubick <kjlubick@google.com>
2020-09-24 19:50:34 +00:00
..
check_generated_files.expected Generate SkSL golden output files from test inputs during the build. 2020-09-14 14:54:12 +00:00
compile.expected Remove old devices.json and code 2020-07-23 12:24:26 +00:00
compute_buildstats.expected [infra] Update recipe dependencies 2020-08-03 11:34:57 +00:00
compute_test.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
housekeeper.expected [infra] Update recipe dependencies 2020-08-03 11:34:57 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected Run docker as current user and add option to copy directory structure to docker.run. 2020-04-16 15:55:10 +00:00
perf_pathkit.expected Run docker as current user and add option to copy directory structure to docker.run. 2020-04-16 15:55:10 +00:00
perf_skottietrace.expected [recipes] Dump debugging information before running tests on Android 2020-08-10 14:41:23 +00:00
perf_skottiewasm_lottieweb.expected [infra] remove SkottieWASM CPU job 2020-09-03 15:32:06 +00:00
perf.expected [recipes] Dump debugging information before running tests on Android 2020-08-10 14:41:23 +00:00
recreate_skps.expected Use GCLIENT_PY3=0 in recreate_skps.py 2020-08-26 11:24:13 +00:00
skpbench.expected Add "AllPathsVolatile" skpbench bots 2020-09-24 19:50:34 +00:00
sync_and_compile.expected [infra] Update recipe dependencies 2020-08-03 11:34:57 +00:00
test_canvaskit.expected Run docker as current user and add option to copy directory structure to docker.run. 2020-04-16 15:55:10 +00:00
test_lottie_web.expected Fix docker command for lottie web 2020-07-06 18:24:23 +00:00
test_pathkit.expected Run docker as current user and add option to copy directory structure to docker.run. 2020-04-16 15:55:10 +00:00
test_skqp_emulator.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
test.expected [recipes] Dump debugging information before running tests on Android 2020-08-10 14:41:23 +00:00
upload_buildstats_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_dm_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_nano_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
check_generated_files.py harmonize rewrite-includes and gn-format checks 2020-04-03 17:00:54 +00:00
compile.py [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
compute_buildstats.py remove more blacklists 2020-07-24 18:14:29 +00:00
compute_test.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
housekeeper.py [recipes] Move app_name into flavor.setup() 2020-02-27 18:06:15 +00:00
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
perf_pathkit.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
perf_skottietrace.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
perf_skottiewasm_lottieweb.py [infra] remove SkottieWASM CPU job 2020-09-03 15:32:06 +00:00
perf.py [infra] Move logic about skps/images/etc into gen_tasks 2020-03-23 13:42:43 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
recreate_skps.py Use GCLIENT_PY3=0 in recreate_skps.py 2020-08-26 11:24:13 +00:00
skpbench.py Add "AllPathsVolatile" skpbench bots 2020-09-24 19:50:34 +00:00
sync_and_compile.py Remove old devices.json and code 2020-07-23 12:24:26 +00:00
test_canvaskit.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
test_lottie_web.py Remove some non-inclusive language in recipes 2020-07-31 19:29:54 +00:00
test_pathkit.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
test_skqp_emulator.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
test.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_buildstats_results.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_dm_results.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_nano_results.py Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.