skia2/infra/bots/recipes
Ben Wagner 108a494984 Omit crashing bench on iOS Metal
Bug: skia:9799
Change-Id: I341a83b575a4e4595756c3ee055fcbc1418bc962
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/272636
Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com>
Commit-Queue: Jim Van Verth <jvanverth@google.com>
Reviewed-by: Jim Van Verth <jvanverth@google.com>
2020-02-24 15:40:35 +00:00
..
android_compile.expected [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.expected [infra] Add ccache for mac default builds. 2020-02-11 13:18:36 +00:00
compile.expected [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
compute_buildstats.expected Create code size treemaps for executable containing GL/Vulkan 2019-12-20 15:01:16 +00:00
compute_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
g3_compile.expected [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.expected [infra] Handle failure from addr2line 2020-01-02 13:16:16 +00:00
perf_skottiewasm_lottieweb.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.expected Omit crashing bench on iOS Metal 2020-02-24 15:40:35 +00:00
recreate_skps.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
skpbench.expected [infra] Handle failure from addr2line 2020-01-02 13:16:16 +00:00
skqp_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
sync_and_compile.expected Update XCode 2020-02-23 23:15:26 +00:00
test_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.expected [infra] Switch iOS to updated libimobiledevice. 2020-02-21 16:21:20 +00:00
upload_buildstats_results.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
upload_dm_results.expected Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
upload_nano_results.expected Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
android_compile.py [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.py rewrite *.gn and #includes on CheckGeneratedFiles bot 2019-07-25 20:48:33 +00:00
compile.py [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
compute_buildstats.py Create code size treemaps for executable containing GL/Vulkan 2019-12-20 15:01:16 +00:00
compute_test.py Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
g3_compile.py [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.py Remove old code size analysis 2018-10-10 14:25:17 +00:00
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.py Reland "[skottie] Remove defensive seek(0) from Animation ctor" 2019-12-03 18:26:40 +00:00
perf_skottiewasm_lottieweb.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.py Omit crashing bench on iOS Metal 2020-02-24 15:40:35 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
recreate_skps.py Have the RecreateSKPs bot upload to partner bucket 2019-02-06 18:35:12 +00:00
skpbench.py Add a kind of asset for MSKPs so the skpbench bot can read them. 2019-08-01 20:29:52 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
sync_and_compile.py [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
test_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.py Remove chromecast jobs 2020-02-13 19:51:12 +00:00
upload_buildstats_results.py Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00
upload_dm_results.py Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
upload_nano_results.py Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.