skia2/infra/bots/recipes
Ben Wagner 7a6db4cbf4 [infra] Move app installation to install method
This generally makes things tidier (e.g. perf_skottietrace.py no longer
needs special logic so that the app is only installed once), and it
means iOS can install only the app that's going to be run instead of
installing everything.

Change-Id: Ic07c56e724d0379255c8da5f204d9d6379b646ec
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/273002
Commit-Queue: Ben Wagner aka dogben <benjaminwagner@google.com>
Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com>
Reviewed-by: Eric Boren <borenet@google.com>
Reviewed-by: Kevin Lubick <kjlubick@google.com>
2020-02-25 17:34:21 +00:00
..
android_compile.expected [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.expected [infra] Add ccache for mac default builds. 2020-02-11 13:18:36 +00:00
compile.expected [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
compute_buildstats.expected Create code size treemaps for executable containing GL/Vulkan 2019-12-20 15:01:16 +00:00
compute_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
g3_compile.expected [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.expected [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
perf_skottiewasm_lottieweb.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.expected [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
recreate_skps.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
skpbench.expected [infra] Handle failure from addr2line 2020-01-02 13:16:16 +00:00
skqp_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
sync_and_compile.expected Update XCode 2020-02-23 23:15:26 +00:00
test_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.expected [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
upload_buildstats_results.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
upload_dm_results.expected Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
upload_nano_results.expected Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
android_compile.py [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.py rewrite *.gn and #includes on CheckGeneratedFiles bot 2019-07-25 20:48:33 +00:00
compile.py [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
compute_buildstats.py Create code size treemaps for executable containing GL/Vulkan 2019-12-20 15:01:16 +00:00
compute_test.py
g3_compile.py [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.py
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.py [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
perf_skottiewasm_lottieweb.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.py [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
README.md
recreate_skps.py
skpbench.py [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
skqp_test.py
sync_and_compile.py [infra] Fix build_task_drivers.sh, update infra dep 2020-01-08 14:53:41 +00:00
test_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.py [infra] Move app installation to install method 2020-02-25 17:34:21 +00:00
upload_buildstats_results.py Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00
upload_dm_results.py Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00
upload_nano_results.py Remove Debian9 GCC jobs and related code 2019-11-24 23:51:04 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.