skia2/infra/bots/recipes
Ravi Mistry 68e470de86 [G3 compile bot] Add comment to CL when there is an interesting failure
Also, create and use new service account for the G3 compile bots.

Interesting failure here refers to when the bot fails only because of
test failures and not:
* merge failures
* unknown failure reasons (eg: some flaky timeouts from the script running in borg)
* when the bot is not owned or approved by a Googler

NoTry: true
Bug: skia:9631
Change-Id: I964fd7874269116cca0e25d1b516283a00d5133f
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/254278
Commit-Queue: Ravi Mistry <rmistry@google.com>
Reviewed-by: Eric Boren <borenet@google.com>
2019-11-22 16:08:03 +00:00
..
android_compile.expected [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
compile.expected Roll recipe dependencies (nontrivial). 2019-10-31 13:45:53 +00:00
compute_buildstats.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
compute_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
g3_compile.expected [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.expected Roll recipe dependencies (nontrivial). 2019-10-31 13:45:53 +00:00
perf_skottiewasm_lottieweb.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.expected drop sse4.1 limit on valgrind bots 2019-11-20 02:00:08 +00:00
recreate_skps.expected Reland "[recipes] Assert that Git is obtained from CIPD" 2019-11-04 16:40:29 +00:00
skpbench.expected Roll recipe dependencies (nontrivial). 2019-10-31 13:45:53 +00:00
skqp_test.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
sync_and_compile.expected [infra] Remove Calmbench and ParentRevision bots 2019-11-06 15:03:43 +00:00
test_canvaskit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.expected [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.expected [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.expected Add Docker-based GCC Test tasks 2019-11-22 12:32:32 +00:00
upload_buildstats_results.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
upload_dm_results.expected Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00
upload_nano_results.expected Roll recipe dependencies (nontrivial). 2019-09-10 11:50:47 +00:00
android_compile.py [Android compile bots] Add comment to CL when both nopatch and withpatch builds fail 2019-10-28 14:55:01 +00:00
check_generated_files.py rewrite *.gn and #includes on CheckGeneratedFiles bot 2019-07-25 20:48:33 +00:00
compile.py [infra] Move SKQP recipe test to correct recipe 2019-07-19 18:48:31 +00:00
compute_buildstats.py Build code size treemaps for skottie_tool 2019-02-12 13:54:00 +00:00
compute_test.py Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
g3_compile.py [G3 compile bot] Add comment to CL when there is an interesting failure 2019-11-22 16:08:03 +00:00
housekeeper.py Remove old code size analysis 2018-10-10 14:25:17 +00:00
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
perf_skottietrace.py Add new SkottieTracing GPU bot to match SkottieWASM and LottieWeb 2019-06-22 12:28:38 +00:00
perf_skottiewasm_lottieweb.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
perf.py drop sse4.1 limit on valgrind bots 2019-11-20 02:00:08 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
recreate_skps.py Have the RecreateSKPs bot upload to partner bucket 2019-02-06 18:35:12 +00:00
skpbench.py Add a kind of asset for MSKPs so the skpbench bot can read them. 2019-08-01 20:29:52 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
sync_and_compile.py [infra] Remove Calmbench and ParentRevision bots 2019-11-06 15:03:43 +00:00
test_canvaskit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_lottie_web.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test_pathkit.py [canvaskit] Try some things to reduce GPU test flakiness 2019-11-21 20:56:42 +00:00
test_skqp_emulator.py [recipes] CanvasKit, PathKit, some others don't need bot_update 2019-11-05 18:46:34 +00:00
test.py Add Docker-based GCC Test tasks 2019-11-22 12:32:32 +00:00
upload_buildstats_results.py Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00
upload_dm_results.py Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00
upload_nano_results.py Reland "Use integer patchset and issue variables." 2019-10-08 11:28:17 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.