skia2/infra/bots/recipes
Brian Osman 829144cc76 Better bot coverage for (Vk, Mtl) x MSAA
- Stop testing Metal-MSAA on our Gen8 Mac. These GPUs are slow and buggy
  with MSAA (we already have them disabled on other backends).
- Add Metal bots with the HD615 to get testing on a Gen9 GPU. This
  should have better performance and more correct results. Also move the
  DDL tests to those machines, to get testing on a newer/faster machine.
- Add MSAA configs to Vulkan and Metal perf bots (except for old Intel).

Bug: skia:9023 skia:8243
Change-Id: I214c6c4ef7b6e1401719e62e29fd5d2ad05b6aa1
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/229379
Reviewed-by: Greg Daniel <egdaniel@google.com>
Reviewed-by: Eric Boren <borenet@google.com>
Commit-Queue: Brian Osman <brianosman@google.com>
2019-07-23 19:11:44 +00:00
..
android_compile.expected Roll recipe dependencies (nontrivial). 2019-06-21 12:03:54 +00:00
calmbench.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
check_generated_files.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
compile.expected [infra] Move SKQP recipe test to correct recipe 2019-07-19 18:48:31 +00:00
compute_buildstats.expected Roll recipe dependencies (nontrivial). 2019-06-05 18:04:47 +00:00
compute_test.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
g3_compile.expected Roll recipe dependencies (nontrivial). 2019-06-21 12:03:54 +00:00
housekeeper.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
perf_pathkit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
perf_skottietrace.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
perf_skottiewasm_lottieweb.expected [perf_skottiewasm_lottieweb] Use the new "--use_gpu" flag for GPU bots 2019-07-12 18:31:47 +00:00
perf.expected Better bot coverage for (Vk, Mtl) x MSAA 2019-07-23 19:11:44 +00:00
recreate_skps.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
skpbench.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
skqp_test.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
sync_and_compile.expected [infra] Move SKQP recipe test to correct recipe 2019-07-19 18:48:31 +00:00
test_canvaskit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_lottie_web.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_pathkit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_skqp_emulator.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
test.expected Enable Metal MSAA configs and ignore flaky test 2019-07-15 17:35:12 +00:00
upload_buildstats_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_calmbench_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_dm_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_nano_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_skiaserve.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
android_compile.py [Android compile bot] Add links to force sync the checkout 2019-05-09 13:00:07 +00:00
calmbench.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.py Add gen_interface to CheckGeneratedFiles check 2019-03-28 17:07:14 +00:00
compile.py [infra] Move SKQP recipe test to correct recipe 2019-07-19 18:48:31 +00:00
compute_buildstats.py Build code size treemaps for skottie_tool 2019-02-12 13:54:00 +00:00
compute_test.py Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
g3_compile.py Add CL link in G3 trybot 2019-06-17 16:16:47 +00:00
housekeeper.py Remove old code size analysis 2018-10-10 14:25:17 +00:00
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
perf_pathkit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
perf_skottietrace.py Add new SkottieTracing GPU bot to match SkottieWASM and LottieWeb 2019-06-22 12:28:38 +00:00
perf_skottiewasm_lottieweb.py [perf_skottiewasm_lottieweb] Use the new "--use_gpu" flag for GPU bots 2019-07-12 18:31:47 +00:00
perf.py Better bot coverage for (Vk, Mtl) x MSAA 2019-07-23 19:11:44 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
recreate_skps.py Have the RecreateSKPs bot upload to partner bucket 2019-02-06 18:35:12 +00:00
skpbench.py [recipes] Fix Windows pathsep; add Windows tests 2019-04-24 19:53:28 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
sync_and_compile.py [infra] Move SKQP recipe test to correct recipe 2019-07-19 18:48:31 +00:00
test_canvaskit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
test_lottie_web.py Update android-skqp Docker image to accept licenses 2019-01-22 23:34:58 +00:00
test_pathkit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
test_skqp_emulator.py Add Build and Test jobs for SKQP using docker. 2018-10-08 19:17:25 +00:00
test.py Better bot coverage for (Vk, Mtl) x MSAA 2019-07-23 19:11:44 +00:00
upload_buildstats_results.py Use right bucket for buildstats 2018-10-08 19:23:56 +00:00
upload_calmbench_results.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
upload_dm_results.py Fix upload_dm_results 2018-08-20 16:44:24 +00:00
upload_nano_results.py Add BuildStats pipeline for PathKit binaries 2018-10-08 18:15:32 +00:00
upload_skiaserve.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.