skia2/infra/bots/recipes
Ravi Mistry 37a4bedfc8 [perf_skottiewasm_lottieweb] Do 2 loops with 25 points each and then pick 25 from the middle
Doing this will avoid the unreliable frames at the start (setup related) and at the end (teardown related). Also:
* Increase timeouts in lottie-web-perf.js and skottie-wasm-perf.js since we are looping twice now.
* Fix bug where ret code was 0 if puppeteer test failed.

NoTry: true
Bug: skia:9237
Change-Id: I0933ecb87113b40c162712076c38fb7379b352d4
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/226836
Reviewed-by: Joe Gregorio <jcgregorio@google.com>
Reviewed-by: Florin Malita <fmalita@chromium.org>
Commit-Queue: Ravi Mistry <rmistry@google.com>
2019-07-11 18:23:17 +00:00
..
android_compile.expected Roll recipe dependencies (nontrivial). 2019-06-21 12:03:54 +00:00
calmbench.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
check_generated_files.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
compile.expected Update skqp's Android NDK to r20 2019-07-03 20:45:24 +00:00
compute_buildstats.expected Roll recipe dependencies (nontrivial). 2019-06-05 18:04:47 +00:00
compute_test.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
g3_compile.expected Roll recipe dependencies (nontrivial). 2019-06-21 12:03:54 +00:00
housekeeper.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
infra.expected [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
perf_pathkit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
perf_skottietrace.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
perf_skottiewasm_lottieweb.expected [perf_skottiewasm_lottieweb] Do 2 loops with 25 points each and then pick 25 from the middle 2019-07-11 18:23:17 +00:00
perf.expected Reland "Test MSAA on Gen9 Intel GPUs" 2019-07-02 14:22:03 +00:00
recreate_skps.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
skpbench.expected Roll recipe dependencies (nontrivial). 2019-06-25 11:43:53 +00:00
skqp_test.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
test_canvaskit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_lottie_web.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_pathkit.expected [infra] Supply revision as target_branch to bot_update 2019-06-04 11:34:52 +00:00
test_skqp_emulator.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
test.expected Blacklist GrTestingBackendTextureUploadTest on MoltenVk. 2019-07-11 00:38:43 +00:00
upload_buildstats_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_calmbench_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_dm_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_nano_results.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
upload_skiaserve.expected Roll recipe dependencies (nontrivial). 2019-06-03 11:25:16 +00:00
android_compile.py [Android compile bot] Add links to force sync the checkout 2019-05-09 13:00:07 +00:00
calmbench.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.py Add gen_interface to CheckGeneratedFiles check 2019-03-28 17:07:14 +00:00
compile.py [recipes] Fix Windows pathsep; add Windows tests 2019-04-24 19:53:28 +00:00
compute_buildstats.py Build code size treemaps for skottie_tool 2019-02-12 13:54:00 +00:00
compute_test.py Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
g3_compile.py Add CL link in G3 trybot 2019-06-17 16:16:47 +00:00
housekeeper.py Remove old code size analysis 2018-10-10 14:25:17 +00:00
infra.py [infra] Make infra tests idempotent 2019-07-09 19:04:47 +00:00
perf_canvaskit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
perf_pathkit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
perf_skottietrace.py Add new SkottieTracing GPU bot to match SkottieWASM and LottieWeb 2019-06-22 12:28:38 +00:00
perf_skottiewasm_lottieweb.py [perf_skottiewasm_lottieweb] Do 2 loops with 25 points each and then pick 25 from the middle 2019-07-11 18:23:17 +00:00
perf.py Revert "Enable MSAA on Gen8 Intel GPUs" 2019-07-09 12:58:40 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
recreate_skps.py Have the RecreateSKPs bot upload to partner bucket 2019-02-06 18:35:12 +00:00
skpbench.py [recipes] Fix Windows pathsep; add Windows tests 2019-04-24 19:53:28 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
test_canvaskit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
test_lottie_web.py Update android-skqp Docker image to accept licenses 2019-01-22 23:34:58 +00:00
test_pathkit.py [pathkit/canvaskit] Address race when uploading results 2019-03-12 21:45:04 +00:00
test_skqp_emulator.py Add Build and Test jobs for SKQP using docker. 2018-10-08 19:17:25 +00:00
test.py Blacklist GrTestingBackendTextureUploadTest on MoltenVk. 2019-07-11 00:38:43 +00:00
upload_buildstats_results.py Use right bucket for buildstats 2018-10-08 19:23:56 +00:00
upload_calmbench_results.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
upload_dm_results.py Fix upload_dm_results 2018-08-20 16:44:24 +00:00
upload_nano_results.py Add BuildStats pipeline for PathKit binaries 2018-10-08 18:15:32 +00:00
upload_skiaserve.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.