skia2/infra/bots/recipes
Brian Salomon 6a3957c1f9 Exclude gltestpersistentcache from TSAN bot.
This bot occasionally produces empty GM images. We believe this is due
to TSAN's thread scheduling interacting poorly with threaded GL drivers.

gltestpersistentcache fails if the cold cache and hot cache images don't
match and this flakiness causes it to fail intermittently.

Change-Id: Ib914c547120e05fac921d7e70de8e36a53bfb61b
Reviewed-on: https://skia-review.googlesource.com/142591
Commit-Queue: Brian Salomon <bsalomon@google.com>
Commit-Queue: Brian Osman <brianosman@google.com>
Auto-Submit: Brian Salomon <bsalomon@google.com>
Reviewed-by: Brian Osman <brianosman@google.com>
2018-07-19 21:27:15 +00:00
..
android_compile.expected [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.expected Debug nightly bookmaker bot 2018-07-19 13:22:44 +00:00
calmbench.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
compile.expected Add hello-opencl to BUILD_PRODUCTS_ISOLATE_WHITELIST 2018-06-28 20:34:27 +00:00
compute_test.expected Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
ct_skps.expected [recipes] Make ct_skps use binaries from a build task 2018-06-08 21:14:02 +00:00
housekeeper.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
infra.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
perf.expected [infra] Determine Android device location based on bot ID 2018-07-10 19:54:58 +00:00
recreate_skps.expected Add Chromium to DEPS for CommandBuffer bots 2018-06-20 13:55:18 +00:00
skpbench.expected [infra] Determine Android device location based on bot ID 2018-07-10 19:54:58 +00:00
skqp_test.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
test.expected [infra] Add infra support for Lottie 2018-07-19 17:53:25 +00:00
upload_calmbench_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_coverage_results.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
upload_dm_results.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_nano_results.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_skiaserve.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
android_compile.py [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.py Debug nightly bookmaker bot 2018-07-19 13:22:44 +00:00
calmbench.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
compile.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
compute_test.py Add OpenCL test job that runs hello-opencl. 2018-06-29 13:25:17 +00:00
ct_skps.py [recipes] Make ct_skps use binaries from a build task 2018-06-08 21:14:02 +00:00
housekeeper.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
infra.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
perf.py [infra] Add infra support for Lottie 2018-07-19 17:53:25 +00:00
README.md Use new recipes.py test command 2017-04-18 13:57:56 +00:00
recreate_skps.py [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
skpbench.py Disable --gpuThreads when skpbenching DDLs 2018-06-26 18:33:42 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
test.py Exclude gltestpersistentcache from TSAN bot. 2018-07-19 21:27:15 +00:00
upload_calmbench_results.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
upload_coverage_results.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
upload_dm_results.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_nano_results.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_skiaserve.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test run --train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.