skia2/infra/bots/recipes
Brian Osman a66f4dad51 Revert "Reland "Revert "Update GPU DM/nanobench configs for color testing"""
This reverts commit d5161b9a62.

Reason for revert: This should be okay again.

Original change's description:
> Reland "Revert "Update GPU DM/nanobench configs for color testing""
> 
> This reverts commit c0fb3c8b9f.
> 
> Reason for revert: Had to revert dependent CL.
> Original change's description:
> > Revert "Revert "Update GPU DM/nanobench configs for color testing""
> > 
> > This reverts commit 2a284de7a5.
> > 
> > Re-landing without esrgb configs. Going to enable those separately,
> > as they require some blacklisting.
> > 
> > Bug: skia:
> > Change-Id: I2315849d4f5c45c2e5512f84f9f867d02ff6fe30
> > Reviewed-on: https://skia-review.googlesource.com/136589
> > Reviewed-by: Brian Osman <brianosman@google.com>
> > Commit-Queue: Brian Osman <brianosman@google.com>
> 
> TBR=mtklein@google.com,bsalomon@google.com,brianosman@google.com
> 
> Change-Id: I942d4235c17100fd933bf9cbfe923e3ae80657b1
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Bug: skia:
> Reviewed-on: https://skia-review.googlesource.com/137721
> Reviewed-by: Brian Osman <brianosman@google.com>
> Commit-Queue: Brian Osman <brianosman@google.com>

TBR=mtklein@google.com,bsalomon@google.com,brianosman@google.com

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug: skia:
Change-Id: I280dac49eb74d6c1cbf7c2f52a3f6a68fa2510ae
Reviewed-on: https://skia-review.googlesource.com/138301
Reviewed-by: Brian Osman <brianosman@google.com>
Commit-Queue: Brian Osman <brianosman@google.com>
2018-06-28 18:20:17 +00:00
..
android_compile.expected [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.expected Increase number of concurrent requests that fiddlecli makes to fiddle.skia.org. 2018-06-27 15:21:50 +00:00
calmbench.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
compile.expected Add Chromium to DEPS for CommandBuffer bots 2018-06-20 13:55:18 +00:00
ct_skps.expected [recipes] Make ct_skps use binaries from a build task 2018-06-08 21:14:02 +00:00
housekeeper.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
infra.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
perf.expected Revert "Reland "Revert "Update GPU DM/nanobench configs for color testing""" 2018-06-28 18:20:17 +00:00
recreate_skps.expected Add Chromium to DEPS for CommandBuffer bots 2018-06-20 13:55:18 +00:00
skpbench.expected Disable --gpuThreads when skpbenching DDLs 2018-06-26 18:33:42 +00:00
skqp_test.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
test.expected Revert "Reland "Revert "Update GPU DM/nanobench configs for color testing""" 2018-06-28 18:20:17 +00:00
upload_calmbench_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_coverage_results.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
upload_dm_results.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_nano_results.expected [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_skiaserve.expected Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
android_compile.py [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.py Increase number of concurrent requests that fiddlecli makes to fiddle.skia.org. 2018-06-27 15:21:50 +00:00
calmbench.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
check_generated_files.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
compile.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
ct_skps.py [recipes] Make ct_skps use binaries from a build task 2018-06-08 21:14:02 +00:00
housekeeper.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
infra.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
perf.py Revert "Reland "Revert "Update GPU DM/nanobench configs for color testing""" 2018-06-28 18:20:17 +00:00
README.md Use new recipes.py test command 2017-04-18 13:57:56 +00:00
recreate_skps.py [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
skpbench.py Disable --gpuThreads when skpbenching DDLs 2018-06-26 18:33:42 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
test.py Revert "Reland "Revert "Update GPU DM/nanobench configs for color testing""" 2018-06-28 18:20:17 +00:00
upload_calmbench_results.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
upload_coverage_results.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00
upload_dm_results.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_nano_results.py [recipes] Simplify test/perf dirs 2018-06-20 17:50:18 +00:00
upload_skiaserve.py Reland [recipes] Isolate build outputs with no subdirs 2018-06-01 15:18:46 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test run --train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.