skia2/infra/bots/recipes
Robert Phillips dbe89bb031 Add a DDL Skpbench bot
This adds a 9 threads 3x3 grid of tiles DDL SKPBench bot that reports the total time. We will
eventually want a 4x4 bot, a 1x1 bot and a 0x1 bot. Additionally, we will want another whole set
that only emits the DDL record time.

So the ultimate naming scheme would be:
DDLTotal_9x9   DDLRecord_9x9
DDLTotal_4x4   DDLRecord_4x4
DDLTotal_1x1   DDLRecord_1x1
DDLTotal_0x1

Change-Id: Ia96c79ec05602077f4112c69cb344bd8c9b2b4b1
Reviewed-on: https://skia-review.googlesource.com/130923
Commit-Queue: Robert Phillips <robertphillips@google.com>
Reviewed-by: Kevin Lubick <kjlubick@google.com>
Reviewed-by: Eric Boren <borenet@google.com>
2018-05-31 16:34:43 +00:00
..
android_compile.expected [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
calmbench.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
check_generated_files.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
compile.expected [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
ct_skps.expected Add a Win10/QuadroP400 SKPBench bot 2018-05-23 13:19:21 +00:00
housekeeper.expected [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
infra.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
perf.expected Update MoltenVK to 43130ab27a8b2e9eaf9e28b70b64f14b20c3b7bb 2018-05-29 18:54:47 +00:00
recreate_skps.expected [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
skpbench.expected Add a DDL Skpbench bot 2018-05-31 16:34:43 +00:00
skqp_test.expected [recipes] BUILDTYPE and SKIA_OUT are no longer used 2018-05-15 19:36:23 +00:00
test.expected Allow CCPR in DDL1 images (since DDL itself now supports CCPR) 2018-05-30 10:15:18 +00:00
upload_calmbench_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_coverage_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_dm_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_nano_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_skiaserve.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
android_compile.py [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
calmbench.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
check_generated_files.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
compile.py [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
ct_skps.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
housekeeper.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
infra.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
perf.py Update MoltenVK to 43130ab27a8b2e9eaf9e28b70b64f14b20c3b7bb 2018-05-29 18:54:47 +00:00
README.md Use new recipes.py test command 2017-04-18 13:57:56 +00:00
recreate_skps.py [recipes] Add parameters to checkout module 2018-05-30 19:02:18 +00:00
skpbench.py Add a DDL Skpbench bot 2018-05-31 16:34:43 +00:00
skqp_test.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
test.py Allow CCPR in DDL1 images (since DDL itself now supports CCPR) 2018-05-30 10:15:18 +00:00
upload_calmbench_results.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00
upload_coverage_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_dm_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_nano_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_skiaserve.py [recipes] Rename some modules and files 2018-05-24 14:06:55 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test run --train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.