skia2/infra/bots/recipes
Kevin Lubick 52b040968a [infra] Remove Python2 when running CI tasks
This is similar to https://skia-review.googlesource.com/c/buildbot/+/538218

BIG CHANGE: If we fail to download uninteresting hashes
(because Gold is down or the script otherwise fails), we
now crash/fail our Test-* tasks. In an early version of
this removal, that lack of failure masked an issue with
the script (urllib2 is not in Python3) and nearly would
have landed. Failing loudly is better, IMO.

This removes the symbolize_stack_trace script, which
stopped working with Python3 for reasons unknown.
If we need the behavior, we can rewrite it.
Relatedly, we removed 4 jobs, the Docker ones, because
we will not get much value out of them as we migrate
towards Bazel and removing the symbolization script
was tricky to get right.

There are a few cleanups around copypasta that I noticed
when combing through the recipes.

Change-Id: I8dfab416e964fd494267800b4ebe216061895f19
Reviewed-on: https://skia-review.googlesource.com/c/skia/+/538636
Reviewed-by: Ravi Mistry <rmistry@google.com>
Commit-Queue: Kevin Lubick <kjlubick@google.com>
Reviewed-by: Eric Boren <borenet@google.com>
2022-05-17 20:26:48 +00:00
..
check_generated_files.expected Use download topics in recipe_modules/checkout. 2022-04-26 16:58:31 +00:00
compile.expected [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
compute_buildstats.expected Use download topics in recipe_modules/checkout. 2022-04-26 16:58:31 +00:00
housekeeper.expected Use download topics in recipe_modules/checkout. 2022-04-26 16:58:31 +00:00
infra.expected Reland "[infra] Use Python3 for our Presubmits" 2022-05-06 14:01:35 +00:00
perf_pathkit.expected [recipes] Port to Python 3 2021-11-10 20:17:28 +00:00
perf_skottietrace.expected [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
perf_skottiewasm_lottieweb.expected [recipes] Port to Python 3 2021-11-10 20:17:28 +00:00
perf.expected Use 'adb push --sync' for copying over resources. 2021-12-07 19:31:34 +00:00
skpbench.expected Use 'adb push --sync' for copying over resources. 2021-12-07 19:31:34 +00:00
sync_and_compile.expected Remove CommandBuffer bots and supporting code from infra scripts 2022-05-04 16:11:31 +00:00
test_canvaskit.expected [canvaskit] Fix test search path 2021-12-07 19:43:27 +00:00
test_lottie_web.expected [recipes] Port to Python 3 2021-11-10 20:17:28 +00:00
test_pathkit.expected Reland "[pathkit] Reorganize to be more like CanvasKit" 2022-02-04 13:10:43 +00:00
test.expected [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
upload_buildstats_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_dm_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
upload_nano_results.expected Changing ~everything (mostly recipe related stuff) to reference Debian10 jobs 2020-04-07 12:18:06 +00:00
check_generated_files.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
compile.py [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
compute_buildstats.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
housekeeper.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
infra.py Reland "[infra] Use Python3 for our Presubmits" 2022-05-06 14:01:35 +00:00
perf_pathkit.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
perf_skottietrace.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
perf_skottiewasm_lottieweb.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
perf.py [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
README.md Re-re-land "added GrSkSLFP and converted DitherEffect to use it" 2018-07-31 15:18:03 +00:00
skpbench.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
sync_and_compile.py [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
test_canvaskit.py [canvaskit] Fix test search path 2021-12-07 19:43:27 +00:00
test_lottie_web.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
test_pathkit.py Reland "[pathkit] Reorganize to be more like CanvasKit" 2022-02-04 13:10:43 +00:00
test.py [infra] Remove Python2 when running CI tasks 2022-05-17 20:26:48 +00:00
upload_buildstats_results.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
upload_dm_results.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00
upload_nano_results.py [python3] Reland recipes -> python3 changes 2021-12-01 13:04:03 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.