skia2/infra/bots/recipes
Yuqian Li cb31248132 Reland "Reland "Reland "Exercise the threaded backend in test bots"""
This reverts commit 47f2b7b089.

Reason for revert: try to fix the issue by reducing the set of bots

Original change's description:
> Revert "Reland "Reland "Exercise the threaded backend in test bots"""
> 
> This reverts commit 7ddad479e4.
> 
> Reason for revert: bots failure
> 
> Original change's description:
> > Reland "Reland "Exercise the threaded backend in test bots""
> > 
> > This reverts commit 0f5972604c.
> > 
> > Reason for revert: ASAN/MSAN should have been fixed
> > 
> > Original change's description:
> > > Revert "Reland "Exercise the threaded backend in test bots""
> > >
> > > This reverts commit 654ca8a340.
> > >
> > > Reason for revert: ASAN,MSAN failures
> > >
> > > Original change's description:
> > > > Reland "Exercise the threaded backend in test bots"
> > > >
> > > > This reverts commit ea51393ba9.
> > > >
> > > > Reason for revert: try again after many fixes of the threaded backend
> > > >
> > > > Original change's description:
> > > > > Revert "Exercise the threaded backend in test bots"
> > > > >
> > > > > This reverts commit a39991ebd7.
> > > > >
> > > > > Reason for revert: Random bots timeout
> > > > >
> > > > > Original change's description:
> > > > > > Exercise the threaded backend in test bots
> > > > > >
> > > > > > We can't draw everything correctly now, but it's at least not crashing.
> > > > > >
> > > > > > The draw_to_canvas is modified by adding flush because now the raster
> > > > > > canvas also needs flush like GPU canvases because of the threaded
> > > > > > backend. (Previously, AndroidCodecSrc vetoed GPU (non-raster) sink
> > > > > > and that's why it was not crashing.)
> > > > > >
> > > > > >
> > > > > > Bug: skia:
> > > > > > Change-Id: I222d706c33e15326e1b97d6bef6c46b8c35cebfd
> > > > > > Reviewed-on: https://skia-review.googlesource.com/118886
> > > > > > Reviewed-by: Kevin Lubick <kjlubick@google.com>
> > > > > > Commit-Queue: Yuqian Li <liyuqian@google.com>
> > > > >
> > > > > TBR=kjlubick@google.com,stephana@google.com,liyuqian@google.com
> > > > >
> > > > > Change-Id: Ib1089d937b6e25cc39d90ad4de35b3a4c406f6b1
> > > > > No-Presubmit: true
> > > > > No-Tree-Checks: true
> > > > > No-Try: true
> > > > > Bug: skia:
> > > > > Reviewed-on: https://skia-review.googlesource.com/119100
> > > > > Reviewed-by: Yuqian Li <liyuqian@google.com>
> > > > > Commit-Queue: Yuqian Li <liyuqian@google.com>
> > > >
> > > > TBR=kjlubick@google.com,stephana@google.com,liyuqian@google.com
> > > >
> > > > # Not skipping CQ checks because original CL landed > 1 day ago.
> > > >
> > > > Bug: skia:7838
> > > > Change-Id: I1405212204bf694b2f31dfc38154759e1d3e363f
> > > > Reviewed-on: https://skia-review.googlesource.com/121680
> > > > Commit-Queue: Yuqian Li <liyuqian@google.com>
> > > > Reviewed-by: Yuqian Li <liyuqian@google.com>
> > >
> > > TBR=kjlubick@google.com,stephana@google.com,liyuqian@google.com
> > >
> > > Change-Id: Id1b273e22a1d0cbc15a2155252909f576b401fa4
> > > No-Presubmit: true
> > > No-Tree-Checks: true
> > > No-Try: true
> > > Bug: skia:7838
> > > Reviewed-on: https://skia-review.googlesource.com/123360
> > > Reviewed-by: Mike Klein <mtklein@google.com>
> > > Commit-Queue: Mike Klein <mtklein@google.com>
> > 
> > TBR=mtklein@google.com,kjlubick@google.com,stephana@google.com,liyuqian@google.com
> > 
> > # Not skipping CQ checks because original CL landed > 1 day ago.
> > 
> > Bug: skia:7838
> > Change-Id: I205d579f2959ea726b447993314c1326b731730e
> > Reviewed-on: https://skia-review.googlesource.com/123660
> > Commit-Queue: Yuqian Li <liyuqian@google.com>
> > Reviewed-by: Yuqian Li <liyuqian@google.com>
> 
> TBR=mtklein@google.com,kjlubick@google.com,stephana@google.com,liyuqian@google.com
> 
> Change-Id: I1d3986cc2af12836dd7acbcbba713081a88301a6
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Bug: skia:7838
> Reviewed-on: https://skia-review.googlesource.com/124200
> Reviewed-by: Yuqian Li <liyuqian@google.com>
> Commit-Queue: Yuqian Li <liyuqian@google.com>

TBR=mtklein@google.com,kjlubick@google.com,stephana@google.com,liyuqian@google.com

Change-Id: I2d4d0c172849a86b37c60b32938a7a2b828258fa
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: skia:7838
Reviewed-on: https://skia-review.googlesource.com/124201
Commit-Queue: Yuqian Li <liyuqian@google.com>
Reviewed-by: Yuqian Li <liyuqian@google.com>
2018-04-27 19:53:48 +00:00
..
android_compile.expected [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
calmbench.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
check_generated_files.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
compile.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
ct_skps.expected Revert "[recipes] Use named caches for git and workdirs" 2018-04-26 22:21:04 +00:00
housekeeper.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
infra.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
perf.expected Update test expectations for Debian9 2018-04-26 17:16:53 +00:00
recreate_skps.expected Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
skpbench.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
skqp_test.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
test.expected Reland "Reland "Reland "Exercise the threaded backend in test bots""" 2018-04-27 19:53:48 +00:00
upload_calmbench_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_coverage_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_dm_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_nano_results.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_skiaserve.expected Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
android_compile.py [Android Compile Bot] Look at the start_dir for trigger_wait_ac_task.py 2018-02-05 18:34:46 +00:00
bookmaker.py Switch RecreateSKPs and Bookmaker bots to use service accounts 2018-04-23 13:00:19 +00:00
calmbench.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
check_generated_files.py Add a bot to verify that generated SKSL files have not been hand-edited 2017-07-28 12:20:47 +00:00
compile.py remove CC,CXX,CPPFLAGS from compile environment 2018-04-03 19:25:31 +00:00
ct_skps.py Reland "[recipes] Use named caches for git and workdirs" 2018-04-27 18:18:48 +00:00
housekeeper.py Fix binary size analysis 2018-03-12 13:23:58 +00:00
infra.py Add bot which builds without DEPS 2018-02-22 17:47:56 +00:00
perf.py Update test expectations for Debian9 2018-04-26 17:16:53 +00:00
README.md Use new recipes.py test command 2017-04-18 13:57:56 +00:00
recreate_skps.py Switch RecreateSKPs and Bookmaker bots to use service accounts 2018-04-23 13:00:19 +00:00
skpbench.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
skqp_test.py Test SKQP on Firebase Testlab and Upload 2018-03-07 20:44:50 +00:00
test.py Reland "Reland "Reland "Exercise the threaded backend in test bots""" 2018-04-27 19:53:48 +00:00
upload_calmbench_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_coverage_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_dm_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_nano_results.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00
upload_skiaserve.py Reland "[infra] Run recipes through Kitchen" 2018-04-19 11:27:46 +00:00

Skia Recipes

These are the top-level scripts which run inside of Swarming tasks to perform all of Skia's automated testing.

To run a recipe locally:

$ python infra/bots/recipes.py run --workdir=/tmp/<workdir> <recipe name without .py> key1=value1 key2=value2 ...

Each recipe may have its own required properties which must be entered as key/value pairs in the command.

When you change a recipe, you generally need to re-train the simulation test:

$ python infra/bots/recipes.py test run --train

Or:

    $ cd infra/bots; make train

The test generates expectations files for the tests contained within each recipe which illustrate which steps would run, given a particular set of inputs. Pay attention to the diffs in these files when making changes to ensure that your change has the intended effect.