AuroraMiddleware/skia2
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
81a58cfe3b
skia2/infra/bots/recipes/perf_skottietrace.expected/skottietracing_trybot.json

1232 lines
67 KiB
JSON
Raw Normal View History

New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
[
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"ensure-directory",
"--mode",
"0777",
"[START_DIR]/tmp"
],
"infra_step": true,
"name": "makedirs tmp_dir"
},
{
"cmd": [
"python",
"-u",
"import os\nprint os.environ.get('SWARMING_BOT_ID', '')\n"
],
"name": "get swarming bot id",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@print os.environ.get('SWARMING_BOT_ID', '')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"mkdir",
"-p",
"/sdcard/revenge_of_the_skiabot/resources"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "mkdir /sdcard/revenge_of_the_skiabot/resources"
},
[infra] Move app installation to install method This generally makes things tidier (e.g. perf_skottietrace.py no longer needs special logic so that the app is only installed once), and it means iOS can install only the app that's going to be run instead of installing everything. Change-Id: Ic07c56e724d0379255c8da5f204d9d6379b646ec Reviewed-on: https://skia-review.googlesource.com/c/skia/+/273002 Commit-Queue: Ben Wagner aka dogben <benjaminwagner@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2020-02-24 21:45:14 +00:00
{
"cmd": [
"python",
"-u",
"\nimport os\nimport subprocess\nimport sys\nimport time\nADB = sys.argv[1]\ncpu = int(sys.argv[2])\ngov = sys.argv[3]\n\nlog = subprocess.check_output([ADB, 'root'])\n# check for message like 'adbd cannot run as root in production builds'\nprint log\nif 'cannot' in log:\n raise Exception('adb root failed')\n\nsubprocess.check_output([ADB, 'shell', 'echo \"%s\" > '\n '/sys/devices/system/cpu/cpu%d/cpufreq/scaling_governor' % (gov, cpu)])\nactual_gov = subprocess.check_output([ADB, 'shell', 'cat '\n '/sys/devices/system/cpu/cpu%d/cpufreq/scaling_governor' % cpu]).strip()\nif actual_gov != gov:\n raise Exception('(actual, expected) (%s, %s)'\n % (actual_gov, gov))\n",
"/opt/infra-android/tools/adb",
"0",
"hotplug"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "Set CPU 0's governor to hotplug",
"timeout": 30,
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@import time@@@",
"@@@STEP_LOG_LINE@python.inline@ADB = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@cpu = int(sys.argv[2])@@@",
"@@@STEP_LOG_LINE@python.inline@gov = sys.argv[3]@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@log = subprocess.check_output([ADB, 'root'])@@@",
"@@@STEP_LOG_LINE@python.inline@# check for message like 'adbd cannot run as root in production builds'@@@",
"@@@STEP_LOG_LINE@python.inline@print log@@@",
"@@@STEP_LOG_LINE@python.inline@if 'cannot' in log:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('adb root failed')@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_output([ADB, 'shell', 'echo \"%s\" > '@@@",
"@@@STEP_LOG_LINE@python.inline@ '/sys/devices/system/cpu/cpu%d/cpufreq/scaling_governor' % (gov, cpu)])@@@",
"@@@STEP_LOG_LINE@python.inline@actual_gov = subprocess.check_output([ADB, 'shell', 'cat '@@@",
"@@@STEP_LOG_LINE@python.inline@ '/sys/devices/system/cpu/cpu%d/cpufreq/scaling_governor' % cpu]).strip()@@@",
"@@@STEP_LOG_LINE@python.inline@if actual_gov != gov:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('(actual, expected) (%s, %s)'@@@",
"@@@STEP_LOG_LINE@python.inline@ % (actual_gov, gov))@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
"[START_DIR]/build/dm",
"/data/local/tmp/"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push dm"
},
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
Simplify pushing directories to android devices Change-Id: I5f0ce6720be821ae3825b58afc94dbeb2f50e2d8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/372217 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2021-02-18 21:42:18 +00:00
"[START_DIR]/skia/resources",
"/sdcard/revenge_of_the_skiabot/resources"
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Simplify pushing directories to android devices Change-Id: I5f0ce6720be821ae3825b58afc94dbeb2f50e2d8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/372217 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2021-02-18 21:42:18 +00:00
"name": "push [START_DIR]/skia/resources /sdcard/revenge_of_the_skiabot/resources"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
"[START_DIR]/skia/infra/bots/assets/lottie-samples/VERSION",
"/path/to/tmp/"
],
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/acfec855b3a03ad8c28df551c3ea7a6bbee75967 [file][cipd] Run YAPF (joshuaseaton@google.com) https://crrev.com/64c4a05dc93199fc5a8aca78f9427b09bd43776c [file] Add read text to presentation (joshuaseaton@google.com) https://crrev.com/1485ed120ff670c0b32905d28c824e7af6f32aa6 [cipd] Add CIPD UI link to register() presentation (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: If102c0ccd69f1393348bd02d3619ed4b0b6b3d6b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/251820 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-30 21:44:56 +00:00
"name": "Get lottie-samples VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@VERSION@42@@@",
"@@@STEP_LOG_END@VERSION@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
"42",
"[START_DIR]/tmp/LOTTIE_VERSION"
],
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"name": "write LOTTIE_VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@LOTTIE_VERSION@42@@@",
"@@@STEP_LOG_END@LOTTIE_VERSION@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"cat",
"/sdcard/revenge_of_the_skiabot/LOTTIE_VERSION"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/c2ae1f8b058dc210e2f8b1753aa7184973da36a6 Remove stdout and stderr from expectation files. (gbeaty@chromium.org) R=stephana@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Idc32b8c2c426c0bc60b0c57476258b649d9620d1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/216355 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-05-28 18:06:52 +00:00
"name": "read /sdcard/revenge_of_the_skiabot/LOTTIE_VERSION"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/LOTTIE_VERSION"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/LOTTIE_VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/lotties"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/lotties",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"mkdir",
"-p",
"/sdcard/revenge_of_the_skiabot/lotties"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "mkdir /sdcard/revenge_of_the_skiabot/lotties"
},
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
Simplify pushing directories to android devices Change-Id: I5f0ce6720be821ae3825b58afc94dbeb2f50e2d8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/372217 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2021-02-18 21:42:18 +00:00
"[START_DIR]/lottie-samples",
"/sdcard/revenge_of_the_skiabot/lotties"
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Simplify pushing directories to android devices Change-Id: I5f0ce6720be821ae3825b58afc94dbeb2f50e2d8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/372217 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2021-02-18 21:42:18 +00:00
"name": "push [START_DIR]/lottie-samples /sdcard/revenge_of_the_skiabot/lotties"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
"[START_DIR]/tmp/LOTTIE_VERSION",
"/sdcard/revenge_of_the_skiabot/LOTTIE_VERSION"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push [START_DIR]/tmp/LOTTIE_VERSION /sdcard/revenge_of_the_skiabot/LOTTIE_VERSION"
},
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/dm_out"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/dm_out",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"mkdir",
"-p",
"/sdcard/revenge_of_the_skiabot/dm_out"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "mkdir /sdcard/revenge_of_the_skiabot/dm_out"
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"listdir",
"[START_DIR]/lottie-samples"
],
"infra_step": true,
"name": "list lottie files",
"~followup_annotations": [
"@@@STEP_LOG_LINE@listdir@[START_DIR]/lottie-samples/LICENSE@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/lottie-samples/lottie 3!.json@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/lottie-samples/lottie(test)'!2.json@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/lottie-samples/lottie1.json@@@",
"@@@STEP_LOG_END@listdir@@@"
]
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/2.json --match \"^lottie 3!.json$\" --config gles --nocpu; echo $? >/data/local/tmp/rc",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"[START_DIR]/tmp/dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"name": "write dm.sh",
"~followup_annotations": [
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"@@@STEP_LOG_LINE@dm.sh@set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/2.json --match \"^lottie 3!.json$\" --config gles --nocpu; echo $? >/data/local/tmp/rc@@@",
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"@@@STEP_LOG_END@dm.sh@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
"[START_DIR]/tmp/dm.sh",
"/data/local/tmp/"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push dm.sh"
},
[recipes] Dump debugging information before running tests on Android Bug: skia:10539 Change-Id: I57e4ec9a26a662b9e5961dc5f39fbb8414f93de0 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/308996 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2020-08-10 13:57:56 +00:00
{
"cmd": [
"python",
"-u",
"\nimport subprocess\ndef run(*cmd):\n print('====================================')\n print(' '.join(cmd))\n print('====================================')\n subprocess.call(cmd)\nadb = '/opt/infra-android/tools/adb'\nrun('uptime')\nrun(adb, 'shell', 'uptime')\nrun(adb, 'shell', 'ps')\nrun(adb, 'logcat', '-d')\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "debugging",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@def run(*cmd):@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ subprocess.call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@adb = '/opt/infra-android/tools/adb'@@@",
"@@@STEP_LOG_LINE@python.inline@run('uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'ps')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'logcat', '-d')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
"/opt/infra-android/tools/adb",
"logcat",
"-c"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "clear log"
},
{
"cmd": [
"python",
"-u",
"\nimport subprocess\nimport sys\nbin_dir = sys.argv[1]\nsh = sys.argv[2]\nsubprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])\ntry:\n sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',\n bin_dir + 'rc'])))\nexcept ValueError:\n print \"Couldn't read the return code. Probably killed for OOM.\"\n sys.exit(1)\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "dm",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@bin_dir = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@sh = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',@@@",
"@@@STEP_LOG_LINE@python.inline@ bin_dir + 'rc'])))@@@",
"@@@STEP_LOG_LINE@python.inline@except ValueError:@@@",
"@@@STEP_LOG_LINE@python.inline@ print \"Couldn't read the return code. Probably killed for OOM.\"@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(1)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"cat",
"/sdcard/revenge_of_the_skiabot/dm_out/2.json"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/c2ae1f8b058dc210e2f8b1753aa7184973da36a6 Remove stdout and stderr from expectation files. (gbeaty@chromium.org) R=stephana@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Idc32b8c2c426c0bc60b0c57476258b649d9620d1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/216355 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-05-28 18:06:52 +00:00
"name": "read /sdcard/revenge_of_the_skiabot/dm_out/2.json"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"python",
"-u",
Reland "[skottie] Remove defensive seek(0) from Animation ctor" This reverts commit e0f374bf8fd9b05f9171a90cd17da205886f413f. Reason for revert: including tracing fix Original change's description: > Revert "[skottie] Remove defensive seek(0) from Animation ctor" > > This reverts commit 042fe0847b06d63fa95d419f3c299710d0247d32. > > Reason for revert: SkottieTracing bots not happy. > > Original change's description: > > [skottie] Remove defensive seek(0) from Animation ctor > > > > It potentially causes unnecessary image frame loads. > > > > Well-behaved clients should always seek() before calling render(). > > > > Bug: skia:9686 > > Change-Id: If16257dc947941541d9ae8906b5ec7b1754dd7df > > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257625 > > Reviewed-by: Mike Reed <reed@google.com> > > Commit-Queue: Florin Malita <fmalita@chromium.org> > > TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com > > Change-Id: I3b7efdfc8e0aed1deb8756d585f946b4309d469d > No-Presubmit: true > No-Tree-Checks: true > No-Try: true > Bug: skia:9686 > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257630 > Reviewed-by: Florin Malita <fmalita@chromium.org> > Commit-Queue: Florin Malita <fmalita@chromium.org> TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com Bug: skia:9686 Change-Id: Ib8a5d76821685cfa7e7dac61bcc31da5629d9055 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257632 Reviewed-by: Florin Malita <fmalita@chromium.org> Commit-Queue: Florin Malita <fmalita@chromium.org>
2019-12-03 17:49:27 +00:00
"\nimport json\nimport sys\n\ntrace_output = sys.argv[1]\ntrace_json = json.loads(trace_output)\nlottie_filename = sys.argv[2]\noutput_json_file = sys.argv[3]\n\nperf_results = {}\nframe_max = 0\nframe_min = 0\nframe_cumulative = 0\ncurrent_frame_duration = 0\ntotal_frames = 0\nframe_start = False\nfor trace in trace_json:\n if 'skottie::Animation::seek' in trace['name']:\n if frame_start:\n raise Exception('We got consecutive Animation::seek without a ' +\n 'render. Something is wrong.')\n frame_start = True\n current_frame_duration = trace['dur']\n elif 'skottie::Animation::render' in trace['name']:\n if not frame_start:\n raise Exception('We got an Animation::render without a seek first. ' +\n 'Something is wrong.')\n\n current_frame_duration += trace['dur']\n frame_start = False\n total_frames += 1\n frame_max = max(frame_max, current_frame_duration)\n frame_min = (min(frame_min, current_frame_duration)\n if frame_min else current_frame_duration)\n frame_cumulative += current_frame_duration\n\nexpected_dm_frames = 25\nif total_frames != expected_dm_frames:\n raise Exception(\n 'Got ' + str(total_frames) + ' frames instead of ' +\n str(expected_dm_frames))\nperf_results['frame_max_us'] = frame_max\nperf_results['frame_min_us'] = frame_min\nperf_results['frame_avg_us'] = frame_cumulative/total_frames\n\n# Write perf_results to the output json.\nwith open(output_json_file, 'w') as f:\n f.write(json.dumps(perf_results))\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"\n[{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":452,\"dur\":2.57,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPaint(const SkPaint &)\",\"ts\":473,\"dur\":2.67e+03,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.15e+03,\"dur\":2.25,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.15e+03,\"dur\":216,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPath(const SkPath &, const SkPaint &)\",\"ts\":3.35e+03,\"dur\":15.1,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.37e+03,\"dur\":1.17,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.37e+03,\"dur\":140,\"tid\":1,\"pid\":0}]\n",
"lottie 3!.json",
"/path/to/tmp/json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "parse lottie 3!.json trace",
"~followup_annotations": [
"@@@STEP_LOG_LINE@json.output@{@@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_avg_us\": 179.71, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_max_us\": 218.25, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_min_us\": 141.17@@@",
"@@@STEP_LOG_LINE@json.output@}@@@",
"@@@STEP_LOG_END@json.output@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import json@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@trace_output = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@trace_json = json.loads(trace_output)@@@",
"@@@STEP_LOG_LINE@python.inline@lottie_filename = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@output_json_file = sys.argv[3]@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results = {}@@@",
"@@@STEP_LOG_LINE@python.inline@frame_max = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_min = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_cumulative = 0@@@",
"@@@STEP_LOG_LINE@python.inline@current_frame_duration = 0@@@",
"@@@STEP_LOG_LINE@python.inline@total_frames = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@for trace in trace_json:@@@",
"@@@STEP_LOG_LINE@python.inline@ if 'skottie::Animation::seek' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got consecutive Animation::seek without a ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'render. Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = True@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration = trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ elif 'skottie::Animation::render' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if not frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got an Animation::render without a seek first. ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration += trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@ total_frames += 1@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_max = max(frame_max, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_min = (min(frame_min, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_min else current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_cumulative += current_frame_duration@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@expected_dm_frames = 25@@@",
"@@@STEP_LOG_LINE@python.inline@if total_frames != expected_dm_frames:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception(@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Got ' + str(total_frames) + ' frames instead of ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ str(expected_dm_frames))@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_max_us'] = frame_max@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_min_us'] = frame_min@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_avg_us'] = frame_cumulative/total_frames@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Write perf_results to the output json.@@@",
"@@@STEP_LOG_LINE@python.inline@with open(output_json_file, 'w') as f:@@@",
"@@@STEP_LOG_LINE@python.inline@ f.write(json.dumps(perf_results))@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/dm_out/2.json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/dm_out/2.json",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/3.json --match \\^lottie\\(test\\)\\'\\!2\\.json\\$ --config gles --nocpu; echo $? >/data/local/tmp/rc",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"[START_DIR]/tmp/dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"name": "write dm.sh (2)",
"~followup_annotations": [
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"@@@STEP_LOG_LINE@dm.sh@set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/3.json --match \\^lottie\\(test\\)\\'\\!2\\.json\\$ --config gles --nocpu; echo $? >/data/local/tmp/rc@@@",
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"@@@STEP_LOG_END@dm.sh@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
"[START_DIR]/tmp/dm.sh",
"/data/local/tmp/"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push dm.sh (2)"
},
[recipes] Dump debugging information before running tests on Android Bug: skia:10539 Change-Id: I57e4ec9a26a662b9e5961dc5f39fbb8414f93de0 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/308996 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2020-08-10 13:57:56 +00:00
{
"cmd": [
"python",
"-u",
"\nimport subprocess\ndef run(*cmd):\n print('====================================')\n print(' '.join(cmd))\n print('====================================')\n subprocess.call(cmd)\nadb = '/opt/infra-android/tools/adb'\nrun('uptime')\nrun(adb, 'shell', 'uptime')\nrun(adb, 'shell', 'ps')\nrun(adb, 'logcat', '-d')\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "debugging (2)",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@def run(*cmd):@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ subprocess.call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@adb = '/opt/infra-android/tools/adb'@@@",
"@@@STEP_LOG_LINE@python.inline@run('uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'ps')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'logcat', '-d')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
"/opt/infra-android/tools/adb",
"logcat",
"-c"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "clear log (2)"
},
{
"cmd": [
"python",
"-u",
"\nimport subprocess\nimport sys\nbin_dir = sys.argv[1]\nsh = sys.argv[2]\nsubprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])\ntry:\n sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',\n bin_dir + 'rc'])))\nexcept ValueError:\n print \"Couldn't read the return code. Probably killed for OOM.\"\n sys.exit(1)\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "dm (2)",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@bin_dir = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@sh = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',@@@",
"@@@STEP_LOG_LINE@python.inline@ bin_dir + 'rc'])))@@@",
"@@@STEP_LOG_LINE@python.inline@except ValueError:@@@",
"@@@STEP_LOG_LINE@python.inline@ print \"Couldn't read the return code. Probably killed for OOM.\"@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(1)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"cat",
"/sdcard/revenge_of_the_skiabot/dm_out/3.json"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/c2ae1f8b058dc210e2f8b1753aa7184973da36a6 Remove stdout and stderr from expectation files. (gbeaty@chromium.org) R=stephana@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Idc32b8c2c426c0bc60b0c57476258b649d9620d1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/216355 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-05-28 18:06:52 +00:00
"name": "read /sdcard/revenge_of_the_skiabot/dm_out/3.json"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"python",
"-u",
Reland "[skottie] Remove defensive seek(0) from Animation ctor" This reverts commit e0f374bf8fd9b05f9171a90cd17da205886f413f. Reason for revert: including tracing fix Original change's description: > Revert "[skottie] Remove defensive seek(0) from Animation ctor" > > This reverts commit 042fe0847b06d63fa95d419f3c299710d0247d32. > > Reason for revert: SkottieTracing bots not happy. > > Original change's description: > > [skottie] Remove defensive seek(0) from Animation ctor > > > > It potentially causes unnecessary image frame loads. > > > > Well-behaved clients should always seek() before calling render(). > > > > Bug: skia:9686 > > Change-Id: If16257dc947941541d9ae8906b5ec7b1754dd7df > > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257625 > > Reviewed-by: Mike Reed <reed@google.com> > > Commit-Queue: Florin Malita <fmalita@chromium.org> > > TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com > > Change-Id: I3b7efdfc8e0aed1deb8756d585f946b4309d469d > No-Presubmit: true > No-Tree-Checks: true > No-Try: true > Bug: skia:9686 > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257630 > Reviewed-by: Florin Malita <fmalita@chromium.org> > Commit-Queue: Florin Malita <fmalita@chromium.org> TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com Bug: skia:9686 Change-Id: Ib8a5d76821685cfa7e7dac61bcc31da5629d9055 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257632 Reviewed-by: Florin Malita <fmalita@chromium.org> Commit-Queue: Florin Malita <fmalita@chromium.org>
2019-12-03 17:49:27 +00:00
"\nimport json\nimport sys\n\ntrace_output = sys.argv[1]\ntrace_json = json.loads(trace_output)\nlottie_filename = sys.argv[2]\noutput_json_file = sys.argv[3]\n\nperf_results = {}\nframe_max = 0\nframe_min = 0\nframe_cumulative = 0\ncurrent_frame_duration = 0\ntotal_frames = 0\nframe_start = False\nfor trace in trace_json:\n if 'skottie::Animation::seek' in trace['name']:\n if frame_start:\n raise Exception('We got consecutive Animation::seek without a ' +\n 'render. Something is wrong.')\n frame_start = True\n current_frame_duration = trace['dur']\n elif 'skottie::Animation::render' in trace['name']:\n if not frame_start:\n raise Exception('We got an Animation::render without a seek first. ' +\n 'Something is wrong.')\n\n current_frame_duration += trace['dur']\n frame_start = False\n total_frames += 1\n frame_max = max(frame_max, current_frame_duration)\n frame_min = (min(frame_min, current_frame_duration)\n if frame_min else current_frame_duration)\n frame_cumulative += current_frame_duration\n\nexpected_dm_frames = 25\nif total_frames != expected_dm_frames:\n raise Exception(\n 'Got ' + str(total_frames) + ' frames instead of ' +\n str(expected_dm_frames))\nperf_results['frame_max_us'] = frame_max\nperf_results['frame_min_us'] = frame_min\nperf_results['frame_avg_us'] = frame_cumulative/total_frames\n\n# Write perf_results to the output json.\nwith open(output_json_file, 'w') as f:\n f.write(json.dumps(perf_results))\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"\n[{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":452,\"dur\":2.57,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPaint(const SkPaint &)\",\"ts\":473,\"dur\":2.67e+03,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.15e+03,\"dur\":2.25,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.15e+03,\"dur\":216,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPath(const SkPath &, const SkPaint &)\",\"ts\":3.35e+03,\"dur\":15.1,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.37e+03,\"dur\":1.17,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.37e+03,\"dur\":140,\"tid\":1,\"pid\":0}]\n",
"lottie(test)'!2.json",
"/path/to/tmp/json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "parse lottie(test)'!2.json trace",
"~followup_annotations": [
"@@@STEP_LOG_LINE@json.output@{@@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_avg_us\": 179.71, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_max_us\": 218.25, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_min_us\": 141.17@@@",
"@@@STEP_LOG_LINE@json.output@}@@@",
"@@@STEP_LOG_END@json.output@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import json@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@trace_output = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@trace_json = json.loads(trace_output)@@@",
"@@@STEP_LOG_LINE@python.inline@lottie_filename = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@output_json_file = sys.argv[3]@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results = {}@@@",
"@@@STEP_LOG_LINE@python.inline@frame_max = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_min = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_cumulative = 0@@@",
"@@@STEP_LOG_LINE@python.inline@current_frame_duration = 0@@@",
"@@@STEP_LOG_LINE@python.inline@total_frames = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@for trace in trace_json:@@@",
"@@@STEP_LOG_LINE@python.inline@ if 'skottie::Animation::seek' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got consecutive Animation::seek without a ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'render. Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = True@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration = trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ elif 'skottie::Animation::render' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if not frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got an Animation::render without a seek first. ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration += trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@ total_frames += 1@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_max = max(frame_max, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_min = (min(frame_min, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_min else current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_cumulative += current_frame_duration@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@expected_dm_frames = 25@@@",
"@@@STEP_LOG_LINE@python.inline@if total_frames != expected_dm_frames:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception(@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Got ' + str(total_frames) + ' frames instead of ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ str(expected_dm_frames))@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_max_us'] = frame_max@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_min_us'] = frame_min@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_avg_us'] = frame_cumulative/total_frames@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Write perf_results to the output json.@@@",
"@@@STEP_LOG_LINE@python.inline@with open(output_json_file, 'w') as f:@@@",
"@@@STEP_LOG_LINE@python.inline@ f.write(json.dumps(perf_results))@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/dm_out/3.json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/dm_out/3.json",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/4.json --match \\^lottie1\\.json\\$ --config gles --nocpu; echo $? >/data/local/tmp/rc",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"[START_DIR]/tmp/dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"name": "write dm.sh (3)",
"~followup_annotations": [
not all bots have `env` That's okay, that's really just me being pedantic anyway. Change-Id: I45a0f6b4866daff752169304da171c223016cac8 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/289685 Reviewed-by: Mike Klein <mtklein@google.com> Commit-Queue: Mike Klein <mtklein@google.com>
2020-05-14 01:18:37 +00:00
"@@@STEP_LOG_LINE@dm.sh@set -x; LD_LIBRARY_PATH=/data/local/tmp/ /data/local/tmp/dm --resourcePath /sdcard/revenge_of_the_skiabot/resources --lotties /sdcard/revenge_of_the_skiabot/lotties --src lottie --nonativeFonts --verbose --traceMatch skottie --trace /sdcard/revenge_of_the_skiabot/dm_out/4.json --match \\^lottie1\\.json\\$ --config gles --nocpu; echo $? >/data/local/tmp/rc@@@",
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/4b7e794e4dbf7abefd1732b76ff9539570d0be7f [file] Record written data in step presentation. (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Ic59ac87f9de5f6abe73e03feb5a94ce4b0dd35f1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/222573 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-06-25 11:15:57 +00:00
"@@@STEP_LOG_END@dm.sh@@@"
]
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"push",
"[START_DIR]/tmp/dm.sh",
"/data/local/tmp/"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push dm.sh (3)"
},
[recipes] Dump debugging information before running tests on Android Bug: skia:10539 Change-Id: I57e4ec9a26a662b9e5961dc5f39fbb8414f93de0 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/308996 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Eric Boren <borenet@google.com>
2020-08-10 13:57:56 +00:00
{
"cmd": [
"python",
"-u",
"\nimport subprocess\ndef run(*cmd):\n print('====================================')\n print(' '.join(cmd))\n print('====================================')\n subprocess.call(cmd)\nadb = '/opt/infra-android/tools/adb'\nrun('uptime')\nrun(adb, 'shell', 'uptime')\nrun(adb, 'shell', 'ps')\nrun(adb, 'logcat', '-d')\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "debugging (3)",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@def run(*cmd):@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@ print('====================================')@@@",
"@@@STEP_LOG_LINE@python.inline@ subprocess.call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@adb = '/opt/infra-android/tools/adb'@@@",
"@@@STEP_LOG_LINE@python.inline@run('uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'uptime')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'shell', 'ps')@@@",
"@@@STEP_LOG_LINE@python.inline@run(adb, 'logcat', '-d')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
"/opt/infra-android/tools/adb",
"logcat",
"-c"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "clear log (3)"
},
{
"cmd": [
"python",
"-u",
"\nimport subprocess\nimport sys\nbin_dir = sys.argv[1]\nsh = sys.argv[2]\nsubprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])\ntry:\n sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',\n bin_dir + 'rc'])))\nexcept ValueError:\n print \"Couldn't read the return code. Probably killed for OOM.\"\n sys.exit(1)\n",
"/data/local/tmp/",
"dm.sh"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "dm (3)",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@bin_dir = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@sh = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(['/opt/infra-android/tools/adb', 'shell', 'sh', bin_dir + sh])@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(int(subprocess.check_output(['/opt/infra-android/tools/adb', 'shell', 'cat',@@@",
"@@@STEP_LOG_LINE@python.inline@ bin_dir + 'rc'])))@@@",
"@@@STEP_LOG_LINE@python.inline@except ValueError:@@@",
"@@@STEP_LOG_LINE@python.inline@ print \"Couldn't read the return code. Probably killed for OOM.\"@@@",
"@@@STEP_LOG_LINE@python.inline@ sys.exit(1)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"shell",
"cat",
"/sdcard/revenge_of_the_skiabot/dm_out/4.json"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/c2ae1f8b058dc210e2f8b1753aa7184973da36a6 Remove stdout and stderr from expectation files. (gbeaty@chromium.org) R=stephana@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: Idc32b8c2c426c0bc60b0c57476258b649d9620d1 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/216355 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Robbie Iannucci <iannucci@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-05-28 18:06:52 +00:00
"name": "read /sdcard/revenge_of_the_skiabot/dm_out/4.json"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
},
{
"cmd": [
"python",
"-u",
Reland "[skottie] Remove defensive seek(0) from Animation ctor" This reverts commit e0f374bf8fd9b05f9171a90cd17da205886f413f. Reason for revert: including tracing fix Original change's description: > Revert "[skottie] Remove defensive seek(0) from Animation ctor" > > This reverts commit 042fe0847b06d63fa95d419f3c299710d0247d32. > > Reason for revert: SkottieTracing bots not happy. > > Original change's description: > > [skottie] Remove defensive seek(0) from Animation ctor > > > > It potentially causes unnecessary image frame loads. > > > > Well-behaved clients should always seek() before calling render(). > > > > Bug: skia:9686 > > Change-Id: If16257dc947941541d9ae8906b5ec7b1754dd7df > > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257625 > > Reviewed-by: Mike Reed <reed@google.com> > > Commit-Queue: Florin Malita <fmalita@chromium.org> > > TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com > > Change-Id: I3b7efdfc8e0aed1deb8756d585f946b4309d469d > No-Presubmit: true > No-Tree-Checks: true > No-Try: true > Bug: skia:9686 > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257630 > Reviewed-by: Florin Malita <fmalita@chromium.org> > Commit-Queue: Florin Malita <fmalita@chromium.org> TBR=fmalita@chromium.org,reed@google.com,aparchur@google.com Bug: skia:9686 Change-Id: Ib8a5d76821685cfa7e7dac61bcc31da5629d9055 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/257632 Reviewed-by: Florin Malita <fmalita@chromium.org> Commit-Queue: Florin Malita <fmalita@chromium.org>
2019-12-03 17:49:27 +00:00
"\nimport json\nimport sys\n\ntrace_output = sys.argv[1]\ntrace_json = json.loads(trace_output)\nlottie_filename = sys.argv[2]\noutput_json_file = sys.argv[3]\n\nperf_results = {}\nframe_max = 0\nframe_min = 0\nframe_cumulative = 0\ncurrent_frame_duration = 0\ntotal_frames = 0\nframe_start = False\nfor trace in trace_json:\n if 'skottie::Animation::seek' in trace['name']:\n if frame_start:\n raise Exception('We got consecutive Animation::seek without a ' +\n 'render. Something is wrong.')\n frame_start = True\n current_frame_duration = trace['dur']\n elif 'skottie::Animation::render' in trace['name']:\n if not frame_start:\n raise Exception('We got an Animation::render without a seek first. ' +\n 'Something is wrong.')\n\n current_frame_duration += trace['dur']\n frame_start = False\n total_frames += 1\n frame_max = max(frame_max, current_frame_duration)\n frame_min = (min(frame_min, current_frame_duration)\n if frame_min else current_frame_duration)\n frame_cumulative += current_frame_duration\n\nexpected_dm_frames = 25\nif total_frames != expected_dm_frames:\n raise Exception(\n 'Got ' + str(total_frames) + ' frames instead of ' +\n str(expected_dm_frames))\nperf_results['frame_max_us'] = frame_max\nperf_results['frame_min_us'] = frame_min\nperf_results['frame_avg_us'] = frame_cumulative/total_frames\n\n# Write perf_results to the output json.\nwith open(output_json_file, 'w') as f:\n f.write(json.dumps(perf_results))\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"\n[{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":452,\"dur\":2.57,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPaint(const SkPaint &)\",\"ts\":473,\"dur\":2.67e+03,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.15e+03,\"dur\":2.25,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.15e+03,\"dur\":216,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void SkCanvas::drawPath(const SkPath &, const SkPaint &)\",\"ts\":3.35e+03,\"dur\":15.1,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::seek(SkScalar)\",\"ts\":3.37e+03,\"dur\":1.17,\"tid\":1,\"pid\":0},{\"ph\":\"X\",\"name\":\"void skottie::Animation::render(SkCanvas *, const SkRect *, RenderFlags) const\",\"ts\":3.37e+03,\"dur\":140,\"tid\":1,\"pid\":0}]\n",
"lottie1.json",
"/path/to/tmp/json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "parse lottie1.json trace",
"~followup_annotations": [
"@@@STEP_LOG_LINE@json.output@{@@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_avg_us\": 179.71, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_max_us\": 218.25, @@@",
"@@@STEP_LOG_LINE@json.output@ \"frame_min_us\": 141.17@@@",
"@@@STEP_LOG_LINE@json.output@}@@@",
"@@@STEP_LOG_END@json.output@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import json@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@trace_output = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@trace_json = json.loads(trace_output)@@@",
"@@@STEP_LOG_LINE@python.inline@lottie_filename = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@output_json_file = sys.argv[3]@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results = {}@@@",
"@@@STEP_LOG_LINE@python.inline@frame_max = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_min = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_cumulative = 0@@@",
"@@@STEP_LOG_LINE@python.inline@current_frame_duration = 0@@@",
"@@@STEP_LOG_LINE@python.inline@total_frames = 0@@@",
"@@@STEP_LOG_LINE@python.inline@frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@for trace in trace_json:@@@",
"@@@STEP_LOG_LINE@python.inline@ if 'skottie::Animation::seek' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got consecutive Animation::seek without a ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'render. Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = True@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration = trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ elif 'skottie::Animation::render' in trace['name']:@@@",
"@@@STEP_LOG_LINE@python.inline@ if not frame_start:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('We got an Animation::render without a seek first. ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Something is wrong.')@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@ current_frame_duration += trace['dur']@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_start = False@@@",
"@@@STEP_LOG_LINE@python.inline@ total_frames += 1@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_max = max(frame_max, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_min = (min(frame_min, current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ if frame_min else current_frame_duration)@@@",
"@@@STEP_LOG_LINE@python.inline@ frame_cumulative += current_frame_duration@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@expected_dm_frames = 25@@@",
"@@@STEP_LOG_LINE@python.inline@if total_frames != expected_dm_frames:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception(@@@",
"@@@STEP_LOG_LINE@python.inline@ 'Got ' + str(total_frames) + ' frames instead of ' +@@@",
"@@@STEP_LOG_LINE@python.inline@ str(expected_dm_frames))@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_max_us'] = frame_max@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_min_us'] = frame_min@@@",
"@@@STEP_LOG_LINE@python.inline@perf_results['frame_avg_us'] = frame_cumulative/total_frames@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Write perf_results to the output json.@@@",
"@@@STEP_LOG_LINE@python.inline@with open(output_json_file, 'w') as f:@@@",
"@@@STEP_LOG_LINE@python.inline@ f.write(json.dumps(perf_results))@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
"/opt/infra-android/tools/adb",
"/sdcard/revenge_of_the_skiabot/dm_out/4.json"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/dm_out/4.json",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
[Recipe] Add CPU bot capability to perf_skottietrace.py Bug: skia:8901 Change-Id: I6e0f2b57987a60c1d4f2d2dc0d92df640d15e08d Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202906 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-25 14:32:07 +00:00
},
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
{
"cmd": [
"python",
"-u",
"import os\nprint os.environ.get('SWARMING_BOT_ID', '')\n"
],
"name": "get swarming bot id (2)",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@print os.environ.get('SWARMING_BOT_ID', '')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"python",
"-u",
"import os\nprint os.environ.get('SWARMING_TASK_ID', '')\n"
],
"name": "get swarming task id",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@print os.environ.get('SWARMING_TASK_ID', '')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"ensure-directory",
"--mode",
"0777",
"[START_DIR]/[SWARM_OUT_DIR]"
],
"infra_step": true,
"name": "makedirs perf_dir"
},
{
"cmd": [
"python",
"-u",
Fix ingested perf data from Skottie tracing bots + add renderer key Notry: true Bug: skia:8884 Change-Id: I8222145b843db971269a85ab7bb4a768125ef3fa Reviewed-on: https://skia-review.googlesource.com/c/skia/+/221356 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Joe Gregorio <jcgregorio@google.com>
2019-06-17 17:56:10 +00:00
"import json\nwith open('[START_DIR]/[SWARM_OUT_DIR]/perf_abc123_1337000001.json', 'w') as outfile:\n json.dump(obj={'gitHash': 'abc123', 'results': {\"lottie(test)'!2.json\": {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}, 'lottie1.json': {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}, 'lottie 3!.json': {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}}, 'patch_storage': 'gerrit', 'swarming_task_id': '', 'renderer': 'skottie', 'key': {'extra_config': 'Android_SkottieTracing', 'bench_type': 'tracing', 'cpu_or_gpu_value': 'Mali400MP2', 'arch': 'arm', 'source_type': 'skottie', 'cpu_or_gpu': 'GPU', 'model': 'AndroidOne', 'configuration': 'Release', 'os': 'Android', 'compiler': 'Clang'}, 'swarming_bot_id': '', 'patchset': 7, 'issue': 1234}, fp=outfile, indent=4)\n"
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
Fix upload collisions in the AndroidOne SkottieTracing bot Bug: skia:8884 Change-Id: I059be73709b9ee75cd6d84ccfc8ceacb16fab8f3 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202900 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Ravi Mistry <rmistry@google.com>
2019-03-21 20:21:56 +00:00
"name": "write output JSON",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import json@@@",
Fix upload collisions in the AndroidOne SkottieTracing bot Bug: skia:8884 Change-Id: I059be73709b9ee75cd6d84ccfc8ceacb16fab8f3 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/202900 Reviewed-by: Ravi Mistry <rmistry@google.com> Commit-Queue: Ravi Mistry <rmistry@google.com>
2019-03-21 20:21:56 +00:00
"@@@STEP_LOG_LINE@python.inline@with open('[START_DIR]/[SWARM_OUT_DIR]/perf_abc123_1337000001.json', 'w') as outfile:@@@",
Fix ingested perf data from Skottie tracing bots + add renderer key Notry: true Bug: skia:8884 Change-Id: I8222145b843db971269a85ab7bb4a768125ef3fa Reviewed-on: https://skia-review.googlesource.com/c/skia/+/221356 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Joe Gregorio <jcgregorio@google.com>
2019-06-17 17:56:10 +00:00
"@@@STEP_LOG_LINE@python.inline@ json.dump(obj={'gitHash': 'abc123', 'results': {\"lottie(test)'!2.json\": {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}, 'lottie1.json': {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}, 'lottie 3!.json': {'gles': {'frame_avg_us': 179.71, 'frame_max_us': 218.25, 'frame_min_us': 141.17}}}, 'patch_storage': 'gerrit', 'swarming_task_id': '', 'renderer': 'skottie', 'key': {'extra_config': 'Android_SkottieTracing', 'bench_type': 'tracing', 'cpu_or_gpu_value': 'Mali400MP2', 'arch': 'arm', 'source_type': 'skottie', 'cpu_or_gpu': 'GPU', 'model': 'AndroidOne', 'configuration': 'Release', 'os': 'Android', 'compiler': 'Clang'}, 'swarming_bot_id': '', 'patchset': 7, 'issue': 1234}, fp=outfile, indent=4)@@@",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"python",
"-u",
[infra] Handle failure from addr2line An error from addr2line (e.g. unknown binary type) can truncate the output, hiding the remainder of the stack trace. Instead print the original line. Change-Id: I563aae4333a79a17560378e399e79b60c79f9ac7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/261288 Commit-Queue: Kevin Lubick <kjlubick@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2019-12-21 00:06:12 +00:00
"\nimport os\nimport subprocess\nimport sys\nout = sys.argv[1]\nlog = subprocess.check_output(['/opt/infra-android/tools/adb', 'logcat', '-d'])\nfor line in log.split('\\n'):\n tokens = line.split()\n if len(tokens) == 11 and tokens[-7] == 'F' and tokens[-3] == 'pc':\n addr, path = tokens[-2:]\n local = os.path.join(out, os.path.basename(path))\n if os.path.exists(local):\n try:\n sym = subprocess.check_output(['addr2line', '-Cfpe', local, addr])\n line = line.replace(addr, addr + ' ' + sym.strip())\n except subprocess.CalledProcessError:\n pass\n print line\n",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"[START_DIR]/build"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "dump log",
"timeout": 300,
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@out = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@log = subprocess.check_output(['/opt/infra-android/tools/adb', 'logcat', '-d'])@@@",
"@@@STEP_LOG_LINE@python.inline@for line in log.split('\\n'):@@@",
"@@@STEP_LOG_LINE@python.inline@ tokens = line.split()@@@",
"@@@STEP_LOG_LINE@python.inline@ if len(tokens) == 11 and tokens[-7] == 'F' and tokens[-3] == 'pc':@@@",
"@@@STEP_LOG_LINE@python.inline@ addr, path = tokens[-2:]@@@",
"@@@STEP_LOG_LINE@python.inline@ local = os.path.join(out, os.path.basename(path))@@@",
"@@@STEP_LOG_LINE@python.inline@ if os.path.exists(local):@@@",
[infra] Handle failure from addr2line An error from addr2line (e.g. unknown binary type) can truncate the output, hiding the remainder of the stack trace. Instead print the original line. Change-Id: I563aae4333a79a17560378e399e79b60c79f9ac7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/261288 Commit-Queue: Kevin Lubick <kjlubick@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2019-12-21 00:06:12 +00:00
"@@@STEP_LOG_LINE@python.inline@ try:@@@",
"@@@STEP_LOG_LINE@python.inline@ sym = subprocess.check_output(['addr2line', '-Cfpe', local, addr])@@@",
"@@@STEP_LOG_LINE@python.inline@ line = line.replace(addr, addr + ' ' + sym.strip())@@@",
"@@@STEP_LOG_LINE@python.inline@ except subprocess.CalledProcessError:@@@",
"@@@STEP_LOG_LINE@python.inline@ pass@@@",
New perf-skottietrace recipe The recipe runs DM on lottie files with tracing enabled. DM will grab 25 samples evenly distributed across the timeline and the trace will be outputted with Animation entry points. The output of the trace is then parsed and written into perf.json for perf.skia.org ingestion. Example resultant perf.json: https://isolateserver.appspot.com/browse?namespace=default-gzip&digest=31f605ad3c9047f2889893654d57344502794371&as=perf.json Recipe would run on android devices. Bug: skia:8884 Change-Id: I70715febf2bfbd7b1f8fcbd872cb4709638eabd7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/201472 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-03-21 16:09:15 +00:00
"@@@STEP_LOG_LINE@python.inline@ print line@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/opt/infra-android/tools/adb",
"kill-server"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/chrome_infrastructure_adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "kill adb server"
},
{
"name": "$result"
}
]
Reference in New Issue Copy Permalink