AuroraMiddleware/skia2
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
3cc4afc703
skia2/infra/bots/recipes/skpbench.expected/Perf-Android-Clang-Pixel-GPU-Adreno530-arm64-Release-All-Android_Skpbench_Mskp.json

462 lines
16 KiB
JSON
Raw Normal View History

Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
[
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"ensure-directory",
"--mode",
"0777",
"[START_DIR]/tmp"
],
"infra_step": true,
"name": "makedirs tmp_dir"
},
{
"cmd": [
"python",
"-u",
"import os\nprint os.environ.get('SWARMING_BOT_ID', '')\n"
],
"name": "get swarming bot id",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@print os.environ.get('SWARMING_BOT_ID', '')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"shell",
"mkdir",
"-p",
"/sdcard/revenge_of_the_skiabot/resources"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "mkdir /sdcard/revenge_of_the_skiabot/resources"
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
"[START_DIR]/skia/infra/bots/assets/mskp/VERSION",
"/path/to/tmp/"
],
"infra_step": true,
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/acfec855b3a03ad8c28df551c3ea7a6bbee75967 [file][cipd] Run YAPF (joshuaseaton@google.com) https://crrev.com/64c4a05dc93199fc5a8aca78f9427b09bd43776c [file] Add read text to presentation (joshuaseaton@google.com) https://crrev.com/1485ed120ff670c0b32905d28c824e7af6f32aa6 [cipd] Add CIPD UI link to register() presentation (joshuaseaton@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: If102c0ccd69f1393348bd02d3619ed4b0b6b3d6b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/251820 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-30 21:44:56 +00:00
"name": "Get mskp VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@VERSION@42@@@",
"@@@STEP_LOG_END@VERSION@@@"
]
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"copy",
"42",
"[START_DIR]/tmp/MSKP_VERSION"
],
"infra_step": true,
"name": "write MSKP_VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@MSKP_VERSION@42@@@",
"@@@STEP_LOG_END@MSKP_VERSION@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"shell",
"cat",
"/sdcard/revenge_of_the_skiabot/MSKP_VERSION"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "read /sdcard/revenge_of_the_skiabot/MSKP_VERSION"
},
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"/usr/bin/adb.1.0.35",
"/sdcard/revenge_of_the_skiabot/MSKP_VERSION"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/MSKP_VERSION",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
},
{
"cmd": [
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"python",
"-u",
"\nimport subprocess\nimport sys\n\n# Remove the path.\nadb = sys.argv[1]\npath = sys.argv[2]\nprint('Removing %s' % path)\ncmd = [adb, 'shell', 'rm', '-rf', path]\nprint(' '.join(cmd))\nsubprocess.check_call(cmd)\n\n# Verify that the path was deleted.\nprint('Checking for existence of %s' % path)\ncmd = [adb, 'shell', 'ls', path]\nprint(' '.join(cmd))\ntry:\n output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)\nexcept subprocess.CalledProcessError as e:\n output = e.output\nprint('Output was:')\nprint('======')\nprint(output)\nprint('======')\nif 'No such file or directory' not in output:\n raise Exception('%s exists despite being deleted' % path)\n",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"/usr/bin/adb.1.0.35",
"/sdcard/revenge_of_the_skiabot/mskp"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
Reland "[recipes] Verify that we actually deleted the file/dir on android" This is a reland of aed15a701a317bdbb5a67ac0b497ea28626a9e71 Original change's description: > [recipes] Verify that we actually deleted the file/dir on android > > Bug: skia:10539 > Change-Id: I3b51ef8c0106ac439f14a7f0ff61c8b88c7152ff > Reviewed-on: https://skia-review.googlesource.com/c/skia/+/305957 > Reviewed-by: Ravi Mistry <rmistry@google.com> > Reviewed-by: Kevin Lubick <kjlubick@google.com> > Commit-Queue: Eric Boren <borenet@google.com> Bug: skia:10539 Change-Id: I23c6f85e5d446eea3fbd61cff3db29379e0b0702 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/307794 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Ravi Mistry <rmistry@google.com>
2020-08-04 18:19:16 +00:00
"name": "rm /sdcard/revenge_of_the_skiabot/mskp",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Remove the path.@@@",
"@@@STEP_LOG_LINE@python.inline@adb = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@path = sys.argv[2]@@@",
"@@@STEP_LOG_LINE@python.inline@print('Removing %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'rm', '-rf', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@subprocess.check_call(cmd)@@@",
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@# Verify that the path was deleted.@@@",
"@@@STEP_LOG_LINE@python.inline@print('Checking for existence of %s' % path)@@@",
"@@@STEP_LOG_LINE@python.inline@cmd = [adb, 'shell', 'ls', path]@@@",
"@@@STEP_LOG_LINE@python.inline@print(' '.join(cmd))@@@",
"@@@STEP_LOG_LINE@python.inline@try:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = subprocess.check_output(cmd, stderr=subprocess.STDOUT)@@@",
"@@@STEP_LOG_LINE@python.inline@except subprocess.CalledProcessError as e:@@@",
"@@@STEP_LOG_LINE@python.inline@ output = e.output@@@",
"@@@STEP_LOG_LINE@python.inline@print('Output was:')@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@print(output)@@@",
"@@@STEP_LOG_LINE@python.inline@print('======')@@@",
"@@@STEP_LOG_LINE@python.inline@if 'No such file or directory' not in output:@@@",
"@@@STEP_LOG_LINE@python.inline@ raise Exception('%s exists despite being deleted' % path)@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"shell",
"mkdir",
"-p",
"/sdcard/revenge_of_the_skiabot/mskp"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "mkdir /sdcard/revenge_of_the_skiabot/mskp"
},
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
{
"cmd": [],
"name": "push [START_DIR]/mskp/* /sdcard/revenge_of_the_skiabot/mskp"
},
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
{
"cmd": [
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"vpython",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-u",
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"listdir",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"[START_DIR]/mskp",
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"--recursive"
],
"infra_step": true,
"name": "push [START_DIR]/mskp/* /sdcard/revenge_of_the_skiabot/mskp.list [START_DIR]/mskp",
"~followup_annotations": [
"@@@STEP_NEST_LEVEL@1@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/mskp/.file3@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/mskp/.ignore/file4@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/mskp/file1@@@",
"@@@STEP_LOG_LINE@listdir@[START_DIR]/mskp/subdir/file2@@@",
"@@@STEP_LOG_END@listdir@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"push",
"[START_DIR]/mskp/.file3",
"/sdcard/revenge_of_the_skiabot/mskp/.file3"
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
],
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"cwd": "[START_DIR]/skia",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"env": {
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"name": "push [START_DIR]/mskp/* /sdcard/revenge_of_the_skiabot/mskp.push [START_DIR]/mskp/.file3",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"~followup_annotations": [
[infra] Retry failed pushes in Android flavor It seems like we see quite a few "force quarantined" bots when pushing resources to the device fails. Rewrite copy_directory_contents_to_device to use the _adb method, which automatically retries. Change-Id: Iae36f8e42e85a58fdddc8c9dc80e693a371fab8b Reviewed-on: https://skia-review.googlesource.com/c/skia/+/248560 Commit-Queue: Eric Boren <borenet@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-10-14 17:03:50 +00:00
"@@@STEP_NEST_LEVEL@1@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"push",
"[START_DIR]/mskp/file1",
"/sdcard/revenge_of_the_skiabot/mskp/file1"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push [START_DIR]/mskp/* /sdcard/revenge_of_the_skiabot/mskp.push [START_DIR]/mskp/file1",
"~followup_annotations": [
"@@@STEP_NEST_LEVEL@1@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"push",
"[START_DIR]/mskp/subdir/file2",
"/sdcard/revenge_of_the_skiabot/mskp/subdir/file2"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push [START_DIR]/mskp/* /sdcard/revenge_of_the_skiabot/mskp.push [START_DIR]/mskp/subdir/file2",
"~followup_annotations": [
"@@@STEP_NEST_LEVEL@1@@@"
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"push",
"[START_DIR]/tmp/MSKP_VERSION",
"/sdcard/revenge_of_the_skiabot/MSKP_VERSION"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push [START_DIR]/tmp/MSKP_VERSION /sdcard/revenge_of_the_skiabot/MSKP_VERSION"
},
{
"cmd": [
Roll recipe dependencies (nontrivial). This is an automated CL created by the recipe roller. This CL rolls recipe changes from upstream projects (e.g. depot_tools) into downstream projects (e.g. tools/build). Please review the expectation changes, and LGTM+CQ. More info is at https://goo.gl/zkKdpD. Use https://goo.gl/noib3a to file a bug. recipe_engine: https://crrev.com/f362dc019e5cedc0e5ce334039a16afcbc95dcb4 Reland "[fileutil] Add support for recursive glob" (atyfto@google.com) R=kjlubick@google.com Recipe-Tryjob-Bypass-Reason: Autoroller Bugdroid-Send-Email: False Change-Id: I3c1a79eb1f1fc8a23bf02ac25f17b8673d7dd199 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/240416 Commit-Queue: Eric Boren <borenet@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-09-09 22:36:05 +00:00
"vpython",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-u",
"RECIPE_MODULE[recipe_engine::file]/resources/fileutil.py",
"--json-output",
"/path/to/tmp/json",
"ensure-directory",
"--mode",
"0777",
"[START_DIR]/[SWARM_OUT_DIR]"
],
"infra_step": true,
"name": "makedirs perf_dir"
},
{
"cmd": [
"adb.1.0.35",
"push",
"[START_DIR]/build/skpbench",
"/data/local/tmp/"
],
"cwd": "[START_DIR]/skia",
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "push skpbench"
},
{
"cmd": [
"python",
"-u",
"[START_DIR]/skia/tools/skpbench/skpbench.py",
"/data/local/tmp/skpbench",
"--resultsfile",
"[START_DIR]/[SWARM_OUT_DIR]/table",
"--config",
"gles",
Add "AllPathsVolatile" skpbench bots Also adds GalaxyS20 to the mix, which wasn't running skpbench previously. Also removes the skpbench logic to fail if we don't recognize the hardware or have specific scripts for it. We don't have time to reverse engineer every new piece of hardware we want to run on and the general android script is quite helpful already. Bug: skia:10419 Change-Id: I0e139cdd4bc2e7ca0e2e14c715d319664fa8c949 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/319143 Commit-Queue: Chris Dalton <csmartdalton@google.com> Reviewed-by: Greg Daniel <egdaniel@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2020-09-24 17:42:47 +00:00
"--internalSamples",
"4",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"-v5",
"--adb",
"--adb_binary",
"adb.1.0.35",
"/sdcard/revenge_of_the_skiabot/mskp"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "skpbench"
},
{
"cmd": [
"python",
"-u",
"import os\nprint os.environ.get('SWARMING_TASK_ID', '')\n"
],
"name": "get swarming task id",
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@print os.environ.get('SWARMING_TASK_ID', '')@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"python",
"-u",
"[START_DIR]/skia/tools/skpbench/skiaperf.py",
"[START_DIR]/[SWARM_OUT_DIR]/table",
"--properties",
"gitHash",
"abc123",
"swarming_bot_id",
"skia-bot-123",
"swarming_task_id",
"123456",
"--outfile",
"[START_DIR]/[SWARM_OUT_DIR]/skpbench_abc123_1337000001.json",
"--key",
"arch",
"arm64",
"compiler",
"Clang",
"cpu_or_gpu",
"GPU",
"cpu_or_gpu_value",
"Adreno530",
"extra_config",
"Android_Skpbench_Mskp",
"model",
"Pixel",
"os",
"Android",
"test_filter",
"All"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"name": "Parse skpbench output into Perf json"
},
{
"cmd": [
"python",
"-u",
[infra] Handle failure from addr2line An error from addr2line (e.g. unknown binary type) can truncate the output, hiding the remainder of the stack trace. Instead print the original line. Change-Id: I563aae4333a79a17560378e399e79b60c79f9ac7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/261288 Commit-Queue: Kevin Lubick <kjlubick@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2019-12-21 00:06:12 +00:00
"\nimport os\nimport subprocess\nimport sys\nout = sys.argv[1]\nlog = subprocess.check_output(['/usr/bin/adb.1.0.35', 'logcat', '-d'])\nfor line in log.split('\\n'):\n tokens = line.split()\n if len(tokens) == 11 and tokens[-7] == 'F' and tokens[-3] == 'pc':\n addr, path = tokens[-2:]\n local = os.path.join(out, os.path.basename(path))\n if os.path.exists(local):\n try:\n sym = subprocess.check_output(['addr2line', '-Cfpe', local, addr])\n line = line.replace(addr, addr + ' ' + sym.strip())\n except subprocess.CalledProcessError:\n pass\n print line\n",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"[START_DIR]/build"
],
"env": {
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "dump log",
"timeout": 300,
"~followup_annotations": [
"@@@STEP_LOG_LINE@python.inline@@@@",
"@@@STEP_LOG_LINE@python.inline@import os@@@",
"@@@STEP_LOG_LINE@python.inline@import subprocess@@@",
"@@@STEP_LOG_LINE@python.inline@import sys@@@",
"@@@STEP_LOG_LINE@python.inline@out = sys.argv[1]@@@",
"@@@STEP_LOG_LINE@python.inline@log = subprocess.check_output(['/usr/bin/adb.1.0.35', 'logcat', '-d'])@@@",
"@@@STEP_LOG_LINE@python.inline@for line in log.split('\\n'):@@@",
"@@@STEP_LOG_LINE@python.inline@ tokens = line.split()@@@",
"@@@STEP_LOG_LINE@python.inline@ if len(tokens) == 11 and tokens[-7] == 'F' and tokens[-3] == 'pc':@@@",
"@@@STEP_LOG_LINE@python.inline@ addr, path = tokens[-2:]@@@",
"@@@STEP_LOG_LINE@python.inline@ local = os.path.join(out, os.path.basename(path))@@@",
"@@@STEP_LOG_LINE@python.inline@ if os.path.exists(local):@@@",
[infra] Handle failure from addr2line An error from addr2line (e.g. unknown binary type) can truncate the output, hiding the remainder of the stack trace. Instead print the original line. Change-Id: I563aae4333a79a17560378e399e79b60c79f9ac7 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/261288 Commit-Queue: Kevin Lubick <kjlubick@google.com> Auto-Submit: Ben Wagner aka dogben <benjaminwagner@google.com> Reviewed-by: Kevin Lubick <kjlubick@google.com>
2019-12-21 00:06:12 +00:00
"@@@STEP_LOG_LINE@python.inline@ try:@@@",
"@@@STEP_LOG_LINE@python.inline@ sym = subprocess.check_output(['addr2line', '-Cfpe', local, addr])@@@",
"@@@STEP_LOG_LINE@python.inline@ line = line.replace(addr, addr + ' ' + sym.strip())@@@",
"@@@STEP_LOG_LINE@python.inline@ except subprocess.CalledProcessError:@@@",
"@@@STEP_LOG_LINE@python.inline@ pass@@@",
Add a kind of asset for MSKPs so the skpbench bot can read them. Bug: skia:9209 Change-Id: Ic16d33341b4fbfd3a77e5dce782b134cd855d0b2 Reviewed-on: https://skia-review.googlesource.com/c/skia/+/230133 Commit-Queue: Nathaniel Nifong <nifong@google.com> Reviewed-by: Eric Boren <borenet@google.com>
2019-08-01 17:39:34 +00:00
"@@@STEP_LOG_LINE@python.inline@ print line@@@",
"@@@STEP_LOG_END@python.inline@@@"
]
},
{
"cmd": [
"/usr/bin/adb.1.0.35",
"kill-server"
],
"cwd": "[START_DIR]/skia",
"env": {
"ADB_VENDOR_KEYS": "/home/chrome-bot/.android/adbkey",
"CHROME_HEADLESS": "1",
"PATH": "<PATH>:RECIPE_REPO[depot_tools]"
},
"infra_step": true,
"name": "kill adb server"
},
{
"name": "$result"
}
]
Reference in New Issue Copy Permalink