Sergiy Belozorov
1de4631ef4
[tools] Add support for --confidence-level flag to tools/try_perf.py
...
See example v8_linux64_perf_try(_triggered) builds on this CL triggered using
the following command lines:
python tools/try_perf.py --linux64 --confidence-level 1 compile
python tools/try_perf.py --linux64 --confidence-level 1 arewefastyet
python tools/try_perf.py --linux64 --confidence-level 3 arewefastyet
This also fixes running tools/run_perf.py --help and adds logging for the
current confidence level, which allows users to monitor progress. Example runs:
https://chrome-swarming.appspot.com/task?id=456e4d6e743cc510 (Compile)
https://chrome-swarming.appspot.com/task?id=456e5145615aa510 (JetStream)
https://chrome-swarming.appspot.com/task?id=456e53eeb9104410 (JSBench)
https://chrome-swarming.appspot.com/task?id=456e541e0e13bc10 (AreWeFastYet)
Finally, this adds support for fractional confidence levels. Example runs:
https://chrome-swarming.appspot.com/task?id=456e5970e6f24410 (AreWeFastYet)
https://chrome-swarming.appspot.com/task?id=456e5a8f3f407c10 (Compile)
R=tmrts@chromium.org , machenbach@chromium.org
Bug: chromium:880724
Change-Id: I725a83060c0bdd3ef08a7f0e4df843611c712d37
Reviewed-on: https://chromium-review.googlesource.com/c/v8/v8/+/1660471
Reviewed-by: Tamer Tas <tmrts@chromium.org>
Commit-Queue: Sergiy Belozorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#62176}
2019-06-14 12:33:49 +00:00
Stephan Herhut
93e1594aa7
[tools] Add ares6 and blazor to benchmark set
...
These are supported by the try bots but were missing from the set.
NOTRY=true
Change-Id: Ie12801ee953b14a7f94588efc64b8c57caa6d720
Reviewed-on: https://chromium-review.googlesource.com/c/1477052
Reviewed-by: Stephan Herhut <herhut@chromium.org>
Reviewed-by: Sergiy Belozorov <sergiyb@chromium.org>
Commit-Queue: Stephan Herhut <herhut@chromium.org>
Cr-Commit-Position: refs/heads/master@{#59693}
2019-02-19 15:24:32 +00:00
Vadim Gorbachev (bmsdave)
7315d7b3d7
Preparing v8 to use with python3 /tools
...
There are now less that 400 days until the end of life
of Python 2(aka _legacy_ Python) https://pythonclock.org/ .
The code compatibility check for python2 and python3
used the following tools: futurize, flake8
You can see the reports here: https://travis-ci.com/bmsdave/v8/builds
This CL was uploaded by git cl split.
Bug: v8:8594
Change-Id: I661c52a70527e8ddde841fee6d4dcba282b4a938
Reviewed-on: https://chromium-review.googlesource.com/c/1470123
Commit-Queue: Sergiy Belozorov <sergiyb@chromium.org>
Reviewed-by: Sergiy Belozorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#59675}
2019-02-19 09:12:07 +00:00
Sergiy Belozorov
3c34f1a50c
[tools] Add new swarming bots and remove support for Buildbot perf trybots
...
R=machenbach@chromium.org , tmrts@chromium.org
No-Try: true
Bug: chromium:616879
Change-Id: I1dbef7ca4ac69df2d3de654b381ab163d5be4214
Reviewed-on: https://chromium-review.googlesource.com/c/1409200
Commit-Queue: Sergiy Belozorov <sergiyb@chromium.org>
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#58845}
2019-01-16 11:35:49 +00:00
Sergiy Belozorov
454e7e1248
[tools] Trigger Nexus5/7 trybots on LUCI builders
...
R=machenbach@chromium.org
No-Try: true
Bug: chromium:920561
Change-Id: Iaf80de577ba2c6b2d22938240aba6b9e432b7427
Reviewed-on: https://chromium-review.googlesource.com/c/1404441
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Belozorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#58756}
2019-01-11 17:52:40 +00:00
Sergiy Byelozyorov
e7ff6989c3
[tools] Trigger linux32 perf trybot on swarming
...
TBR=machenbach@chromium.org
No-Try: true
Bug: chromium:616879
Change-Id: I7a567060d4bbfdd5cbd8cc92a828b051ce8ddb8c
Reviewed-on: https://chromium-review.googlesource.com/c/1346332
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#57685}
2018-11-21 14:07:44 +00:00
Sergiy Byelozyorov
c6e09003be
[tools] Add verbose mode to try_perf.py
...
This is useful to see exact command used to communicate with buildbucket and
debug any triggering issues.
R=machenbach@chromium.org
Change-Id: I1630485ed128f757364d9c1f62b7f1d663db2ece
Reviewed-on: https://chromium-review.googlesource.com/c/1325371
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#57371}
2018-11-08 21:20:26 +00:00
Sergiy Byelozyorov
a77ec15f59
[tools] Trigger v8_linux64_atom_perf_try on swarming
...
R=machenbach@chromium.org
Bug: chromium:902428
Change-Id: Id9a727d83c2a69e4ffd20e761c274cba2c75404a
Reviewed-on: https://chromium-review.googlesource.com/c/1320889
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#57336}
2018-11-07 23:40:57 +00:00
Sergiy Byelozyorov
b13f266428
[tools] Remove support for Haswell trybots
...
R=machenbach@chromium.org
Bug: chromium:616879
Change-Id: I78a204d3620a1ea28bfd93f019b122f2186f009b
Reviewed-on: https://chromium-review.googlesource.com/c/1323909
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#57329}
2018-11-07 20:08:36 +00:00
Sergiy Byelozyorov
a4df9cbfd9
[tools] Add Nokia One trybot to the try_perf script
...
R=machenbach@chromium.org
Bug: chromium:874316
Change-Id: I148916d0b0f34214325910b29aceb39d3a1db459
Reviewed-on: https://chromium-review.googlesource.com/1201523
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#55598}
2018-09-04 10:08:41 +00:00
Sergiy Byelozyorov
c136d7b4c9
[tools] Remove support for v8_nexus9_perf_try
...
TBR=machenbach@chromium.org
No-Try: true
Bug: chromium:838864
Change-Id: Id4881bd0cd01564cb969da7aad855a7ce6685bb8
Reviewed-on: https://chromium-review.googlesource.com/1168482
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#54993}
2018-08-09 00:09:27 +00:00
Sergiy Byelozyorov
d652c85c5e
[tools] Add v8_pixel2_perf_try to the list of bots that can be triggered
...
TBR=machenbach@google.om
No-Try: true
Bug: chromium:838864
Change-Id: Ic162e3fbd1c02b62cd8151bb5a598ca25db39d0b
Reviewed-on: https://chromium-review.googlesource.com/1163721
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#54968}
2018-08-08 11:48:09 +00:00
Ulan Degenbaev
b01c4367b0
[infra] Add web-tooling-benchmark to tools/try_perf.py
...
NOTRY=true
Change-Id: I4ac9c02c465e7120ab7059142de505063b3ce1a4
Reviewed-on: https://chromium-review.googlesource.com/1064116
Commit-Queue: Ulan Degenbaev <ulan@chromium.org>
Reviewed-by: Benedikt Meurer <bmeurer@chromium.org>
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#53235}
2018-05-17 13:56:42 +00:00
Sergiy Byelozyorov
78835fdc53
Trigger v8_linux64_perf_try on swarming
...
R=machenbach@chromium.org
NOTRY=true
Bug: chromium:616879
Change-Id: Ie732c5432cc0b69a28b4e356d9cead5855d00a7c
Reviewed-on: https://chromium-review.googlesource.com/915361
Commit-Queue: Michael Achenbach <machenbach@chromium.org>
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#51300}
2018-02-15 01:09:34 +00:00
Sergiy Byelozyorov
d8dc1fc5c9
Correct try bucket name for internal V8 bots on swarming
...
TBR=machenbach@chromium.org
No-Try: true
Bug: chromium:616879
Change-Id: I49d3f12216cdc2d26761e8f82fef18512d8eb6fd
Reviewed-on: https://chromium-review.googlesource.com/915141
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Reviewed-by: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#51257}
2018-02-13 00:25:18 +00:00
Sergiy Byelozyorov
6be9c2daed
Only run git-cl-try if there are bots to trigger to avoid triggering CQ dry-run
...
R=machenbach@chromium.org
Bug: chromium:616879
Change-Id: Ice9927dd4bbaf72141c6693e4afaf57a362f515b
Reviewed-on: https://chromium-review.googlesource.com/884281
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#50852}
2018-01-24 19:41:28 +00:00
Sergiy Byelozyorov
ed71ede425
Add ability to trigger perf bots on swarming
...
R=machenbach@chromium.org
Bug: chromium:616879
Change-Id: I168ec7d3dbd1a9e9c6006919bf59de1d8b40ab3b
Reviewed-on: https://chromium-review.googlesource.com/881483
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#50839}
2018-01-24 15:05:29 +00:00
Sergiy Byelozyorov
3e188ad3fa
Remove v8_linux64_haswell_cm_perf
...
R=machenbach@chromium.org
Change-Id: Ic9566af4475901e87a26d2d4b62e0cb32a1b773c
Reviewed-on: https://chromium-review.googlesource.com/784890
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Sergiy Byelozyorov <sergiyb@chromium.org>
Cr-Commit-Position: refs/heads/master@{#49561}
2017-11-22 08:31:30 +00:00
Ross McIlroy
05207b098a
[Interpreter] Replace --ignition flag with a --stress-fullcodegen
...
Removes the --ignition flag which is now on by default. Adds a
--stress-fullcodegen flag which enables running all functions supported
by fullcodegen to be compiled by fullcodegen.
This will enable moving parser internalization later when we are not
stressing fullcodegen or compiling asm.js functions.
BUG=v8:5203, v8:6409, v8:6589
Change-Id: I7fa68016d4e734755434ec0b4e749ef65ffa7f4e
Reviewed-on: https://chromium-review.googlesource.com/565569
Commit-Queue: Ross McIlroy <rmcilroy@chromium.org>
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Reviewed-by: Michael Starzinger <mstarzinger@chromium.org>
Cr-Commit-Position: refs/heads/master@{#46635}
2017-07-13 13:05:00 +00:00
Michael Achenbach
5d39f7c13b
[test] Add flag for concurrent-marking trybot to try_perf
...
NOTRY=true
TBR=ulan@chromium.org
Bug: chromium:735951
Change-Id: Ic5cf6692988ede915aabdc1c44eea52b42bf7f45
Reviewed-on: https://chromium-review.googlesource.com/547426
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#46199}
2017-06-26 07:33:48 +00:00
Michael Achenbach
0fe9b8d283
[tools] Fix tryperf depot_tools updating
...
TBR=phajdan.jr@chromium.org
NOTRY=true
Change-Id: Ifaec5818beda86020f14b2be39821759a3ee058e
Reviewed-on: https://chromium-review.googlesource.com/506731
Reviewed-by: Michael Achenbach <machenbach@chromium.org>
Commit-Queue: Michael Achenbach <machenbach@chromium.org>
Cr-Commit-Position: refs/heads/master@{#45358}
2017-05-17 06:21:54 +00:00
bbudge
deabb19abc
Remove SIMD.js from V8.
...
LOG=Y
BUG=v8:4124,v8:5948
R=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org
Review-Url: https://codereview.chromium.org/2684313003
Cr-Original-Original-Commit-Position: refs/heads/master@{#43162}
Committed: d170c57ab9
Review-Url: https://codereview.chromium.org/2684313003
Cr-Original-Commit-Position: refs/heads/master@{#43169}
Committed: a9b59a11f1
Review-Url: https://codereview.chromium.org/2684313003
Cr-Commit-Position: refs/heads/master@{#43176}
2017-02-14 06:57:25 +00:00
franzih
a386eb4f04
Revert of Remove SIMD.js from V8. (patchset #7 id:120001 of https://codereview.chromium.org/2684313003/ )
...
Reason for revert:
Breaks Node integration build.
Original issue's description:
> Remove SIMD.js from V8.
>
> LOG=Y
> BUG=v8:4124,v8:5948
> R=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org
>
> Review-Url: https://codereview.chromium.org/2684313003
> Cr-Original-Commit-Position: refs/heads/master@{#43162}
> Committed: d170c57ab9
> Review-Url: https://codereview.chromium.org/2684313003
> Cr-Commit-Position: refs/heads/master@{#43169}
> Committed: a9b59a11f1
TBR=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org,bradnelson@google.com,machenbach@chromium.org,bbudge@chromium.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=v8:4124,v8:5948
Review-Url: https://codereview.chromium.org/2695653005
Cr-Commit-Position: refs/heads/master@{#43170}
2017-02-13 21:33:46 +00:00
bbudge
a9b59a11f1
Remove SIMD.js from V8.
...
LOG=Y
BUG=v8:4124,v8:5948
R=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org
Review-Url: https://codereview.chromium.org/2684313003
Cr-Original-Commit-Position: refs/heads/master@{#43162}
Committed: d170c57ab9
Review-Url: https://codereview.chromium.org/2684313003
Cr-Commit-Position: refs/heads/master@{#43169}
2017-02-13 20:43:08 +00:00
bradnelson
43fc15bb79
Revert of Remove SIMD.js from V8. (patchset #7 id:120001 of https://codereview.chromium.org/2684313003/ )
...
Reason for revert:
red
Original issue's description:
> Remove SIMD.js from V8.
>
> LOG=Y
> BUG=v8:4124,5948
> R=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org
> (notry since trybots can't patch directory deletes)
> NOTRY=true
>
> Review-Url: https://codereview.chromium.org/2684313003
> Cr-Commit-Position: refs/heads/master@{#43162}
> Committed: d170c57ab9
TBR=bmeurer@chromium.org ,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org,bradnelson@google.com,bbudge@chromium.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=v8:4124,5948
Review-Url: https://codereview.chromium.org/2692933002
Cr-Commit-Position: refs/heads/master@{#43164}
2017-02-13 18:12:14 +00:00
bbudge
d170c57ab9
Remove SIMD.js from V8.
...
LOG=Y
BUG=v8:4124,5948
R=bradnelson@chromium.org ,bmeurer@chromium.org,jochen@chromium.org,hpayer@chromium.org,danno@chromium.org
(notry since trybots can't patch directory deletes)
NOTRY=true
Review-Url: https://codereview.chromium.org/2684313003
Cr-Commit-Position: refs/heads/master@{#43162}
2017-02-13 15:59:22 +00:00
mtrofin
154548c2ba
[tools] added unity suite to known benchmark set
...
try_perf.py knows now of the "unity" benchmark suite
NOTRY=true
Review-Url: https://codereview.chromium.org/2358873002
Cr-Commit-Position: refs/heads/master@{#39615}
2016-09-22 08:18:16 +00:00
rmcilroy
23ca1e8270
Add Ignition perf benchmarks to try_perf.py
...
BUG=v8:4280
NOTRY=true
Review-Url: https://codereview.chromium.org/2033393002
Cr-Commit-Position: refs/heads/master@{#36708}
2016-06-03 11:06:22 +00:00
mtrofin
c6405c4a60
[tools] added wasm to the list of benchmarks
...
BUG=
Review-Url: https://codereview.chromium.org/1931293005
Cr-Commit-Position: refs/heads/master@{#36055}
2016-05-05 19:12:31 +00:00
nikolaos
186728f7e3
Add a revision flag for try_perf.py
...
R=machenbach@chromium.org
NOTRY=true
Review URL: https://codereview.chromium.org/1704963002
Cr-Commit-Position: refs/heads/master@{#34074}
2016-02-17 12:13:18 +00:00
machenbach
1e82da4b30
[test] Make try-perf script more convenient to use.
...
Warn if unknown benchmark configurations are triggered.
NOTRY=true
Review URL: https://codereview.chromium.org/1479483003
Cr-Commit-Position: refs/heads/master@{#32274}
2015-11-25 14:00:49 +00:00
machenbach
9b25041b24
[test] Add intel atom to perf try category.
...
BUG=chromium:468025
LOG=n
NOTRY=true
Review URL: https://codereview.chromium.org/1396613003
Cr-Commit-Position: refs/heads/master@{#31177}
2015-10-08 13:04:37 +00:00
machenbach
ba67a42629
[test] Allow passing extra flags to perf tryjobs.
...
NOTRY=true
Review URL: https://codereview.chromium.org/1342263003
Cr-Commit-Position: refs/heads/master@{#30817}
2015-09-18 08:06:31 +00:00
machenbach
d7c8b9bac6
[test] Switch perf try wrapper to buildbucket.
...
NOTRY=true
Review URL: https://codereview.chromium.org/1351093002
Cr-Commit-Position: refs/heads/master@{#30801}
2015-09-17 13:41:42 +00:00
machenbach
7d5db46e89
[test] Add android perf trybots.
...
BUG=chromium:502176
LOG=n
NOTRY=true
Review URL: https://codereview.chromium.org/1217503008
Cr-Commit-Position: refs/heads/master@{#29491}
2015-07-06 12:17:27 +00:00
machenbach
e47c362642
[test] Add arm perf trybot to runner script.
...
BUG=chromium:484589
LOG=n
NOTRY=true
TBR=hpayer@chromium.org
Review URL: https://codereview.chromium.org/1123473007
Cr-Commit-Position: refs/heads/master@{#28227}
2015-05-05 14:17:47 +00:00
machenbach
4b8bb5ed1e
[test-runner] Enable specification of trybots.
...
Now it's possible to specify the desired trybots for perf
tries, e.g.:
tools/try_perf.py --linux64_haswell octane sunspider
BUG=chromium:478460
LOG=n
NOTRY=true
Review URL: https://codereview.chromium.org/1114913002
Cr-Commit-Position: refs/heads/master@{#28142}
2015-04-30 05:12:42 +00:00
Michael Achenbach
8d042464d9
Prototype for a client-side performance trybot script.
...
BUG=chromium:374740
LOG=n
TEST=tools/try_perf.py sunspider octane
R=phajdan.jr@chromium.org
Review URL: https://codereview.chromium.org/734403002
Cr-Commit-Position: refs/heads/master@{#25398}
2014-11-18 14:40:00 +00:00