machenbach
1a511b0e38
Revert of Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #1 id:1 of https://codereview.chromium.org/1163373005/ )
...
Reason for revert:
All build problems had other causes.
Original issue's description:
> Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #3 id:40001 of https://codereview.chromium.org/1171943002/ )
>
> Reason for revert:
> might break stuff
>
> Original issue's description:
> > [test] Refactoring - Use subject/observer pattern for progress indicators.
> >
> > This should prevent bugs caused by missing super calls in
> > overridden methods. The assumption is that methods of
> > different indicators are independent.
> >
> > Committed: https://crrev.com/fbe973ff1722a6158a5b2babce9c1a32d26a1d3b
> > Cr-Commit-Position: refs/heads/master@{#28866}
>
> TBR=jkummerow@chromium.org ,tandrii@chromium.org
> NOPRESUBMIT=true
> NOTREECHECKS=true
> NOTRY=true
>
> Committed: https://crrev.com/2a3962d9d2a7415378811f4d56522531332d5a3e
> Cr-Commit-Position: refs/heads/master@{#28869}
TBR=jkummerow@chromium.org ,tandrii@chromium.org
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
Review URL: https://codereview.chromium.org/1176863002
Cr-Commit-Position: refs/heads/master@{#28901}
2015-06-10 09:42:31 +00:00
machenbach
2a3962d9d2
Revert of [test] Refactoring - Use subject/observer pattern for progress indicators. (patchset #3 id:40001 of https://codereview.chromium.org/1171943002/ )
...
Reason for revert:
might break stuff
Original issue's description:
> [test] Refactoring - Use subject/observer pattern for progress indicators.
>
> This should prevent bugs caused by missing super calls in
> overridden methods. The assumption is that methods of
> different indicators are independent.
>
> Committed: https://crrev.com/fbe973ff1722a6158a5b2babce9c1a32d26a1d3b
> Cr-Commit-Position: refs/heads/master@{#28866}
TBR=jkummerow@chromium.org ,tandrii@chromium.org
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
Review URL: https://codereview.chromium.org/1163373005
Cr-Commit-Position: refs/heads/master@{#28869}
2015-06-09 15:32:50 +00:00
machenbach
fbe973ff17
[test] Refactoring - Use subject/observer pattern for progress indicators.
...
This should prevent bugs caused by missing super calls in
overridden methods. The assumption is that methods of
different indicators are independent.
Review URL: https://codereview.chromium.org/1171943002
Cr-Commit-Position: refs/heads/master@{#28866}
2015-06-09 14:41:26 +00:00
machenbach
e728125131
[test] Fix missing heartbeats in test runner.
...
TBR=jkummerow@chromium.org
Review URL: https://codereview.chromium.org/1163523008
Cr-Commit-Position: refs/heads/master@{#28808}
2015-06-05 09:51:01 +00:00
machenbach
4d6f1abbdb
[test] Remove default for zero test cases.
...
BUG=
Review URL: https://codereview.chromium.org/1153103003
Cr-Commit-Position: refs/heads/master@{#28654}
2015-05-27 13:50:48 +00:00
machenbach
2dda8c3d4e
[test] Verbose test runner output on windows.
...
TBR=jkummerow@chromium.org
NOTRY=true
Review URL: https://codereview.chromium.org/1156133006
Cr-Commit-Position: refs/heads/master@{#28643}
2015-05-26 19:50:54 +00:00
machenbach
99be3e82bf
[test-runner] Pass slowest test durations to buildbot.
...
BUG=
Review URL: https://codereview.chromium.org/1070753003
Cr-Commit-Position: refs/heads/master@{#27696}
2015-04-09 09:56:03 +00:00
machenbach
a54f22d418
Make test runner more chatty to avoid it getting killed by buildbot.
...
NOTRY=true
NOTREECHECKS=true
Review URL: https://codereview.chromium.org/1064043002
Cr-Commit-Position: refs/heads/master@{#27653}
2015-04-08 09:53:39 +00:00
machenbach@chromium.org
0df953c9e1
Fix test driver json output.
...
TBR=tandrii@chromium.org
Review URL: https://codereview.chromium.org/716713002
Cr-Commit-Position: refs/heads/master@{#25254}
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@25254 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-11-11 06:06:42 +00:00
machenbach@chromium.org
3aaaf5c522
Fix serialization of expected outcomes in test driver.
...
The outcomes are saved as a set and need to be converted into
a list to be json-serializable.
TBR=tandrii@chromium.org
Review URL: https://codereview.chromium.org/710073002
Cr-Commit-Position: refs/heads/master@{#25246}
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@25246 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-11-10 14:18:20 +00:00
machenbach@chromium.org
e140bbcafa
Add expected outcomes to json test output.
...
BUG=
R=tandrii@chromium.org
Review URL: https://codereview.chromium.org/713463002
Cr-Commit-Position: refs/heads/master@{#25235}
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@25235 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-11-10 10:26:40 +00:00
machenbach@chromium.org
13f4c91276
Fix test driver output for passes in predictable mode.
...
Passes in predictable mode were wrongly reported as failures by the json progress indicator. This moves control about what is reported completely to execution.py.
BUG=391747
LOG=n
R=ishell@chromium.org , jkummerow@chromium.org
Review URL: https://codereview.chromium.org/382443004
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@22299 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-07-09 11:37:36 +00:00
machenbach@chromium.org
ba584456e6
Fix result status of rerun flaky tests.
...
Tests that pass on reruns where wrongly treated as failures. Now the result state can include any of (PASS, FAIL, CRASH, TIMEOUT)
BUG=374134
LOG=n
R=jkummerow@chromium.org
Review URL: https://codereview.chromium.org/363883003
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@22186 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-07-03 09:33:22 +00:00
machenbach@chromium.org
4d55c22827
Add information about rerun tests to json output.
...
BUG=374134
LOG=n
R=jkummerow@chromium.org
Review URL: https://codereview.chromium.org/364793004
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@22147 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-07-02 09:12:07 +00:00
machenbach@chromium.org
f737580c65
Let test driver export json results.
...
BUG=374134
LOG=n
R=jkummerow@chromium.org
Review URL: https://codereview.chromium.org/285193009
git-svn-id: https://v8.googlecode.com/svn/branches/bleeding_edge@21358 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2014-05-19 08:36:53 +00:00
ulan@chromium.org
7f885c709c
Print exit code on crash in run-tests.py
...
R=jkummerow@chromium.org
Review URL: https://chromiumcodereview.appspot.com/99363002
git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@18204 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2013-12-02 15:46:41 +00:00
machenbach@chromium.org
6a6790be37
HasUnexpectedOutput() is evaluated two times for each test run.
...
This fix removes the redundant call to allow heavy text comparisons through overwriting of that method.
R=jkummerow@chromium.org
Review URL: https://codereview.chromium.org/17089003
git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@15162 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2013-06-14 14:57:14 +00:00
palfia@homejinni.com
17f2177cb3
Add support for JUnit compatible XML output in the new test runner.
...
Implement a new output method in run-tests.py which
outputs JUnit compatible XML status information.
BUG=
Review URL: https://codereview.chromium.org/13813003
git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@14217 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2013-04-11 00:22:26 +00:00
jkummerow@chromium.org
230bec1274
Use tools/run-tests.py for "check" targets in the top-level Makefile.
...
Bonus content: a few minor fixes for run-tests.py
Review URL: https://codereview.chromium.org/11184039
git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@12758 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2012-10-18 14:21:35 +00:00
jkummerow@chromium.org
975d6e2170
First commit of new tools/run-tests.py
...
Review URL: https://codereview.chromium.org/10919265
git-svn-id: http://v8.googlecode.com/svn/branches/bleeding_edge@12583 ce2b1a6d-e550-0410-aec6-3dcde31c8c00
2012-09-24 09:38:46 +00:00