v8/test/mozilla
littledan f3568ca400 Make test262 test runner check for which exception is thrown
test262 "negative" test expectations list which exception is thrown. The ES2017
draft specification is very specific about which exception class is thrown
from which path, and V8 works hard to be correct with respect to that spec.

Previously, the test262 test runner would accept any nonzero status code,
such as from a crash, or a FAIL printed out, for a negative test. This
patch makes negative tests check for the right answer using a quick-and-dirty
parsing of the exception printing from d8 to find the exception class.
It invokes d8 in a way to get a status code of 0 from thrown exceptions
so that 'negative' tests aren't actually implemented by negating the output.

Amazingly, this didn't catch any test262 failures, but I verified the extra
checking interactively by changing a negative test to expect a different type
and saw it fail.

BUG=v8:4803
R=machenbach
LOG=Y

Review URL: https://codereview.chromium.org/1766503002

Cr-Commit-Position: refs/heads/master@{#34763}
2016-03-14 21:20:37 +00:00
..
mozilla-shell-emulation.js Removed lots of new mozilla tests depending on "options" function. 2008-12-03 10:21:50 +00:00
mozilla.gyp [swarming] Isolate more tests. 2015-10-19 11:37:26 +00:00
mozilla.isolate [swarming] Isolate more tests. 2015-10-19 11:37:26 +00:00
mozilla.status Restrict FunctionDeclarations in Statement position 2016-03-03 21:34:26 +00:00
testcfg.py Make test262 test runner check for which exception is thrown 2016-03-14 21:20:37 +00:00