History

Clemens Hammacher 913d5ba508 Split message tests in failing and non-failing This way, we can also check the return code of d8. We currently have a bug (6981) which makes failing tests not being detected, even though the failure message is (sometimes) being printed. After this refactoring, we can write tests for our mjsunit test functions. R=machenbach@chromium.org Bug: v8:6981 Change-Id: I0aa0abcb0f9a4f622a1e1d1a4d826da1e6eb4f07 Reviewed-on: https://chromium-review.googlesource.com/737991 Reviewed-by: Michael Achenbach <machenbach@chromium.org> Commit-Queue: Clemens Hammacher <clemensh@chromium.org> Cr-Commit-Position: refs/heads/master@{#48951}		2017-10-26 07:36:28 +00:00
..
fail	Split message tests in failing and non-failing	2017-10-26 07:36:28 +00:00
regress/fail	Split message tests in failing and non-failing	2017-10-26 07:36:28 +00:00
asm-assignment-undeclared.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-assignment-undeclared.out	[asm.js] Fix assignment with undeclared target.	2017-03-30 08:36:17 +00:00
asm-function-mismatch-def.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-function-mismatch-def.out	[asm.js] Test and fix function type checking.	2017-04-07 12:10:45 +00:00
asm-function-mismatch-use.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-function-mismatch-use.out	[asm.js] Test and fix function type checking.	2017-04-07 12:10:45 +00:00
asm-function-redefined.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-function-redefined.out	[asm.js] Test and fix function name collisions.	2017-04-07 09:03:11 +00:00
asm-function-undefined.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-function-undefined.out	[asm.js] Test and fix function table definition failures.	2017-04-11 16:46:26 +00:00
asm-function-variable-collision.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-function-variable-collision.out	[asm.js] Test and fix function name collisions.	2017-04-07 09:03:11 +00:00
asm-import-wrong-annotation.js	[asm.js] Fix validation failure in module variable import.	2017-05-05 11:39:06 +00:00
asm-import-wrong-annotation.out	[asm.js] Fix validation failure in module variable import.	2017-05-05 11:39:06 +00:00
asm-import-wrong-object.js	[asm.js] Fix validation failure in module variable import.	2017-05-05 11:39:06 +00:00
asm-import-wrong-object.out	[asm.js] Fix validation failure in module variable import.	2017-05-05 11:39:06 +00:00
asm-linking-bogus-heap.js	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-linking-bogus-heap.out	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-linking-bogus-stdlib.js	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-linking-bogus-stdlib.out	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-linking-missing-heap.js	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-linking-missing-heap.out	[asm.js] Report module linking failures to the console.	2017-05-19 11:31:12 +00:00
asm-missing-parameter-annotation.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-missing-parameter-annotation.out	[asm.js] Make validation error messages consistent.	2017-03-29 20:55:12 +00:00
asm-missing-return-annotation.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-missing-return-annotation.out	[asm.js] Make validation error messages consistent.	2017-03-29 20:55:12 +00:00
asm-table-mismatch-def.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-table-mismatch-def.out	[asm.js] Test and fix function table type checks.	2017-04-10 08:47:34 +00:00
asm-table-mismatch-use.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-table-mismatch-use.out	[asm.js] Test and fix function table type checks.	2017-04-10 08:47:34 +00:00
asm-table-redefined.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-table-redefined.out	[asm.js] Test and fix function table definition failures.	2017-04-11 16:46:26 +00:00
asm-table-undefined.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-table-undefined.out	[asm.js] Test and fix function table definition failures.	2017-04-11 16:46:26 +00:00
asm-table-variable-collision.js	[asm.js] Remove deprecated --fast-validate-asm flag.	2017-05-04 13:52:39 +00:00
asm-table-variable-collision.out	[asm.js] Test and fix function table definition failures.	2017-04-11 16:46:26 +00:00
message.gyp	[gn] Move build to gypfiles	2016-04-29 10:11:11 +00:00
message.isolate	Reland [swarming] Isolate v8 testing.	2015-10-05 09:48:42 +00:00
message.status	Split message tests in failing and non-failing	2017-10-26 07:36:28 +00:00
non-use-strict-hex-escape.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
non-use-strict-hex-escape.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
non-use-strict-octal-escape.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
non-use-strict-octal-escape.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
non-use-strict-uhex-escape.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
non-use-strict-uhex-escape.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-arguments.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-arguments.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-eval.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-eval.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-with.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
nonstrict-with.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
README.md	[testing] Rename documentation file.	2017-03-31 08:05:15 +00:00
settimeout.js	Reland "[d8] implement setTimeout."	2017-09-05 07:30:46 +00:00
settimeout.out	[d8] Don't print prefix for console.log in d8	2017-10-13 13:56:32 +00:00
strict-octal-indirect-regexp.js	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
strict-octal-indirect-regexp.out	[testing] Move the last JS tests out of "preparser".	2016-03-14 17:10:49 +00:00
strict-octal-regexp.js	[testing] Convert some "preparser" tests into "message".	2016-03-11 11:00:12 +00:00
strict-octal-regexp.out	[testing] Convert some "preparser" tests into "message".	2016-03-11 11:00:12 +00:00
testcfg.py	Split message tests in failing and non-failing	2017-10-26 07:36:28 +00:00
try-catch-finally-no-message.js	Changed the message reporting for try { ... } finally { ... } statements to	2008-10-23 08:40:19 +00:00
try-catch-finally-no-message.out	First commit of new tools/run-tests.py	2012-09-24 09:38:46 +00:00
try-catch-finally-return-in-finally.js	Update V8 to version 3.0 (re-land r5920).	2010-12-07 11:31:57 +00:00
try-catch-finally-return-in-finally.out	Update V8 to version 3.0 (re-land r5920).	2010-12-07 11:31:57 +00:00
try-finally-return-in-finally.js	Update V8 to version 3.0 (re-land r5920).	2010-12-07 11:31:57 +00:00
try-finally-return-in-finally.out	Update V8 to version 3.0 (re-land r5920).	2010-12-07 11:31:57 +00:00
wasm-trace-memory-interpreted.js	[wasm] Add flag for memory tracing	2017-10-02 08:26:26 +00:00
wasm-trace-memory-interpreted.out	[wasm] Add flag for memory tracing	2017-10-02 08:26:26 +00:00
wasm-trace-memory.js	[wasm] Add flag for memory tracing	2017-10-02 08:26:26 +00:00
wasm-trace-memory.out	[wasm] Add flag for memory tracing	2017-10-02 08:26:26 +00:00

README.md

JavaScript tests with expected output

Tests in test/message pass if the output matches the expected output. Message tests are particularly useful when checking for exact error messages.

Tests and their expected output must have the same filename, with the .js and .out extension.

foo.js
foo.out

All tests must end with an exception. The test runner does not handle output from multiple runs, e.g., --stress-opt. Without an exception, the output will be generated several times and the comparison will fail.

You can use a regex in the expected output. Instead of the exact path. use

*%(basename)s:7: SyntaxError: Detected cycle while resolving name 'a'

Empty lines are ignored in the comparison, but whitespaces are not.

Exact details of the test runner are in testcfg.py.