qt5base-lts/util/wasm/batchedtestrunner
Mikolaj Boc d552558170 Allow filtering of test functions to run in WASM testrunner
Just proxy any non-standard arg to the WASM module and let it use
the arg as a filter

Change-Id: Ia77a30ca872497425017edb8fa8961b6d687ca68
Reviewed-by: Michal Klocek <michal.klocek@qt.io>
2023-01-30 13:55:58 +01:00
..
batchedtestrunner.html Provide visual output in page in WASM test runner 2022-10-05 00:36:41 +02:00
batchedtestrunner.js Allow filtering of test functions to run in WASM testrunner 2023-01-30 13:55:58 +01:00
emrunadapter.js wasm testrunner: Join output into batches 2023-01-24 08:34:42 +01:00
qtestoutputreporter.css Provide visual output in page in WASM test runner 2022-10-05 00:36:41 +02:00
qtestoutputreporter.js Provide visual output in page in WASM test runner 2022-10-05 00:36:41 +02:00
qwasmjsruntime.js Remove the instance.ENV assignment in js test runner 2023-01-12 17:14:11 +00:00
qwasmtestmain.js Allow filtering of test functions to run in WASM testrunner 2023-01-30 13:55:58 +01:00
README.md Adapt the js batched test runner to emrun interface 2022-09-12 22:28:10 +02:00
util.js Create a driver for running batched tests on WASM 2022-08-24 19:08:58 +02:00

This package contains sources for a webpage whose scripts run batched WASM tests - a single executable with a number of linked test classes. The webpage operates on an assumption that the test program, when run without arguments, prints out a list of test classes inside its module. Then, when run with the first argument equal to the name of one of the test classes, the test program will execute all tests within that single class.

The following query parameters are recognized by the webpage:

qtestname=testname - the test case to run. When batched test module is used, the test is assumed to be a part of the batch. If a standalone test module is used, this is assumed to be the name of the wasm module.

quseemrun - if specified, the test communicates with the emrun instance via the protocol expected by emrun.

qtestoutputformat=txt|xml|lightxml|junitxml|tap - specifies the output format for the test case.

qbatchedtest - if specified, the script will load the test_batch.wasm module and either run all testcases in it or a specific test case, depending on the existence of the qtestname parameter. Otherwise, the test is assumed to be a standalone binary whose name is determined by the qtestname parameter.

The scripts in the page will load the wasm file as specified by a combination of qbatchedtest and qtestname.

Public interface for querying the test execution status is accessible via the global object 'qtTestRunner':

qtTestRunner.status - this contains the status of the test runner itself, of the enumeration type RunnerStatus.

qtTestRunner.results - a map of test class name to test result. The result contains a test status (status, of the enumeration TestStatus), text output chunks (output), and in case of a terminal status, also the test's exit code (exitCode)

qtTestRunner.onStatusChanged - an event for changes in state of the runner itself. The possible values are those of the enumeration RunnerStatus.

qtTestRunner.onTestStatusChanged - an event for changes in state of a single tests class. The possible values are those of the enumeration TestStatus. When a terminal state is reached (Completed, Error, Crashed), the text results and exit code are filled in, if available, and will not change.

Typical usage: Run all tests in a batch: - load the webpage batchedtestrunner.html

Run a single test in a batch: - load the webpage batchedtestrunner.html?qtestname=tst_mytest

Query for test execution state: - qtTestRunner.onStatusChanged.addEventListener((runnerStatus) => (...))) - qtTestRunner.onTestStatusChanged.addEventListener((testName, status) => (...)) - qtTestRunner.status === (...) - qtTestRunner.results['tst_mytest'].status === (...) - qtTestRunner.results['tst_mytest'].textOutput

When queseemrun is specified, the built-in emrun support module will POST the test output to the emrun instance and will report ^exit^ with a suitable exit code to it when testing is finished.