10414444e1
We need to have a finer grained control over the tests we skip in our CI system. This adds a blacklisting mechanism that allows blacklisting individual test functions (or even test data) using a set of predefined matching keys for the operating system and some other relevant variables. QTestlib will search for a file called BLACKLIST in the test directory and parse it if found. The file contains a simple ini style list of functions to blacklist. For details see qtestblacklist.cpp. Change-Id: Id3fae4b264ca99970cbf9f45bfb85fa75c1fd823 Reviewed-by: Lars Knoll <lars.knoll@digia.com>
56 lines
3.1 KiB
Plaintext
56 lines
3.1 KiB
Plaintext
********* Start testing of tst_ExpectFail *********
|
|
Config: Using QtTest library @INSERT_QT_VERSION_HERE@, Qt @INSERT_QT_VERSION_HERE@
|
|
PASS : tst_ExpectFail::initTestCase()
|
|
QDEBUG : tst_ExpectFail::xfailAndContinue() begin
|
|
XFAIL : tst_ExpectFail::xfailAndContinue() This should xfail
|
|
Loc: [tst_expectfail.cpp(78)]
|
|
QDEBUG : tst_ExpectFail::xfailAndContinue() after
|
|
PASS : tst_ExpectFail::xfailAndContinue()
|
|
QDEBUG : tst_ExpectFail::xfailAndAbort() begin
|
|
XFAIL : tst_ExpectFail::xfailAndAbort() This should xfail
|
|
Loc: [tst_expectfail.cpp(86)]
|
|
PASS : tst_ExpectFail::xfailAndAbort()
|
|
FAIL! : tst_ExpectFail::xfailTwice() Already expecting a fail
|
|
Loc: [tst_expectfail.cpp(96)]
|
|
XFAIL : tst_ExpectFail::xfailWithQString() A string
|
|
Loc: [tst_expectfail.cpp(105)]
|
|
XFAIL : tst_ExpectFail::xfailWithQString() Bug 5 (The message)
|
|
Loc: [tst_expectfail.cpp(110)]
|
|
PASS : tst_ExpectFail::xfailWithQString()
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQVerify(Pass 1)
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQVerify(Pass 2)
|
|
XFAIL : tst_ExpectFail::xfailDataDrivenWithQVerify(Abort) This test should xfail
|
|
Loc: [tst_expectfail.cpp(139)]
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQVerify(Abort)
|
|
XFAIL : tst_ExpectFail::xfailDataDrivenWithQVerify(Continue) This test should xfail
|
|
Loc: [tst_expectfail.cpp(139)]
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQVerify(Continue)
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQCompare(Pass 1)
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQCompare(Pass 2)
|
|
XFAIL : tst_ExpectFail::xfailDataDrivenWithQCompare(Abort) This test should xfail
|
|
Loc: [tst_expectfail.cpp(173)]
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQCompare(Abort)
|
|
XFAIL : tst_ExpectFail::xfailDataDrivenWithQCompare(Continue) This test should xfail
|
|
Loc: [tst_expectfail.cpp(173)]
|
|
PASS : tst_ExpectFail::xfailDataDrivenWithQCompare(Continue)
|
|
PASS : tst_ExpectFail::xfailOnWrongRow(right row)
|
|
XFAIL : tst_ExpectFail::xfailOnAnyRow(first row) This test should xfail
|
|
Loc: [tst_expectfail.cpp(208)]
|
|
PASS : tst_ExpectFail::xfailOnAnyRow(first row)
|
|
XFAIL : tst_ExpectFail::xfailOnAnyRow(second row) This test should xfail
|
|
Loc: [tst_expectfail.cpp(208)]
|
|
PASS : tst_ExpectFail::xfailOnAnyRow(second row)
|
|
FAIL! : tst_ExpectFail::xfailWithoutVerify(first row) QEXPECT_FAIL was called without any subsequent verification statements
|
|
FAIL! : tst_ExpectFail::xfailWithoutVerify(second row) QEXPECT_FAIL was called without any subsequent verification statements
|
|
XPASS : tst_ExpectFail::xpass() 'true' returned TRUE unexpectedly. ()
|
|
Loc: [tst_expectfail.cpp(228)]
|
|
XPASS : tst_ExpectFail::xpassDataDrivenWithQVerify(XPass) 'true' returned TRUE unexpectedly. ()
|
|
Loc: [tst_expectfail.cpp(250)]
|
|
PASS : tst_ExpectFail::xpassDataDrivenWithQVerify(Pass)
|
|
XPASS : tst_ExpectFail::xpassDataDrivenWithQCompare(XPass) QCOMPARE(1, 1) returned TRUE unexpectedly.
|
|
Loc: [tst_expectfail.cpp(271)]
|
|
PASS : tst_ExpectFail::xpassDataDrivenWithQCompare(Pass)
|
|
PASS : tst_ExpectFail::cleanupTestCase()
|
|
Totals: 18 passed, 6 failed, 0 skipped, 0 blacklisted
|
|
********* Finished testing of tst_ExpectFail *********
|