qt5base-lts/tests/auto/testlib/selftests/expected_subtest.txt
Edward Welbourne bac150f056 Add a repeated-failure selftest for testlib
This mimics the effects of test-code delegating checks to other
functions, which can lead to repeated failures. The failing test
should only contribute one to the total of failed tsts.  Drive-by:
correct an existing test's reporting of its own name.

Task-number: QTBUG-95661
Change-Id: I370fd2aee378d9fdd35826f0d11677483c60423d
Reviewed-by: Mårten Nordheim <marten.nordheim@qt.io>
2021-09-01 17:11:43 +02:00

75 lines
4.3 KiB
Plaintext

********* Start testing of tst_Subtest *********
Config: Using QtTest library
QDEBUG : tst_Subtest::initTestCase() initTestCase initTestCase (null)
PASS : tst_Subtest::initTestCase()
QDEBUG : tst_Subtest::test1() init test1 (null)
QDEBUG : tst_Subtest::test1() test1 test1 (null)
QDEBUG : tst_Subtest::test1() cleanup test1 (null)
PASS : tst_Subtest::test1()
QDEBUG : tst_Subtest::test2() test2_data test2 (null)
QDEBUG : tst_Subtest::test2() test2_data end
QDEBUG : tst_Subtest::test2(data0) init test2 data0
QDEBUG : tst_Subtest::test2(data0) test2 test2 data0
QDEBUG : tst_Subtest::test2(data0) test2 end
QDEBUG : tst_Subtest::test2(data0) cleanup test2 data0
PASS : tst_Subtest::test2(data0)
QDEBUG : tst_Subtest::test2(data1) init test2 data1
QDEBUG : tst_Subtest::test2(data1) test2 test2 data1
QDEBUG : tst_Subtest::test2(data1) test2 end
QDEBUG : tst_Subtest::test2(data1) cleanup test2 data1
PASS : tst_Subtest::test2(data1)
QDEBUG : tst_Subtest::test2(data2) init test2 data2
QDEBUG : tst_Subtest::test2(data2) test2 test2 data2
QDEBUG : tst_Subtest::test2(data2) test2 end
QDEBUG : tst_Subtest::test2(data2) cleanup test2 data2
PASS : tst_Subtest::test2(data2)
QDEBUG : tst_Subtest::test3() test3_data test3 (null)
QDEBUG : tst_Subtest::test3() test3_data end
QDEBUG : tst_Subtest::test3(data0) init test3 data0
QDEBUG : tst_Subtest::test3(data0) test3 test3 data0
QDEBUG : tst_Subtest::test3(data0) test3 end
QDEBUG : tst_Subtest::test3(data0) cleanup test3 data0
PASS : tst_Subtest::test3(data0)
QDEBUG : tst_Subtest::test3(data1) init test3 data1
QDEBUG : tst_Subtest::test3(data1) test3 test3 data1
FAIL! : tst_Subtest::test3(data1) Compared values are not the same
Actual (str) : "hello1"
Expected (QString("hello0")): "hello0"
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
QDEBUG : tst_Subtest::test3(data1) cleanup test3 data1
QDEBUG : tst_Subtest::test3(data2) init test3 data2
QDEBUG : tst_Subtest::test3(data2) test3 test3 data2
FAIL! : tst_Subtest::test3(data2) Compared values are not the same
Actual (str) : "hello2"
Expected (QString("hello0")): "hello0"
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
QDEBUG : tst_Subtest::test3(data2) cleanup test3 data2
QDEBUG : tst_Subtest::multiFail() init multiFail (null)
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() This failure message should be repeated ten times
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
FAIL! : tst_Subtest::multiFail() But this test should only contribute one to the failure count
Loc: [qtbase/tests/auto/testlib/selftests/subtest/tst_subtest.cpp(0)]
QDEBUG : tst_Subtest::multiFail() cleanup multiFail (null)
QDEBUG : tst_Subtest::cleanupTestCase() cleanupTestCase cleanupTestCase (null)
PASS : tst_Subtest::cleanupTestCase()
Totals: 7 passed, 13 failed, 0 skipped, 0 blacklisted, 0ms
********* Finished testing of tst_Subtest *********