qt5base-lts/tests/auto/testlib/selftests/expected_counting.tap
Tor Arne Vestbø 3b42e098ef testlib: Add Test Anything Protocol (TAP) reporter
The Test Anything Protocol (TAP), was originally Perl's simple text-based
interface between testing modules and test harnesses, but has since been
adopted by a large number of producers and consumers in many different
languages, which allows colorizing and summarizing test results.

The format is very simple:

TAP version 13
ok 1 - test description
not ok 2 - test description
  ---
  message: 'Failure message'
  severity: fail
  expected: 123
  actual: 456
  ...
ok 3 - test description # SKIP
1..3

The specification [1] is very brief, so the implementation has been
based on how typical consumers behave, especially when it comes to
the undefined diagnostics block.

[1] http://testanything.org/tap-version-13-specification.html

Change-Id: I616e802ea380165c678510e940ddc6607d39c92d
Reviewed-by: Simon Hausmann <simon.hausmann@qt.io>
2018-03-14 14:28:36 +00:00

119 lines
3.7 KiB
Plaintext

TAP version 13
# tst_Counting
ok 1 - initTestCase()
ok 2 - testPassPass(row 1)
ok 3 - testPassPass(row 2)
ok 4 - testPassSkip(row 1)
ok 5 - testPassSkip(row 2) # SKIP Skipping
ok 6 - testPassFail(row 1)
not ok 7 - testPassFail(row 2)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testPassFail() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
ok 8 - testSkipPass(row 1) # SKIP Skipping
ok 9 - testSkipPass(row 2)
ok 10 - testSkipSkip(row 1) # SKIP Skipping
ok 11 - testSkipSkip(row 2) # SKIP Skipping
ok 12 - testSkipFail(row 1) # SKIP Skipping
not ok 13 - testSkipFail(row 2)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testSkipFail() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
not ok 14 - testFailPass(row 1)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testFailPass() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
ok 15 - testFailPass(row 2)
not ok 16 - testFailSkip(row 1)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testFailSkip() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
ok 17 - testFailSkip(row 2) # SKIP Skipping
not ok 18 - testFailFail(row 1)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testFailFail() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
not ok 19 - testFailFail(row 2)
---
type: QVERIFY
message: Verification failed
wanted: true (false)
found: false (false)
expected: true (false)
actual: false (false)
at: tst_Counting::testFailFail() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:102)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 102
...
ok 20 - testFailInInit(before)
not ok 21 - testFailInInit(fail)
---
# Fail in init()
at: tst_Counting::testFailInInit() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:221)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 221
...
ok 22 - testFailInInit(after)
ok 23 - testFailInCleanup(before)
# This test function should execute and then QFAIL in cleanup()
not ok 24 - testFailInCleanup(fail)
---
# Fail in cleanup()
at: tst_Counting::testFailInCleanup() (qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp:229)
file: qtbase/tests/auto/testlib/selftests/counting/tst_counting.cpp
line: 229
...
ok 25 - testFailInCleanup(after)
ok 26 - testSkipInInit(before)
ok 27 - testSkipInInit(skip) # SKIP Skip in init()
ok 28 - testSkipInInit(after)
ok 29 - testSkipInCleanup(before)
# This test function should execute and then QSKIP in cleanup()
ok 30 - testSkipInCleanup(skip) # SKIP Skip in cleanup()
ok 31 - testSkipInCleanup(after)
ok 32 - cleanupTestCase()
1..32
# tests 32
# pass 16
# fail 8