AuroraMiddleware/qt5base-lts
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
594abde1a2
qt5base-lts/tests/auto/testlib/selftests/expected_cmptest.tap
Friedemann Kleint 9c8d1ca18b QTestlib: Check compared images for device pixel ratio 
When accidentally running a test doing screen-grabbing
with High DPI scaling active, sizes of the obtained pixmaps
can differ due to the device pixel ratio. Add a check to make that
clearer.

[ChangeLog][QtTestLib] Comparison of QImage, QPixmap now checks for the
device pixel ratio.

Change-Id: Id8d5187e99c565c44a7bfb8b9cfb09737815fb15
Reviewed-by: Edward Welbourne <edward.welbourne@qt.io>
2019-07-09 20:15:34 +02:00

481 lines
17 KiB
Plaintext
Raw Blame History

TAP version 13
# tst_Cmptest
ok 1 - initTestCase()
not ok 2 - compare_unregistered_enums()
---
# Compared values are not the same
at: tst_Cmptest::compare_unregistered_enums() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:171)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 171
...
not ok 3 - compare_registered_enums()
---
type: QCOMPARE
message: Compared values are not the same
wanted: Sunday (Qt::Sunday)
found: Monday (Qt::Monday)
expected: Sunday (Qt::Sunday)
actual: Monday (Qt::Monday)
at: tst_Cmptest::compare_registered_enums() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:178)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 178
...
not ok 4 - compare_class_enums()
---
type: QCOMPARE
message: Compared values are not the same
wanted: MyClassEnumValue2 (MyClassEnum::MyClassEnumValue2)
found: MyClassEnumValue1 (MyClassEnum::MyClassEnumValue1)
expected: MyClassEnumValue2 (MyClassEnum::MyClassEnumValue2)
actual: MyClassEnumValue1 (MyClassEnum::MyClassEnumValue1)
at: tst_Cmptest::compare_class_enums() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:184)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 184
...
ok 5 - test_windowflags(pass)
not ok 6 - test_windowflags(fail1)
---
type: QCOMPARE
message: Compared values are not the same
wanted: Window|FramelessWindowHint|WindowSystemMenuHint|WindowStaysOnBottomHint (expectedWindowFlags)
found: Window|WindowSystemMenuHint|WindowStaysOnBottomHint (actualWindowFlags)
expected: Window|FramelessWindowHint|WindowSystemMenuHint|WindowStaysOnBottomHint (expectedWindowFlags)
actual: Window|WindowSystemMenuHint|WindowStaysOnBottomHint (actualWindowFlags)
at: tst_Cmptest::test_windowflags() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:209)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 209
...
not ok 7 - test_windowflags(fail2)
---
type: QCOMPARE
message: Compared values are not the same
wanted: Window|FramelessWindowHint (expectedWindowFlags)
found: Window (actualWindowFlags)
expected: Window|FramelessWindowHint (expectedWindowFlags)
actual: Window (actualWindowFlags)
at: tst_Cmptest::test_windowflags() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:209)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 209
...
ok 8 - test_unregistered_flags(pass)
not ok 9 - test_unregistered_flags(fail1)
---
type: QCOMPARE
message: Compared values are not the same
wanted: 0x5 (expectedFlags)
found: 0x3 (actualFlags)
expected: 0x5 (expectedFlags)
actual: 0x3 (actualFlags)
at: tst_Cmptest::test_unregistered_flags() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:242)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 242
...
not ok 10 - test_unregistered_flags(fail2)
---
type: QCOMPARE
message: Compared values are not the same
wanted: 0x5 (expectedFlags)
found: 0x1 (actualFlags)
expected: 0x5 (expectedFlags)
actual: 0x1 (actualFlags)
at: tst_Cmptest::test_unregistered_flags() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:242)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 242
...
ok 11 - compare_boolfuncs()
ok 12 - compare_to_nullptr()
ok 13 - compare_pointerfuncs()
not ok 14 - compare_tostring(int, string)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVariant(QString,hi) (expected)
found: QVariant(int,123) (actual)
expected: QVariant(QString,hi) (expected)
actual: QVariant(int,123) (actual)
at: tst_Cmptest::compare_tostring() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:331)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 331
...
ok 15 - compare_tostring(both invalid)
not ok 16 - compare_tostring(null hash, invalid)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVariant() (expected)
found: QVariant(QVariantHash) (actual)
expected: QVariant() (expected)
actual: QVariant(QVariantHash) (actual)
at: tst_Cmptest::compare_tostring() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:331)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 331
...
not ok 17 - compare_tostring(string, null user type)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVariant(PhonyClass) (expected)
found: QVariant(QString,A simple string) (actual)
expected: QVariant(PhonyClass) (expected)
actual: QVariant(QString,A simple string) (actual)
at: tst_Cmptest::compare_tostring() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:331)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 331
...
not ok 18 - compare_tostring(both non-null user type)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVariant(PhonyClass,<value not representable as string>) (expected)
found: QVariant(PhonyClass,<value not representable as string>) (actual)
expected: QVariant(PhonyClass,<value not representable as string>) (expected)
actual: QVariant(PhonyClass,<value not representable as string>) (actual)
at: tst_Cmptest::compare_tostring() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:331)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 331
...
ok 19 - compareQStringLists(empty lists)
ok 20 - compareQStringLists(equal lists)
not ok 21 - compareQStringLists(last item different)
---
type: QCOMPARE
message: Compared lists differ at index 2.
wanted: "DIFFERS" (opB)
found: "string3" (opA)
expected: "DIFFERS" (opB)
actual: "string3" (opA)
at: tst_Cmptest::compareQStringLists() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:425)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 425
...
not ok 22 - compareQStringLists(second-last item different)
---
type: QCOMPARE
message: Compared lists differ at index 2.
wanted: "DIFFERS" (opB)
found: "string3" (opA)
expected: "DIFFERS" (opB)
actual: "string3" (opA)
at: tst_Cmptest::compareQStringLists() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:425)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 425
...
not ok 23 - compareQStringLists(prefix)
---
# Compared lists have different sizes.
Actual (opA) size: 2
Expected (opB) size: 1
at: tst_Cmptest::compareQStringLists() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:425)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 425
...
not ok 24 - compareQStringLists(short list second)
---
# Compared lists have different sizes.
Actual (opA) size: 12
Expected (opB) size: 1
at: tst_Cmptest::compareQStringLists() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:425)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 425
...
not ok 25 - compareQStringLists(short list first)
---
# Compared lists have different sizes.
Actual (opA) size: 1
Expected (opB) size: 12
at: tst_Cmptest::compareQStringLists() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:425)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 425
...
not ok 26 - compareQListInt()
---
type: QCOMPARE
message: Compared lists differ at index 2.
wanted: 4 (int2)
found: 3 (int1)
expected: 4 (int2)
actual: 3 (int1)
at: tst_Cmptest::compareQListInt() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:432)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 432
...
not ok 27 - compareQListDouble()
---
type: QCOMPARE
message: Compared lists differ at index 0.
wanted: 1 (double2)
found: 1.5 (double1)
expected: 1 (double2)
actual: 1.5 (double1)
at: tst_Cmptest::compareQListDouble() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:439)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 439
...
ok 28 - compareQColor(Qt::yellow vs "yellow")
not ok 29 - compareQColor(Qt::yellow vs Qt::green)
---
type: QCOMPARE
message: Compared values are not the same
wanted: #ff00ff00 (colorB)
found: #ffffff00 (colorA)
expected: #ff00ff00 (colorB)
actual: #ffffff00 (colorA)
at: tst_Cmptest::compareQColor() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:458)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 458
...
not ok 30 - compareQColor(0x88ff0000 vs 0xffff0000)
---
type: QCOMPARE
message: Compared values are not the same
wanted: #ffff0000 (colorB)
found: #88ff0000 (colorA)
expected: #ffff0000 (colorB)
actual: #88ff0000 (colorA)
at: tst_Cmptest::compareQColor() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:458)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 458
...
ok 31 - compareQPixmaps(both null)
not ok 32 - compareQPixmaps(one null)
---
type: QCOMPARE
message: Compared QPixmaps differ.
wanted: 0 (opB).isNull()
found: 1 (opA).isNull()
expected: 0 (opB).isNull()
actual: 1 (opA).isNull()
at: tst_Cmptest::compareQPixmaps() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:486)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 486
...
not ok 33 - compareQPixmaps(other null)
---
type: QCOMPARE
message: Compared QPixmaps differ.
wanted: 1 (opB).isNull()
found: 0 (opA).isNull()
expected: 1 (opB).isNull()
actual: 0 (opA).isNull()
at: tst_Cmptest::compareQPixmaps() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:486)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 486
...
ok 34 - compareQPixmaps(equal)
not ok 35 - compareQPixmaps(different size)
---
type: QCOMPARE
message: Compared QPixmaps differ in size.
wanted: 20x20 (opB)
found: 11x20 (opA)
expected: 20x20 (opB)
actual: 11x20 (opA)
at: tst_Cmptest::compareQPixmaps() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:486)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 486
...
not ok 36 - compareQPixmaps(different pixels)
---
# Compared values are not the same
at: tst_Cmptest::compareQPixmaps() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:486)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 486
...
not ok 37 - compareQPixmaps(different dpr)
---
type: QCOMPARE
message: Compared QPixmaps differ in device pixel ratio.
wanted: 2 (opB)
found: 1 (opA)
expected: 2 (opB)
actual: 1 (opA)
at: tst_Cmptest::compareQPixmaps() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:486)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 486
...
ok 38 - compareQImages(both null)
not ok 39 - compareQImages(one null)
---
type: QCOMPARE
message: Compared QImages differ.
wanted: 0 (opB).isNull()
found: 1 (opA).isNull()
expected: 0 (opB).isNull()
actual: 1 (opA).isNull()
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
not ok 40 - compareQImages(other null)
---
type: QCOMPARE
message: Compared QImages differ.
wanted: 1 (opB).isNull()
found: 0 (opA).isNull()
expected: 1 (opB).isNull()
actual: 0 (opA).isNull()
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
ok 41 - compareQImages(equal)
not ok 42 - compareQImages(different size)
---
type: QCOMPARE
message: Compared QImages differ in size.
wanted: 20x20 (opB)
found: 11x20 (opA)
expected: 20x20 (opB)
actual: 11x20 (opA)
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
not ok 43 - compareQImages(different format)
---
type: QCOMPARE
message: Compared QImages differ in format.
wanted: 3 (opB)
found: 6 (opA)
expected: 3 (opB)
actual: 6 (opA)
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
not ok 44 - compareQImages(different pixels)
---
# Compared values are not the same
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
not ok 45 - compareQImages(different dpr)
---
type: QCOMPARE
message: Compared QImages differ in device pixel ratio.
wanted: 2 (opB)
found: 1 (opA)
expected: 2 (opB)
actual: 1 (opA)
at: tst_Cmptest::compareQImages() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:516)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 516
...
ok 46 - compareQRegion(equal-empty)
not ok 47 - compareQRegion(1-empty)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QRegion(null) (rB)
found: QRegion(200x50+10+10) (rA)
expected: QRegion(null) (rB)
actual: QRegion(200x50+10+10) (rA)
at: tst_Cmptest::compareQRegion() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:539)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 539
...
ok 48 - compareQRegion(equal)
not ok 49 - compareQRegion(different lists)
---
type: QCOMPARE
message: Compared values are not the same
wanted: QRegion(2 rectangles, 50x200+100+200, 200x50+10+10) (rB)
found: QRegion(200x50+10+10) (rA)
expected: QRegion(2 rectangles, 50x200+100+200, 200x50+10+10) (rB)
actual: QRegion(200x50+10+10) (rA)
at: tst_Cmptest::compareQRegion() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:539)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 539
...
not ok 50 - compareQVector2D()
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVector2D(1, 3) (v2b)
found: QVector2D(1, 2) (v2a)
expected: QVector2D(1, 3) (v2b)
actual: QVector2D(1, 2) (v2a)
at: tst_Cmptest::compareQVector2D() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:548)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 548
...
not ok 51 - compareQVector3D()
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVector3D(1, 3, 3) (v3b)
found: QVector3D(1, 2, 3) (v3a)
expected: QVector3D(1, 3, 3) (v3b)
actual: QVector3D(1, 2, 3) (v3a)
at: tst_Cmptest::compareQVector3D() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:557)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 557
...
not ok 52 - compareQVector4D()
---
type: QCOMPARE
message: Compared values are not the same
wanted: QVector4D(1, 3, 3, 4) (v4b)
found: QVector4D(1, 2, 3, 4) (v4a)
expected: QVector4D(1, 3, 3, 4) (v4b)
actual: QVector4D(1, 2, 3, 4) (v4a)
at: tst_Cmptest::compareQVector4D() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:566)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 566
...
not ok 53 - verify()
---
type: QVERIFY
message: Verification failed
wanted: true (opaqueFunc() < 2)
found: false (opaqueFunc() < 2)
expected: true (opaqueFunc() < 2)
actual: false (opaqueFunc() < 2)
at: tst_Cmptest::verify() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:578)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 578
...
not ok 54 - verify2()
---
type: QVERIFY
message: 42
wanted: true (opaqueFunc() < 2)
found: false (opaqueFunc() < 2)
expected: true (opaqueFunc() < 2)
actual: false (opaqueFunc() < 2)
at: tst_Cmptest::verify2() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:584)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 584
...
not ok 55 - tryVerify()
---
type: QVERIFY
message: Verification failed
wanted: true (opaqueFunc() < 2)
found: false (opaqueFunc() < 2)
expected: true (opaqueFunc() < 2)
actual: false (opaqueFunc() < 2)
at: tst_Cmptest::tryVerify() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:590)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 590
...
not ok 56 - tryVerify2()
---
type: QVERIFY
message: 42
wanted: true (opaqueFunc() < 2)
found: false (opaqueFunc() < 2)
expected: true (opaqueFunc() < 2)
actual: false (opaqueFunc() < 2)
at: tst_Cmptest::tryVerify2() (qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp:596)
file: qtbase/tests/auto/testlib/selftests/cmptest/tst_cmptest.cpp
line: 596
...
ok 57 - verifyExplicitOperatorBool()
ok 58 - cleanupTestCase()
1..58
# tests 58
# pass 18
# fail 40
Reference in New Issue View Git Blame Copy Permalink