Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
/****************************************************************************
|
|
|
|
**
|
|
|
|
** Copyright (C) 2021 The Qt Company Ltd.
|
|
|
|
** Contact: https://www.qt.io/licensing/
|
|
|
|
**
|
|
|
|
** This file is part of the test suite of the Qt Toolkit.
|
|
|
|
**
|
|
|
|
** $QT_BEGIN_LICENSE:GPL-EXCEPT$
|
|
|
|
** Commercial License Usage
|
|
|
|
** Licensees holding valid commercial Qt licenses may use this file in
|
|
|
|
** accordance with the commercial license agreement provided with the
|
|
|
|
** Software or, alternatively, in accordance with the terms contained in
|
|
|
|
** a written agreement between you and The Qt Company. For licensing terms
|
|
|
|
** and conditions see https://www.qt.io/terms-conditions. For further
|
|
|
|
** information use the contact form at https://www.qt.io/contact-us.
|
|
|
|
**
|
|
|
|
** GNU General Public License Usage
|
|
|
|
** Alternatively, this file may be used under the terms of the GNU
|
|
|
|
** General Public License version 3 as published by the Free Software
|
|
|
|
** Foundation with exceptions as appearing in the file LICENSE.GPL3-EXCEPT
|
|
|
|
** included in the packaging of this file. Please review the following
|
|
|
|
** information to ensure the GNU General Public License requirements will
|
|
|
|
** be met: https://www.gnu.org/licenses/gpl-3.0.html.
|
|
|
|
**
|
|
|
|
** $QT_END_LICENSE$
|
|
|
|
**
|
|
|
|
****************************************************************************/
|
|
|
|
|
|
|
|
#include <qbaselinetest.h>
|
2021-11-19 11:25:00 +00:00
|
|
|
#include <qwidgetbaselinetest.h>
|
Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
#include <QtWidgets>
|
|
|
|
|
2021-11-19 11:25:00 +00:00
|
|
|
class tst_Widgets : public QWidgetBaselineTest
|
Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
{
|
|
|
|
Q_OBJECT
|
|
|
|
|
|
|
|
public:
|
2021-11-19 11:25:00 +00:00
|
|
|
tst_Widgets() = default;
|
Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
|
|
|
|
private slots:
|
|
|
|
void tst_QSlider_data();
|
|
|
|
void tst_QSlider();
|
|
|
|
|
|
|
|
void tst_QPushButton_data();
|
|
|
|
void tst_QPushButton();
|
|
|
|
};
|
|
|
|
|
|
|
|
void tst_Widgets::tst_QSlider_data()
|
|
|
|
{
|
|
|
|
QTest::addColumn<Qt::Orientation>("orientation");
|
|
|
|
QTest::addColumn<QSlider::TickPosition>("tickPosition");
|
|
|
|
|
|
|
|
QBaselineTest::newRow("horizontal") << Qt::Horizontal << QSlider::NoTicks;
|
|
|
|
QBaselineTest::newRow("horizontal ticks above") << Qt::Horizontal << QSlider::TicksAbove;
|
|
|
|
QBaselineTest::newRow("horizontal ticks below") << Qt::Horizontal << QSlider::TicksBelow;
|
|
|
|
QBaselineTest::newRow("horizontal ticks both") << Qt::Horizontal << QSlider::TicksBothSides;
|
|
|
|
QBaselineTest::newRow("vertical") << Qt::Vertical << QSlider::NoTicks;
|
|
|
|
QBaselineTest::newRow("vertical ticks left") << Qt::Vertical << QSlider::TicksLeft;
|
|
|
|
QBaselineTest::newRow("vertical ticks right") << Qt::Vertical << QSlider::TicksRight;
|
|
|
|
QBaselineTest::newRow("vertical ticks both") << Qt::Vertical << QSlider::TicksBothSides;
|
|
|
|
}
|
|
|
|
|
|
|
|
void tst_Widgets::tst_QSlider()
|
|
|
|
{
|
|
|
|
struct PublicSlider : QSlider { friend tst_Widgets; };
|
|
|
|
QFETCH(Qt::Orientation, orientation);
|
|
|
|
QFETCH(QSlider::TickPosition, tickPosition);
|
|
|
|
|
|
|
|
QBoxLayout *box = new QBoxLayout(orientation == Qt::Horizontal ? QBoxLayout::TopToBottom
|
|
|
|
: QBoxLayout::LeftToRight);
|
|
|
|
QList<QSlider*> _sliders;
|
|
|
|
for (int i = 0; i < 3; ++i) {
|
|
|
|
QSlider *slider = new QSlider;
|
|
|
|
slider->setOrientation(orientation);
|
|
|
|
slider->setTickPosition(tickPosition);
|
|
|
|
_sliders << slider;
|
|
|
|
box->addWidget(slider);
|
|
|
|
}
|
|
|
|
const auto sliders = _sliders;
|
|
|
|
|
2021-11-19 11:25:00 +00:00
|
|
|
testWindow()->setLayout(box);
|
Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
|
|
|
|
// we want to see sliders with different values
|
|
|
|
int value = 0;
|
|
|
|
for (const auto &slider : sliders)
|
|
|
|
slider->setValue(value += 33);
|
|
|
|
|
|
|
|
takeStandardSnapshots();
|
|
|
|
|
|
|
|
PublicSlider *slider = static_cast<PublicSlider*>(sliders.first());
|
|
|
|
QStyleOptionSlider sliderOptions;
|
|
|
|
slider->initStyleOption(&sliderOptions);
|
|
|
|
const QRect handleRect = slider->style()->subControlRect(QStyle::CC_Slider, &sliderOptions,
|
|
|
|
QStyle::SubControl::SC_SliderHandle, slider);
|
|
|
|
QTest::mousePress(slider, Qt::LeftButton, {}, handleRect.center());
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "pressed");
|
|
|
|
QTest::mouseRelease(slider, Qt::LeftButton, {}, handleRect.center());
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "released");
|
|
|
|
|
|
|
|
slider->setSliderDown(true);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "down");
|
|
|
|
|
|
|
|
sliders.first()->setSliderDown(false);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "notdown");
|
|
|
|
}
|
|
|
|
|
|
|
|
void tst_Widgets::tst_QPushButton_data()
|
|
|
|
{
|
|
|
|
QTest::addColumn<bool>("isFlat");
|
|
|
|
|
|
|
|
QBaselineTest::newRow("normal") << false;
|
|
|
|
QBaselineTest::newRow("flat") << true;
|
|
|
|
}
|
|
|
|
|
|
|
|
void tst_Widgets::tst_QPushButton()
|
|
|
|
{
|
|
|
|
QFETCH(bool, isFlat);
|
|
|
|
|
|
|
|
QVBoxLayout *vbox = new QVBoxLayout;
|
|
|
|
QPushButton *testButton = new QPushButton("Ok");
|
|
|
|
testButton->setFlat(isFlat);
|
|
|
|
vbox->addWidget(testButton);
|
|
|
|
|
|
|
|
testWindow()->setLayout(vbox);
|
|
|
|
takeStandardSnapshots();
|
|
|
|
|
|
|
|
testButton->setDown(true);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "down");
|
|
|
|
testButton->setDown(false);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "up");
|
2021-11-23 13:13:26 +00:00
|
|
|
|
|
|
|
testButton->setDefault(true);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "default_up");
|
|
|
|
testButton->setDown(true);
|
|
|
|
QBASELINE_CHECK(takeSnapshot(), "default_down");
|
|
|
|
testButton->setDown(false);
|
Add baseline test that allows comparing the rendering of widgets
Provide basic boiler plate that sets up the baseline (aka lancelot)
framework specifically for comparing the appearance of widgets, and
implement test functions for QSlider and QPushButton.
Widgets should always look the same if the QPA platform, the OS
version, and certain UI-impacting attributes are identical. Ie.
on any macOS 10.15 machine that runs in "Light" mode, widgets
look the same. On a macOS 11 machine, they might look different.
On an OpenSUSE machine using the fusion style things might look
different from a Ubuntu machine.
The helper function removes DPR differences - images are always
scaled to a DPR of 1.0, which allows us to compare the image\
content and not get distracted by them having different dimensions
(and the fuzzy comparison of images might make the system tolerate
scaling artefacts).
Note: For now, this test is meant to be run locally, either when
testing changes to style code, or when checking how QWidget based
UIs would look on newer version of an operating system. In CI the
test is run, but then skipped in CI as the baseline server is
not configured.
Change-Id: Ie33a9d979d934f0df6883757333ce2c5e2f7ef84
Reviewed-by: Tor Arne Vestbø <tor.arne.vestbo@qt.io>
2021-11-11 19:29:22 +00:00
|
|
|
}
|
|
|
|
|
|
|
|
|
|
|
|
#define main _realmain
|
|
|
|
QTEST_MAIN(tst_Widgets)
|
|
|
|
#undef main
|
|
|
|
|
|
|
|
int main(int argc, char *argv[])
|
|
|
|
{
|
|
|
|
qSetGlobalQHashSeed(0); // Avoid rendering variations caused by QHash randomization
|
|
|
|
|
|
|
|
QBaselineTest::handleCmdLineArgs(&argc, &argv);
|
|
|
|
return _realmain(argc, argv);
|
|
|
|
}
|
|
|
|
|
|
|
|
#include "tst_baseline_widgets.moc"
|