AuroraMiddleware/gtk2
1
0
Fork 0
forked from AuroraMiddleware/gtk
Code Issues Pull Requests Projects Releases Wiki Activity
3209d0f937
gtk2/testsuite/reftests/meson.build

457 lines
14 KiB
Meson
Raw Normal View History

meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
# FIXME: $(no_undefined) ?
build: Don't hardcode shared_library() in meson. Instead, use the standard library(). This is a meson best practice. Fixes -Ddefault_library=static not having any effect.
2019-11-11 15:37:46 +00:00
libgtkreftestprivate = library('gtkreftestprivate',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'reftest-compare.c', 'reftest-module.c', 'reftest-snapshot.c',
dependencies : libgtk_dep)
build: Don't hardcode shared_library() in meson. Instead, use the standard library(). This is a meson best practice. Fixes -Ddefault_library=static not having any effect.
2019-11-11 15:37:46 +00:00
libreftest = library('reftest',
reftests: Actually build a module Reftests are expecting a module called libreftest.so, so don't build a static libgtkreftest.a but what they expect.
2019-03-27 03:52:59 +00:00
[ 'expand-expander.c',
'frame-inhibitor.c',
'letter-spacing.c',
'set-default-direction.c',
'statusbar-remove-all.c',
'textview-border-windows.c',
'textview-tags.c',
'animation-direction.c',
],
link_with: libgtkreftestprivate,
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
dependencies : libgtk_dep)
tcdata = configuration_data()
meson: Use libexecdir option
2017-05-06 16:25:13 +00:00
tcdata.set('libexecdir', join_paths(get_option('prefix'), get_option('libexecdir')))
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
#built_tests = ['reftests', 'reftests-dark', 'reftests-hc', 'reftests-hci']
#foreach t : built_tests
# configure_file(input : '@0@.test.in'.format(t),
# output : '@0@.test'.format(t),
# configuration : tcdata)
#endforeach
gtk_reftest = executable('gtk-reftest', 'gtk-reftest.c',
testsuite/reftests: Add common_cflags to build
2020-03-06 17:24:58 +00:00
c_args: common_cflags,
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
link_with : [libgtkreftestprivate, libreftest],
dependencies : libgtk_dep)
Add an image comparison utility This comes in handy sometimes, and we already have the image diff code.
2019-07-30 18:01:11 +00:00
image_compare = executable('image-compare', 'image-compare.c',
testsuite/reftests: Add common_cflags to build
2020-03-06 17:24:58 +00:00
c_args: common_cflags,
Add an image comparison utility This comes in handy sometimes, and we already have the image diff code.
2019-07-30 18:01:11 +00:00
link_with : [libgtkreftestprivate, libreftest],
dependencies : libgtk_dep)
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
# Installed data (TODO)
testdata = [
'721800-0px-dotted-border.css',
'721800-0px-dotted-border.ref.ui',
'721800-0px-dotted-border.ui',
'actionbar.css',
'actionbar.ref.ui',
'actionbar.ui',
'animation-direction.css',
'animation-direction.ref.ui',
'animation-direction.ui',
'animation-fill-mode-iteration-count.css',
'animation-fill-mode-iteration-count.ref.ui',
'animation-fill-mode-iteration-count.ui',
'background-area.css',
'background-area.ref.ui',
'background-area.ui',
'background-blend-mode-clip-interaction.css',
'background-blend-mode-clip-interaction.ref.ui',
'background-blend-mode-clip-interaction.ui',
'background-color-transparent.css',
'background-color-transparent.ref.ui',
'background-color-transparent.ui',
'background-image-multiple.css',
'background-image-multiple.ref.ui',
'background-image-multiple.ui',
'background-origin.css',
'background-origin.ref.ui',
'background-origin.ui',
'background-positioning-area-empty.ref.ui',
'background-positioning-area-empty.ui',
'background-position.css',
'background-position.ref.ui',
'background-position.ui',
'background-position-repeat.css',
'background-position-repeat.ref.ui',
'background-position-repeat.ui',
'background-position-repeat-bg.png',
'background-position-simple.css',
'background-position-simple.ref.ui',
'background-position-simple.ui',
'background-size.css',
'background-size.ref.ui',
'background-size.ui',
'background-size-keywords.css',
'background-size-keywords.ref.ui',
'background-size-keywords.ui',
'background-size-zero.css',
'background-size-zero.ref.ui',
'background-size-zero.ui',
'background-window-transparent.css',
'background-window-transparent.ref.ui',
'background-window-transparent.ui',
'bad-color-names.css',
'bad-color-names.ref.ui',
'bad-color-names.ui',
'reference-background-origin.png',
'border-color-default.css',
'border-color-default.ref.ui',
'border-color-default.ui',
'border-corner-zero-width-rendering.css',
'border-corner-zero-width-rendering.ref.ui',
'border-corner-zero-width-rendering.ui',
'border-half-pixel.css',
'border-half-pixel.ref.ui',
'border-half-pixel.ui',
'border-image-ball-green.png',
'border-image-ball-red.png',
'border-image-ball-yellow.png',
'border-image-balls.png',
'border-image-3-balls-green.png',
'border-image-3-balls-green-squished.png',
'border-image-3-balls-yellow.png',
'border-image-3-balls-yellow-squished.png',
'border-image-excess-size.css',
'border-image-excess-size.ref.ui',
'border-image-excess-size.ui',
'border-image-url-scaled.css',
'border-image-url-scaled.ref.ui',
'border-image-url-scaled.ui',
'border-image-url.css',
'border-image-url.ref.ui',
'border-image-url.ui',
'border-radius-clamp.css',
'border-radius-clamp.ref.ui',
'border-radius-clamp.ui',
'border-rgb.png',
'border-rgb@2.png',
'border-style-none.css',
'border-style-none.ref.ui',
'border-style-none.ui',
'border-style.css',
'border-style.ref.ui',
'border-style.ui',
'box-order.css',
'box-order.ref.ui',
'box-order.ui',
'box-pseudo-classes.css',
'box-pseudo-classes.ref.ui',
'box-pseudo-classes.ui',
'box-shadow-changes-modify-clip.css',
'box-shadow-changes-modify-clip.ref.ui',
'box-shadow-changes-modify-clip.ui',
'box-shadow-spec-inset.css',
'box-shadow-spec-inset.ref.ui',
'box-shadow-spec-inset.ui',
'box-shadow-spread.css',
'box-shadow-spread.ref.ui',
'box-shadow-spread.ui',
'box-shadow-with-blend-mode.css',
'box-shadow-with-blend-mode.ref.ui',
'box-shadow-with-blend-mode.ui',
'button-wrapping.ui',
'button-wrapping.ref.ui',
'color-transition.css',
'color-transition.ref.ui',
'color-transition.ui',
reftests: Add a cross-fade syntax-checking reftest Making sure all this newfangled code does what it says.
2019-03-30 19:13:11 +00:00
'cross-fade-syntax.css',
'cross-fade-syntax.ref.ui',
'cross-fade-syntax.ui',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'css-em-label-size.css',
'css-em-label-size.ui',
'css-em-label-size.ref.ui',
'css-currentcolor-alpha.css',
'css-currentcolor-alpha.ui',
'css-currentcolor-alpha.ref.ui',
'css-image-aspect-ratio.css',
'css-image-aspect-ratio.ui',
'css-image-aspect-ratio.ref.ui',
'css-image-color-aspect-ratio.css',
'css-image-color-aspect-ratio.ui',
'css-image-color-aspect-ratio.ref.ui',
'css-match-class.css',
'css-match-class.ref.ui',
'css-match-class.ui',
'css-match-descendant-later.css',
'css-match-descendant-later.ref.ui',
'css-match-descendant-later.ui',
'css-match-exact.css',
'css-match-exact.ref.ui',
'css-match-exact.ui',
'css-match-import.css',
'css-match-import-import.css',
'css-match-import.ui',
'css-match-import.ref.ui',
'css-match-inherit.css',
'css-match-inherit.ref.ui',
'css-match-inherit.ui',
'css-match-inherit-different-state.css',
'css-match-inherit-different-state.ref.ui',
'css-match-inherit-different-state.ui',
'css-match-name.css',
'css-match-name.ref.ui',
'css-match-name.ui',
'css-match-siblings.css',
'css-match-siblings.ref.ui',
'css-match-siblings.ui',
'css-match-type.css',
'css-match-type.ref.ui',
'css-match-type.ui',
'css-multi-state.css',
'css-multi-state.ref.ui',
'css-multi-state.ui',
css: Add data URL parsing to images
2019-05-09 01:11:48 +00:00
'data-url.css',
'data-url.ref.ui',
'data-url.ui',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'fixed-widget-stacking.ref.ui',
'fixed-widget-stacking.ui',
'flipping-icons.ref.ui',
'flipping-icons.ui',
'font-sizes-names.css',
'font-sizes-names.ref.ui',
'font-sizes-names.ui',
'gtk-image-effect-inherit.css',
'gtk-image-effect-inherit.ref.ui',
'gtk-image-effect-inherit.ui',
'green-20x20.png',
'grid-empty-with-spacing.ref.ui',
'grid-empty-with-spacing.ui',
'grid-expand.css',
'grid-expand.ref.ui',
'grid-expand.ui',
'grid-wfh.ui',
'grid-wfh.ref.ui',
'grid-homogeneous.css',
'grid-homogeneous.ref.ui',
'grid-homogeneous.ui',
'grid-spacing1.ref.ui',
'grid-spacing1.ui',
'grid-spacing2.ref.ui',
'grid-spacing2.ui',
'grid-spacing3.css',
'grid-spacing3.ref.ui',
'grid-spacing3.ui',
'gtk-icontheme-sizing.css',
'gtk-icontheme-sizing.ref.ui',
'gtk-icontheme-sizing.ui',
'icon-effect-missing.css',
'icon-effect-missing.ref.ui',
'icon-effect-missing.ui',
'icon-shadow-no-transform.css',
'icon-shadow-no-transform.ref.ui',
'icon-shadow-no-transform.ui',
'icon-style-basics.css',
'icon-style-basics.ref.ui',
'icon-style-basics.ui',
'icon-vfuncs.css',
'icon-vfuncs.ref.ui',
'icon-vfuncs.ui',
'iconview-empty.css',
'iconview-empty.ui',
'iconview-empty.ref.ui',
'image-icon-name-use-fallback.ui',
'image-icon-name-use-fallback.ref.ui',
'image-icon-shadow-clipping.css',
'image-icon-shadow-clipping.ref.ui',
'image-icon-shadow-clipping.ui',
'image-load-from-file.css',
'image-load-from-file.ref.ui',
'image-load-from-file.ui',
'label-attribute-preference.css',
'label-attribute-preference.ref.ui',
'label-attribute-preference.ui',
'label-background.css',
'label-background.ref.ui',
'label-background.ui',
'label-box-shadow-clip.css',
'label-box-shadow-clip.ref.ui',
'label-box-shadow-clip.ui',
'label-clipping.css',
'label-clipping.ref.ui',
'label-clipping.ui',
'label-ellipsize-small.ref.ui',
'label-ellipsize-small.ui',
'label-ellipsize-with-big.ref.ui',
'label-ellipsize-with-big.ui',
Add a reftest for multiple font families This tests that listing multiple font families in the css font-family property works as expected.
2019-05-03 01:33:09 +00:00
'label-fonts.css',
'label-fonts.ref.ui',
'label-fonts.ui',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'label-shadows.css',
'label-shadows.ref.ui',
'label-shadows.ui',
'label-sizing.css',
'label-sizing.ref.ui',
'label-sizing.ui',
'label-small-ellipsized.ref.ui',
'label-small-ellipsized.ui',
'label-text-shadow-clipping.css',
'label-text-shadow-clipping.ref.ui',
'label-text-shadow-clipping.ui',
'label-text-shadow-changes-modify-clip.css',
'label-text-shadow-changes-modify-clip.ref.ui',
'label-text-shadow-changes-modify-clip.ui',
'label-width-chars-dont-shrink.ref.ui',
'label-width-chars-dont-shrink.ui',
'label-wrap-justify.ref.ui',
'label-wrap-justify.ui',
'letter-spacing.css',
'letter-spacing.ui',
'letter-spacing.ref.ui',
'linear-gradient.css',
'linear-gradient.ref.ui',
'linear-gradient.ui',
'linear-gradient-transition-to-other.css',
'linear-gradient-transition-to-other.ref.ui',
'linear-gradient-transition-to-other.ui',
'link-coloring.css',
'link-coloring.ref.ui',
'link-coloring.ui',
'marble.xpm',
'messagedialog-secondarytext.ui',
'messagedialog-secondarytext.ref.ui',
'named-colors.css',
'named-colors.ref.ui',
'named-colors.ui',
'no-colors.css',
'no-colors.ref.ui',
'no-colors.ui',
'nonresizable-size.ref.ui',
'nonresizable-size.ui',
'notebook-tab-position.css',
'notebook-tab-position.ui',
'notebook-tab-position.ref.ui',
'nth-child.css',
'nth-child.ref.ui',
'nth-child.ui',
'opacity.css',
'opacity.ui',
'opacity.ref.ui',
'opacity-initial.css',
'opacity-initial.ref.ui',
'opacity-initial.ui',
'overlay-no-main-widget.ref.ui',
'overlay-no-main-widget.ui',
'paned-undersized.css',
'paned-undersized.ref.ui',
'paned-undersized.ui',
reftests: Add a reftest for rendering failure c18d2872f292607c921c959e6e97c4d6635bdfd2 introduced a misrendering in the Cairo fallback rendering code while fixing another one. This test exposes that problem. Related: !756
2019-04-19 00:28:37 +00:00
'partial-rounded-border.css',
'partial-rounded-border.ref.ui',
'partial-rounded-border.ui',
picture: Don't cause warnings on load failures When a file set via gtk_picture_set_file() can't be loaded, just silently don't load it. Reftest picture-load-invalid-file added for that case.
2019-03-29 04:36:12 +00:00
'picture-load-invalid-file.ui',
'picture-load-invalid-file.ref.ui',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'pseudoclass-on-box.css',
'pseudoclass-on-box.ref.ui',
'pseudoclass-on-box.ui',
'pseudoclass-on-parent.css',
'pseudoclass-on-parent.ref.ui',
'pseudoclass-on-parent.ui',
'quit-mnemonic.css',
'quit-mnemonic.ref.ui',
'quit-mnemonic.ui',
'repeating-radial-gradient-at-beginning.css',
'repeating-radial-gradient-at-beginning.ref.ui',
'repeating-radial-gradient-at-beginning.ui',
'reset-to-defaults.css',
'revealer-extra-size.ref.ui',
'revealer-extra-size.ui',
'revealer-wrappable-contents.ref.ui',
'revealer-wrappable-contents.ui',
'rotated-layout.ref.ui',
'rotated-layout.ui',
'separator-size.css',
'separator-size.ref.ui',
'separator-size.ui',
'set-default-direction.ui',
'set-default-direction.ref.ui',
'shadow-clip-rounding.css',
'shadow-clip-rounding.ref.ui',
'shadow-clip-rounding.ui',
'shorthand-entry-border.css',
'shorthand-entry-border.ref.ui',
'shorthand-entry-border.ui',
'sibling-pseudoclasses.css',
'sibling-pseudoclasses.ref.ui',
'sibling-pseudoclasses.ui',
'simple.ref.ui',
'simple.ui',
'sizegroups-basics.css',
'sizegroups-basics.ui',
'sizegroups-basics.ref.ui',
reftests: Comment out a test that fails only in ci Fixing such only-in-ci failures is just too hard, unfortunately.
2020-04-06 19:15:21 +00:00
# this one triggers pango assertion in ci
#'sizegroups-evolution-identity-page.ui',
#'sizegroups-evolution-identity-page.ref.ui',
meson: testsuite: reftests: add build defs, but needs more work Not sure how these are supposed to work yet, we can specify arguments for running the tests uninstalled as well with test(), if that helps in any way.
2017-03-22 13:17:02 +00:00
'sizegroups-get-preferred-null.ui',
'sizegroups-get-preferred-null.ref.ui',
'statusbar-remove-all.ref.ui',
'statusbar-remove-all.ui',
'style-context-save-inheritance.css',
'style-context-save-inheritance.ref.ui',
'style-context-save-inheritance.ui',
'style-properties-only-child.css',
'style-properties-only-child.ref.ui',
'style-properties-only-child.ui',
'symbolic-icon-translucent-color.css',
'symbolic-icon-translucent-color.ref.ui',
'symbolic-icon-translucent-color.ui',
'textview-border-windows.css',
'textview-border-windows.ref.ui',
'textview-border-windows.ui',
'textview-margins.css',
'textview-margins.ref.ui',
'textview-margins.ui',
'textview-tags.ref.ui',
'textview-tags.ui',
'treeview-crash-too-wide.ref.ui',
'treeview-crash-too-wide.ui',
'treeview-fixed-height.css',
'treeview-fixed-height.ref.ui',
'treeview-fixed-height.ui',
'treeview-headers-hidden.ref.ui',
'treeview-headers-hidden.ui',
'unresolvable.css',
'unresolvable.ref.ui',
'unresolvable.ui',
'window-border-width.ref.ui',
'window-border-width.ui',
'window-default-size.ref.ui',
'window-default-size.ui',
'window-height-for-width.ref.ui',
'window-height-for-width.ui',
'window-show-contents-on-map.ref.ui',
'window-show-contents-on-map.ui',
]
reftests: Mark the currently unfixed failures as XFAIL They should be fixeed before 4.0 but the fixes are more involved. And we want to start running the existing tests on CI, because they break regularly and we want to catch that.
2019-04-12 16:01:45 +00:00
# These need to be fixed but the issue hasn't been tracked down.
xfails = [
'background-origin.ui',
reftests: Comment out a test that fails only in ci Fixing such only-in-ci failures is just too hard, unfortunately.
2020-04-06 19:15:21 +00:00
# see above
#'sizegroups-evolution-identity-page.ui',
reftest: Exclude flaky tests These depend on details of text rendering, and started failing with newer pango.
2019-07-28 20:29:31 +00:00
# these depend on details of text layout
tests: Add label-sizing.ui to the XFAIL list Changes in Pango may make this test fail.
2019-11-04 23:46:22 +00:00
'label-sizing.ui',
reftests: Mark the currently unfixed failures as XFAIL They should be fixeed before 4.0 but the fixes are more involved. And we want to start running the existing tests on CI, because they break regularly and we want to catch that.
2019-04-12 16:01:45 +00:00
]
reftests: Make meson run every test separately This way, we don't get an abort once the first test gets a warning. We also can use meson test to run individual tests. Unfortunately, only ~60% of tests pass.
2019-03-27 01:59:13 +00:00
foreach testname : testdata
build: Don't use 'continue' It does not exist in meson 0.48 apparently.
2019-03-31 04:37:10 +00:00
if testname.endswith('.ui') and not testname.endswith('.ref.ui')
test('reftest ' + testname, gtk_reftest,
ci: Cache the reftest artifacts Keeping the reftest output images as artifacts of a job allows us to browse them and download them straight from GitLab.
2019-04-12 19:58:29 +00:00
args: [ '--tap',
'-k',
'-o', join_paths(meson.current_build_dir(), 'output'),
join_paths(meson.current_source_dir(), testname),
],
testsuite: Tell meson we use TAP This makes meson actually parse the individual test results. Most of the time, it does not make a difference, but one case where it does is when all the individual tests of a binary are skipped, meson will mark the test as skipped.
2020-03-20 13:39:56 +00:00
protocol: 'tap',
build: Don't use 'continue' It does not exist in meson 0.48 apparently.
2019-03-31 04:37:10 +00:00
env: [ 'GIO_USE_VOLUME_MONITOR=unix',
'GSETTINGS_BACKEND=memory',
'GSETTINGS_SCHEMA_DIR=@0@'.format(gtk_schema_build_dir),
'GTK_CSD=1',
Don't use xsettings or xft defaults in testsuite This adds a GDK_DEBUG=default-settings flag which disables reads from xsettings and Xft resources, and enables this for the testsuite. This is one less way to get different testresults depending on the environment. In particular, it was failing the css tests for me due to getting the wrong font size because i have a different dpi.
2020-02-03 14:11:35 +00:00
'GDK_DEBUG=default-settings',
build: Don't use 'continue' It does not exist in meson 0.48 apparently.
2019-03-31 04:37:10 +00:00
'G_ENABLE_DIAGNOSTIC=0',
'G_TEST_SRCDIR=@0@'.format(meson.current_source_dir()),
'G_TEST_BUILDDIR=@0@'.format(meson.current_build_dir()),
'GSK_RENDERER=opengl',
'REFTEST_MODULE_DIR=@0@'.format(meson.current_build_dir()),
],
reftests: Mark the currently unfixed failures as XFAIL They should be fixeed before 4.0 but the fixes are more involved. And we want to start running the existing tests on CI, because they break regularly and we want to catch that.
2019-04-12 16:01:45 +00:00
suite: 'reftest',
should_fail: xfails.contains(testname))
reftests: Make meson run every test separately This way, we don't get an abort once the first test gets a warning. We also can use meson test to run individual tests. Unfortunately, only ~60% of tests pass.
2019-03-27 01:59:13 +00:00
endif
endforeach
Reference in New Issue Copy Permalink