AuroraMiddleware/gtk2
1
0
Fork 0
forked from AuroraMiddleware/gtk
Code Issues Pull Requests Projects Releases Wiki Activity
957dd49ef7
gtk2/testsuite/gtk
History
Simon McVittie 957dd49ef7 testsuite: Use separate setups for unstable tests instead of should_fail 
There are two possible interpretations of "expected failure": either
the test *must* fail (exactly the inverse of an ordinary test, with
success becoming failure and failure becoming success), or the test
*may* fail (with success intended, but failure possible in some
environments). Autotools had the second interpretation, which seems
more useful in practice, but Meson has the first.

Instead of using should_fail, we can put the tests in one of two new
suites: "flaky" is intended for tests that succeed or fail unpredictably
according to the test environment or chance, while "failing" is for
tests that ought to succeed but currently never do as a result of a
bug or missing functionality. With a sufficiently new version of Meson,
the flaky and failing tests are not run by default, but can be requested
by running a setup that does not exclude them, with a command like:

    meson test --setup=x11_unstable --suite=flaky --suite=failing

As a bonus, now that we're setting up setups and their excluded suites
programmatically, the gsk-compare-broadway tests are also excluded by
default when running the test setup for a non-broadway backend.

When running the tests in CI, --suite=gtk overrides the default
exclude_suites, so we have to specify --no-suite=flaky and
--no-suite=failing explicitly.

This arrangement is inspired by GNOME/glib!2987, which was contributed
by Marco Trevisan.

Signed-off-by: Simon McVittie <smcv@debian.org>
2022-11-24 13:46:33 +00:00
..
compose Add a test for short compose sequences 2022-09-12 22:30:47 -04:00
file-chooser-test-dir build: Move gtk/tests to testsuite/gtk 2013-05-15 15:37:16 +02:00
focus-chain gtk: Remove GtkFileChooserButton 2020-12-03 02:02:27 +01:00
icons testsuite: add a test for non-square symbolic icons 2015-06-12 08:55:23 -07:00
icons2 icon-theme: Test inheritance vs. generic fallback 2014-09-21 16:34:27 -04:00
ui builder: Parse PangoAttrList values 2022-11-18 10:42:50 -05:00
accel.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
accessor-apis.c Cosmetics: Eradicate gint 2021-06-03 17:41:28 -04:00
action.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
adjustment.c Replace "gint" with "int" 2020-07-25 00:47:36 +02:00
autotestkeywords.cc docs: Stop referring to the Quartz backend 2020-10-29 14:23:46 -04:00
bitmask.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
bitset.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
border.c gtk: Improve test coverage 2022-07-18 07:08:01 -05:00
builder.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
builderparser.c testsuite: test new treestore builder functionality 2022-05-06 09:29:44 -04:00
calendar.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
cellarea.c Deprecate GtkEntryCompletion 2022-10-03 23:23:56 -04:00
check-icon-names.c testsuite/gtk: Add common_cflags to build 2020-03-07 16:28:04 +01:00
composetable.c Add a test for short compose sequences 2022-09-12 22:30:47 -04:00
constraint-solver.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
cssprovider.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
defaultvalue.c Add GtkFontDialogButton 2022-10-29 13:31:41 -04:00
displayclose.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
entry.c Replace "gchar" with "char" 2020-07-25 00:47:36 +02:00
expression.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
filefilter.c filefilter: Add properties for the criteria 2022-11-21 22:44:03 -05:00
filter.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
filterlistmodel-exhaustive.c filterlistmodel: Add ::item-type and ::n-items 2022-06-11 08:25:22 +02:00
filterlistmodel.c filterlistmodel: Add more tests 2022-07-18 07:08:01 -05:00
filtermodel.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
flattenlistmodel.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
floating.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
flowbox.c Add a test for a flowbox crash 2020-05-13 21:47:11 -04:00
fnmatch.c testsuite: Fix a few memory leaks 2021-09-14 08:29:45 -04:00
gestures.c Replace "gdouble" with "double" 2020-07-25 00:47:36 +02:00
grid-layout.c grid layout: Rename some properties 2020-08-02 17:58:03 -04:00
grid.c Replace "gint" with "int" 2020-07-25 00:47:36 +02:00
gtk.test.in testsuite: Run some installed tests exclusively 2021-05-17 07:16:42 -04:00
gtktreemodelrefcount.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
gtktreemodelrefcount.h Replace "gint" with "int" 2020-07-25 00:47:36 +02:00
icontheme.c tests: Rewrite the icontheme tests 2022-09-23 18:12:39 -04:00
imcontext.c textview: Provide more context to input methods 2021-12-03 14:44:05 -05:00
label.c tests: Rewrite PangoAttribute introspection 2021-08-24 12:53:48 -04:00
listbox.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
listlistmodel.c Add some tests for the listlistmodel 2022-07-15 15:46:06 -04:00
liststore.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
main.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
maplistmodel.c Add more maplistmodel tests 2022-07-14 17:04:02 -04:00
meson.build testsuite: Use separate setups for unstable tests instead of should_fail 2022-11-24 13:46:33 +00:00
misc.c Add a test for picker button constructors 2022-11-07 15:32:51 +01:00
modelrefcount.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
multiselection.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
no-gtk-init.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
noselection.c Add some tests for GtkNoSelection 2022-07-15 15:46:06 -04:00
notify.c testsuite: Fix up a few test for GtkStackPage changes 2022-07-13 15:03:05 +01:00
object.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
objects-finalize.c testsuite: Fix up a few test for GtkStackPage changes 2022-07-13 15:03:05 +01:00
papersize.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
popover.c Use gtk_window_set_child throughout 2020-05-04 22:53:08 -04:00
propertylookuplistmodel.c propertylookuplistmodel: Add ::item-type and ::n-items 2022-06-11 08:25:18 +02:00
rbtree-crash.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
rbtree.c Deprecate treeviews and cell renderers 2022-10-11 17:18:21 -04:00
recentmanager.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
regression-tests.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
revealer-size.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
scrolledwindow.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
searchbar.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
shortcuts.c gdk/toplevel: Negotiate surface size via a compute-size signal 2020-08-05 15:49:00 +02:00
singleselection.c singleselection: Add ::item-type and ::n-items 2022-06-11 08:25:16 +02:00
slicelistmodel.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
sorter.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
sortlistmodel-exhaustive.c sortlistmodel: Add ::item-type and ::n-items 2022-06-11 08:25:15 +02:00
sortlistmodel.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
sortmodel.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
spinbutton.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
stringlist.c stringlist: Add a construct-only strings property 2022-11-20 14:07:45 -05:00
templates.c Deprecate GtkColorChooser and implementations 2022-10-29 13:31:41 -04:00
test-focus-chain.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
textbuffer.c gtk: Rename some private headers 2022-10-05 23:01:28 -04:00
texthistory.c testsuite: add failing test for delete selection 2021-12-26 12:46:16 -08:00
textiter.c testsuite: Reduce the use of g_assert 2021-04-12 21:22:46 -04:00
theme-validate.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
timsort.c Drop redundant glib version checks 2022-11-17 22:49:56 -05:00
tooltips.c Make tooltip properties idiomatic 2020-06-05 20:32:26 +01:00
treelistmodel.c Add a test for treelistmodel row collapse 2022-08-24 08:23:22 -04:00
treemodel.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
treemodel.h testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
treepath.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
treesorter.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
treestore.c Avoid g_log_set_writer_func in tests 2022-05-28 10:43:26 -04:00
treeview.c testsuite: Ignore deprecations 2022-10-11 17:18:21 -04:00
typename.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
widget-refcount.c Deprecate GtkFileChooser and implementations 2022-10-29 13:31:41 -04:00
widgetorder.c Force g_test_init to cooperate 2021-04-12 21:22:46 -04:00
window.c testsuite: Remove test for gtk_window_resize() 2020-12-07 09:46:39 +01:00