mirror of
https://gitlab.gnome.org/GNOME/glib.git
synced 2024-11-11 20:06:18 +01:00
62dca6c1cf
We have tests that are failing in some environments, but it's difficult to handle them because: - for some environments we just allow all the tests to fail: DANGEROUS - when we don't allow failures we have flacky tests: A CI pain So, to avoid this and ensure that: - New failing tests are tracked in all platforms - gitlab integration on tests reports is working - coverage is reported also for failing tests Add support for `can_fail` keyword on tests that would mark the test as part of the `failing` test suite. Not adding the suite directly when defining the tests as this is definitely simpler and allows to define conditions more clearly (see next commits). Now, add a default test setup that does not run the failing and flaky tests by default (not to bother distributors with testing well-known issues) and eventually run all the tests in CI: - Non-flaky tests cannot fail in all platforms - Failing and Flaky tests can fail In both cases we save the test reports so that gitlab integration is preserved.
29 lines
905 B
Batchfile
29 lines
905 B
Batchfile
@echo on
|
|
:: vcvarsall.bat sets various env vars like PATH, INCLUDE, LIB, LIBPATH for the
|
|
:: specified build architecture
|
|
call "C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\VC\Auxiliary\Build\vcvarsall.bat" x64
|
|
|
|
:: Remove quotes from script args
|
|
setlocal enabledelayedexpansion
|
|
set args=
|
|
for %%x in (%*) do (
|
|
set args=!args! %%~x
|
|
)
|
|
set args=%args:~1%
|
|
|
|
:: FIXME: make warnings fatal
|
|
pip3 install --upgrade --user meson==0.60.3 || goto :error
|
|
meson %args% _build || goto :error
|
|
python .gitlab-ci/check-missing-install-tag.py _build || goto :error
|
|
ninja -C _build || goto :error
|
|
|
|
:: FIXME: dont ignore test errors
|
|
meson test -C _build --timeout-multiplier %MESON_TEST_TIMEOUT_MULTIPLIER%
|
|
meson test -C _build --timeout-multiplier %MESON_TEST_TIMEOUT_MULTIPLIER% --setup=unstable_tests --suite=failing --suite=flaky
|
|
|
|
:: FIXME: can we get code coverage support?
|
|
|
|
goto :EOF
|
|
:error
|
|
exit /b 1
|