Valentine Burley
04b154b847
ci/deqp: Add a DEQP_FORCE_ASAN option
...
Replace the last use case for for DEQP_RUNNER_OPTIONS by introducing
a centralized option instead of hardcoding the path via the --env
argument in various test configs.
Signed-off-by: Valentine Burley <valentine.burley@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32659 >
2024-12-17 12:10:04 +00:00
Valentine Burley
ab3356e718
ci/deqp: Simplify conditional arguments
...
Simplify the --baseline and --max-fails conditional arguments.
This will allow deleting DEQP_RUNNER_OPTIONS.
Signed-off-by: Valentine Burley <valentine.burley@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32659 >
2024-12-17 12:10:04 +00:00
Valentine Burley
ee72c8a177
ci/deqp: Remove non-suite support
...
Remove deqp-runner non-suite support to simplify deqp-runner.sh,
prevent the reintroduction of non-suite jobs, and streamline
testing.
Signed-off-by: Valentine Burley <valentine.burley@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32659 >
2024-12-17 12:10:04 +00:00
Eric Engestrom
beab815670
ci/deqp: add a deqp-vk build on the main branch
...
To be able to run new tests as soon as they are merged, instead of
having to wait for the next official CTS release
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/28168 >
2024-11-27 20:38:05 +00:00
Eric Engestrom
ad42be50c9
ci/deqp: fully isolate deqp builds
...
Since the builds can be from very different versions of the code, we
need to make sure the common bits are compiled from the correct code.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32250 >
2024-11-22 10:16:49 +00:00
Eric Engestrom
08e5a50921
ci/deqp: move testlog-to-* tools to /deqp
...
While at it, make it a move instead of copy + delete.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/32250 >
2024-11-22 10:16:49 +00:00
Eric Engestrom
03f056ea71
ci: skip slow tests on all non-"full" jobs
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31828 >
2024-10-25 08:26:31 +00:00
Eric Engestrom
bedb2f8a86
ci: rename "merge-skips" to "slow-skips" as they're about to be used outside of merge piplines
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31828 >
2024-10-25 08:26:31 +00:00
Eric Engestrom
e9998fdef5
ci/{deqp,piglit}-runner: make zstd respect FDO_CI_CONCURRENT when set, and fallback to the current "all the threads"
...
Also, expand `-q` to `--quiet` to be more explicit, and drop a stray
`-c` which did nothing except cancel out `--rm`.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/30416 >
2024-10-21 08:52:22 +00:00
Daniel Stone
ef175ea594
ci: Make section emission really quiet
...
If you're emitting a section header under set -x, you will see:
+ section_start foo "foo"
+ x_off
[the section header]
This is kind of annoying. Instead of trying to squash it everywhere by
dancing around local set +x management, play some extremely stupid
tricks with shells to make sure we never emit it.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31602 >
2024-10-20 11:32:43 +01:00
Daniel Stone
8316654dac
ci: Quieten post-test cleanup
...
Ordinary people are not interested in reading this.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31602 >
2024-10-20 11:32:43 +01:00
Valentine Burley
f3ef27e0b9
ci: Add global ANGLE skips for its waiver
...
ANGLE has a waiver for certain XFB tests, but this wasn't properly applied
on Alder Lake and these tests weren't skipped there.
Add a global angle-skips.txt file so that we don't have to keep copy-pasting
these skips.
Signed-off-by: Valentine Burley <valentine.burley@gmail.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31721 >
2024-10-18 20:39:33 +00:00
Guilherme Gallo
1dc64d0613
ci: Use merge-skips files during merge pipelines
...
These skip files contain tests that exceed one minute in execution time,
which are better suited for nightly jobs. This change aims to optimize
execution time and prevent delays in merge pipelines under time
constraints.
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31699 >
2024-10-18 03:27:45 +00:00
Daniel Stone
938e827c48
ci/deqp: Compress caselists with zstd
...
The Vulkan caselist is gigantic - over 400MB - and only growing over
time. Luckily zstd gets that down to about 9MB, with absolutely
negligible runtime overhead.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31595 >
2024-10-16 22:52:44 +00:00
Daniel Stone
ed8441a339
ci/deqp: Flatten fraction/shard sed into a single pass
...
Currently, we:
* copy the case list to a temporary file
* have sed read it in, decimate for fraction, write it out again
* have sed read it in, decimate for shard, write it out again
Flatten this out to have a single-pass sed covering both fraction and
shard that reads the source caselist in directly and writes the final
one.
This comes at the cost of an expression that's unreadable even for sed,
but with the Vulkan mustpass over 400MB and growing, it's a good
improvement.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31595 >
2024-10-16 22:52:44 +00:00
Deborah Brouwer
f406595ec7
ci/deqp-runner: implement max-fails
...
If we get more than 40 unexpected fails/crashes in a merge pipeline,
then stop early to preserve pipeline resources.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31429 >
2024-10-16 17:32:53 +00:00
Deborah Brouwer
6a564d84e2
ci/deqp-runner: print version info
...
Since deqp-runner is built in several different images, print the
deqp-runner version before running it just to double check that we are
using the expected version.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31429 >
2024-10-16 17:32:53 +00:00
Daniel Stone
476a5aab34
ci/deqp: Use common $RESULTS_DIR
...
This means that setting $DEQP_RESULTS_DIR no longer works, but it does
clean up the CI setup.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/31110 >
2024-09-13 10:12:09 +01:00
Eric Engestrom
03e50318ff
ci/deqp-runner: be less verbose in the loop printing the deqp builds info
...
The bash stuff printed in the middle makes it unnecessarily hard to read
the useful part of the output.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/30866 >
2024-08-27 22:26:17 +00:00
Eric Engestrom
9155e0a887
ci/deqp-runner: fix --fraction-start in non-parallel jobs
...
`CI_NODE_INDEX` is only defined in `parallel:` jobs.
Without this, we end up with `--fraction-start --fraction 1`, which is
obviously invalid but somehow it hasn't blown up (yet).
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/30462 >
2024-08-04 20:40:26 +00:00
Mike Blumenkrantz
6cd4372460
ci: prune dri from LD_LIBRARY_PATH
...
partial revert of 50fc7cc290
Fixes: 50fc7cc290 ("glx: directly link to gallium")
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/30346 >
2024-07-24 15:53:12 +00:00
Mike Blumenkrantz
50fc7cc290
glx: directly link to gallium
...
this eliminates the loader interface, which avoids an entire class
of issues and simplifies a bunch of code
Acked-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/29771 >
2024-07-18 20:30:43 +00:00
Eric Engestrom
cc49894e34
ci: drop dead VK_CPU option
...
Unused since 1eca809680 ("ci/v3dv: test v3dv in arm64
environment"), and in the meantime other code paths have been added and
do not support this (`.gitlab-ci/common/init-stage2.sh` when starting
xorg & wayland for instance), so instead of fixing dead code, let's
remove it.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/29201 >
2024-05-15 14:34:56 +00:00
Samuel Pitoiset
40f39482e1
ci: uprev CTS to vulkan-cts-1.3.8.0
...
Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/27459 >
2024-04-17 21:22:36 +00:00
Eric Engestrom
e215200617
ci: use the new VK_DRIVER_FILES env var
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/28516 >
2024-04-02 18:08:52 +00:00
Eric Engestrom
c73c244a6c
ci/deqp-runner: print deqp-gles version log as well
...
Fixes: 78ea3bb43d ("ci/deqp: use the proper gl/gles releases for deqp-gl*, deqp-gles*, deqp-egl")
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/28356 >
2024-03-24 23:23:44 +00:00
Eric Engestrom
78ea3bb43d
ci/deqp: use the proper gl/gles releases for deqp-gl*, deqp-gles*, deqp-egl
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/27473 >
2024-03-04 16:53:58 +00:00
Eric Engestrom
8bb59f16ec
ci/deqp-runner: inline never-used DEQP_VARIANT variable
...
It has never been used, and we're about to change some of them and not others,
so we need to distinguish them.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/27473 >
2024-03-04 16:53:58 +00:00
Eric Engestrom
fb326ef27f
ci/deqp: split vk and gl builds
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/27250 >
2024-01-26 21:49:05 +00:00
Eric Engestrom
e46702f7ae
ci: deduplicate constructing the ARTIFACTS_BASE_URL
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26670 >
2023-12-13 21:12:22 +00:00
Eric Engestrom
5bdb42b1a2
zink/ci: run only the relevant jobs when changing the ci expectations
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26258 >
2023-12-07 07:55:13 +00:00
Martin Roukala (né Peres)
a1609d76ee
Revert "ci/deqp-runner: turn paths in errors into links"
...
This reverts commit d173584b6e , which
inexplicably-but-reliably broke execution of `zink-radv-navi31-valve`[1].
Rather than experimenting for days on how to fix this, let's revert the
commit as it really isn't a critical thing to have. We'll rework it as
time permits.
[1] https://gitlab.freedesktop.org/mesa/mesa/-/jobs/51870356
Signed-off-by: Martin Roukala (né Peres) <martin.roukala@mupuf.org >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26314 >
2023-11-21 15:54:25 +02:00
Eric Engestrom
d173584b6e
ci/deqp-runner: turn paths in errors into links
...
Suggested-by: Emma Anholt <emma@anholt.net >
Signed-off-by: Eric Engestrom <eric@igalia.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26177 >
2023-11-20 19:26:53 +00:00
Eric Engestrom
1b18ca83fa
amd/ci: avoid re-running all the test jobs when changing the expectations for only one of them
...
Previously, any change to any job would trigger every job.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26127 >
2023-11-17 14:22:46 +00:00
Eric Engestrom
37970fa703
ci/build-deqp: print more detailed information about what deqp version is running
...
`git describe` tells you that you have N patches on top of tag T, but
not what these patches are, and the commit hash is useless as it is only
valid during the container build.
Replace this with:
- the tag that we are checking out
- the list of patches applied on top of it
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/26013 >
2023-11-04 12:44:36 +00:00
Samuel Pitoiset
8f63419733
ci: bump the number of tests per group from 500 to 5000 for Vulkan drivers
...
Except for lvp which already forces 1.
Signed-off-by: Samuel Pitoiset <samuel.pitoiset@gmail.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/25476 >
2023-10-18 12:52:37 +00:00
Eric Engestrom
6387c17504
ci: print deqp version in the job log
...
This allows to easily verify which version was actually running in some
job, to notice if an image tag wasn't properly bumped, for instance.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21850 >
2023-10-07 21:38:02 +00:00
David Heidelberg
45c234700f
ci: do not report failed job when flakes reporting fails
...
It's not critical for the job itself.
Suggested-by: Daniel Stone <daniels@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/25604 >
2023-10-07 20:15:51 +00:00
Eric Engestrom
276caddbd9
ci/deqp-runner: restore exit-on-error after getting deqp-runner's exit code
...
Signed-off-by: Eric Engestrom <eric@igalia.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24738 >
2023-10-01 02:00:50 +00:00
Eric Engestrom
f8326d0950
ci/deqp-runner: fix indentation
...
Signed-off-by: Eric Engestrom <eric@igalia.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24738 >
2023-10-01 02:00:50 +00:00
David Heidelberg
9bf104f934
ci/deqp: really remove the uncompressed results.csv file
...
Arguments are parsed in order, so the `-c` here causes that first `--rm`
won't get applied and then it gets overriden by `-o` which writes the file.
Sadly zstd won't report this as a issue, but that's being reported in [1],
so maybe in future versions zstd will warn about it.
[1] https://github.com/facebook/zstd/issues/3719
Fixes: d110299d77 ("ci/deqp-runner: compress results.csv before uploading it to GitLab")
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24651 >
2023-08-12 19:32:34 +02:00
Emma Anholt
2e3c445b68
ci/anv: Add testing of the GLES CTS using ANGLE on TGL.
...
We're interested in a Vulkan-only stack in Chrome OS, where Android's GLES
would be provided by ANGLE-over-Venus-over-ANV. Let's get some testing
covering ANGLE-on-ANV first.
This is structured as a single partial job pre-merge to catch most
regressions, and a longer manual job to do full coverage for when you need
to update the xfails list.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20163 >
2023-07-06 23:12:30 +00:00
David Heidelberg
5941fc8ccd
ci: enable shellcheck on whole .gitlab-ci
...
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21977 >
2023-05-25 16:06:53 +02:00
Emma Anholt
2c5a2f1a05
ci/valve: Add a workaround for finding libdrm on navi21s.
...
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22495 >
2023-04-25 04:43:10 +00:00
Emma Anholt
75a08b04d7
ci: Move zink's validation layer setup to deqp-runner.sh.
...
I want the path to be always set in case someone wants some
ZINK_DEBUG=validation, rather than having to do it per test job.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22459 >
2023-04-24 19:21:50 +00:00
David Heidelberg
74e4235916
ci: polish deqp-runner a bit
...
Plus cosmetics adjustments to pass more of shellcheck.
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22255 >
2023-04-16 17:28:52 +00:00
David Heidelberg
d73d383ed2
ci: deqp-runner: drop already unused function
...
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21668 >
2023-03-04 04:02:03 +00:00
David Heidelberg
4cc0cec473
ci: implement unified sections
...
in after_script, variable $SCRIPTS_DIR is lost
Acked-by: Daniel Stone <daniels@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20272 >
2023-03-01 12:02:24 +00:00
Emma Anholt
159edf710e
ci/piglit: Exclude swapbuffers front-readback tests with PIGLIT_PLATFORM=gbm.
...
These are expected to fail by the design of gbm. Don't make each driver
track them.
Acked-by: Alyssa Rosenzweig <alyssa.rosenzweig@collabora.com >
Acked-by: Karol Herbst <kherbst@redhat.com >
Acked-by: Martin Roukala <martin.roukala@mupuf.org >
Acked-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20798 >
2023-01-24 00:13:03 +00:00
Emma Anholt
849af68dbd
ci/piglit: Add some common piglit skips for Mesa CI's testing of glx.
...
Since our X servers don't have a compositor, and we run tests in parallel,
various swap and frontbuffer tests won't ever be stable. Rather than
having every driver have to track those flakes, make a general X11 skips
list as a known issue of our CI rather than pointing fingers at drivers.
Acked-by: Alyssa Rosenzweig <alyssa.rosenzweig@collabora.com >
Acked-by: Karol Herbst <kherbst@redhat.com >
Acked-by: Martin Roukala <martin.roukala@mupuf.org >
Acked-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20798 >
2023-01-24 00:13:02 +00:00