AlexIndustrial/mesa
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
170,109 Commits 1 Branch 0 Tags
c1d32880f7ba767f4d36c8e1bd239311855043a8
Commit Graph

1978 Commits

Author SHA1 Message Date
Emma Anholt 7d17713723 ci: Crank up the yamllint line length limit. 
I hated that CI errors out because I pasted useful information in the
yaml.  You shouldn't have to manually line-wrap pastes from dmesg.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22562>
 2023-04-20 02:22:41 +00:00
Guilherme Gallo d6b30d42b0 ci/lava: Skip regression test if LAVA log file is not present 
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo a893b06691 ci/lava: Use f-strings in job definition 
f-strings are little more concise than str.format() approach.
It makes the code a little more readable as well.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 11a97b644c ci/lava: Refactor LAVAJobSubmitter and add tests 
Some refactoring was needed to make LAVAJobSubmitter class testable via
pytest.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 710b568dcd ci/lava: Force use of UTC timezones 
LAVA farm is giving datetime in UTC timezone, let's standardize it
locally for the script run, so datetimes coming from LAVA proxy calls
will be at the same timezone as the ones we use in structural logging
and traces.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 5c5aec15b1 ci/lava: Integrate StructuralLogger with AutoSaveDict 
Let's use the AutoSaveDict as structural logger abstraction to enable
real-time monitoring of LAVA jobs. Mainly used for local runs and
debugging of Mesa CI LAVA jobs.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 0ac3824922 ci/lava: Add a simple Structural Logger into submitter 
Refactor some pieces of the submitter to improve the clarity of the
functions and create a simple dictionary with aggregated data from the
submitter execution which will be dumped to a file when the script
exits.

Add support for the AutoSaveDict based structured logger as well, which
will come in a follow-up commit.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 41f29c5333 ci/lava: Update LogFollower for better section handling and history 
Update the LogFollower class to improve section handling and provide a
history of sections encountered during log processing:

1. Add section_history attribute to store the history of encountered
   GitlabSections.
2. Make LAVA job submitter use the section history feature to improve
   structural logging.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo cfe644a9e5 ci/lava: Use python-fire in job submitter 
Cleanup argparse to use dataclasses+python-fire to give easier
maintenance to job submitter.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo c03f7233ca ci/lava: Extract LAVA proxy and LAVAJob abstractions 
Let's make lava_job_submitter.py cleaner with only parsing and retry
mechanism capabilities.

Moved out from the submitter script:

1. proxy functions
  - moved to lava.utils.lava_proxy.py
2. LAVAJob class definition
  - moved to lava.utils.lava_job.py
  - added structural logging capabilities into LAVAJob
  - Implemented properties for job_id, is_finished, and status, with
    corresponding setter methods that update the log dictionary.
  - Added new methods show, get_lava_time, and refresh_log for improved
    log handling and data retrieval.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
Guilherme Gallo 6f6b892dca ci/lava: Move job definition stuff to another file 
The LAVA job submitter is too big, let's reorganize it a little.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22500>
 2023-04-19 14:36:37 +00:00
David Heidelberg 135039f526 ci: do not retry on forks to get the upstream kernel and rootfs 
This commit introduces multiple changes:
  1. Now we check for mainline artifacts only when NOT running on
     the mainline branch
  2. if we run on the fork and get 404-like error, it doesn't retry.

Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22386>
 2023-04-18 14:49:10 +00:00
David Heidelberg 74525f8576 ci: uninstall libdrm from the GL and VK containers 
Occasionally causing troubles on -valve jobs.

Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22255>
 2023-04-16 17:28:52 +00:00
David Heidelberg 74e4235916 ci: polish deqp-runner a bit 
Plus cosmetics adjustments to pass more of shellcheck.

Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22255>
 2023-04-16 17:28:52 +00:00
David Heidelberg 1fcfcaf008 ci: drop overriding new a530 firmware due to preemption issues with older kernel 
Fixes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/8825

Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22255>
 2023-04-16 17:28:52 +00:00
David Heidelberg a925c59f83 ci: bump kernel to the 6.3, support HDK 888 based on sm8350 
- uprev to kernel 6.3-rc6
 - add sm8350 support (needed for HDK 888)
 - add missing patch for Asurada functionality
 - enable CONFIG_ARM_SMMU_QCOM, since we dropped specific patch
   worarounding need for it

Acked-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22255>
 2023-04-16 17:28:52 +00:00
David Heidelberg 5cf3b92661 ci/dxvk: uprev to 2.1 
Major uprev, requires VK 1.3 now.

Acked-by: Martin Roukala <martin.roukala@mupuf.org>
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22447>
 2023-04-15 10:57:06 +00:00
Michel Dänzer 20c330e95d ci: Drop executable permissions from backend compiler wrapper script 
Not needed anymore, since the frontend scripts just source the backend
script now.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22438>
 2023-04-15 01:55:12 +00:00
Michel Dänzer 1ec3c16c54 ci: Remove shebang from backend compiler wrapper script 
Not needed anymore, since the frontend scripts just source the backend
script now.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22438>
 2023-04-15 01:55:12 +00:00
Michel Dänzer 21b190bf44 ci: Use set -e in frontend compiler wrapper scripts. 
I doubt the shebang line in the backend script has any effect now,
since the frontend scripts just source it directly.

v2:
* Use "set -e" instead of adding -e to shebang (Eric Engestrom)

v3:
* Apply to the clang wrapper scripts as well (Eric Engestrom)

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22438>
 2023-04-15 01:55:12 +00:00
Michel Dänzer 1915185648 ci: Explicitly test for meson feature checks in compiler wrapper 
The previous indirect method was more complicated and still error prone.

v2:
* Use "grep -E" (Eric Engestrom)
* Exclude spaces and slashes in the grep pattern, to avoid accidentally
  matching across unrelated compiler arguments.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22438>
 2023-04-15 01:55:12 +00:00
Eric Engestrom 6af78baa23 ci: update shebang to make it more portable 
Doesn't matter for now, but it doesn't cost anything to make it portable :)

Suggested-by: David Heidelberg <david.heidelberg@collabora.com>
Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Eric Engestrom 9120f17b27 ci: bump tags 
Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Eric Engestrom 8eb5de3126 ci: start documenting which image tags need to be bumped 
Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Eric Engestrom 9a45d3ee13 ci: move deqp-egl instead of copying it 
To make sure we can't accidentally run a random leftover platform.

Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Eric Engestrom efd2067a8f ci: add -android suffix for android build of deqp-egl 
Makes it clearer which platform is being run.

Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Eric Engestrom e876a018e9 ci: stop removing -x11 suffix for x11 build of deqp-egl 
Makes it clearer which platform is being run.

Signed-off-by: Eric Engestrom <eric@igalia.com>
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22450>
 2023-04-14 11:28:21 +00:00
Giancarlo Devich cc6d87b462 d3d12: Update and require DirectX-Headers 1.610.0 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22454>
 2023-04-14 03:19:22 +00:00
Eric Engestrom 1a9727a81e ci/rustfmt: make sure to only check each file once 
rustfmt has some magic that follows files (I'm guessing), making files get
checked multiple times with `*.rs`, so let's limit ourselves to `lib.rs`.

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22321>
 2023-04-13 05:56:53 +00:00
Tatsuyuki Ishi 36fd2bbd98 ci/android: Make armv8's arch aarch64 instead of arm. 
Per [1], arm is for 32-bit.

For an upcoming change, we need to detect AArch64 specifically.
Specifying arm in the cross file will result in the wrong build script
behavior.

[1]: https://mesonbuild.com/Reference-tables.html#cpu-families

Reviewed-by: Helen Koike <helen.koike@collabora.com>
Reviewed-by: Emma Anholt <emma@anholt.net>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22418>
 2023-04-13 04:28:29 +00:00
Collabora's Gfx CI Team be5db62f88 Uprev Piglit to 355ad6bcb2cb3d9e030b7c6eef2b076b0dfb4d63 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22325>
 2023-04-12 08:04:55 +00:00
Alyssa Rosenzweig 7582752233 ci: Run clang-format on panfrost 
So we don't regress formatting in the future. This should never really trigger
if people configure their editors correctly, but it can help avoid regressing
the formatting from drive-by patches.

Signed-off-by: Alyssa Rosenzweig <alyssa@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22372>
 2023-04-10 21:56:04 +00:00
Jesse Natalie 767c5425da CI/windows: Increase timeout for build container job 
These jobs can take upwards of 40 minutes just to upload
the built container images...

Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22320>
 2023-04-06 09:14:22 +00:00
Jesse Natalie 24fce05f3f CI/windows: Update headers and Agility redist to 1.710.0-preview 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22320>
 2023-04-06 09:14:22 +00:00
David Heidelberg e261e46c09 ci: implement sections for cuttlefish 
Reviewed-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22005>
 2023-04-05 16:26:20 +00:00
Erik Faye-Lund 1b7a4029d0 virgl/ci: clean up manual rules for virgl 
In f6c06ef2f6 ("ci: Add manual rules variations to disable irrelevant
driver jobs."), we fixed this for *most* driver. This fixes up the last
driver, hopefully removing an annoying needless button in the UI for
some MRs.

Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Eric Engestrom <eric@igalia.com>
Acked-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22263>
 2023-04-04 23:49:53 +00:00
Erik Faye-Lund 67750f138b ci: move virgl-rules after intel-rules 
We're about to add a dependency on stuff from the intel-rules, and
moving virgl down here allows us to depend on them without having to
move the definition out of the intel-section.

Reviewed-by: Emma Anholt <emma@anholt.net>
Reviewed-by: Eric Engestrom <eric@igalia.com>
Acked-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22263>
 2023-04-04 23:49:53 +00:00
Collabora's Gfx CI Team 91b06ea8b2 Uprev Piglit to 2391a83d1639a7ab7bbea02853b922878687b0e5 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22279>
 2023-04-04 15:37:14 +00:00
Corentin Noël 1eaea97f3a venus/ci: Only run one crosvm instance 
As venus now has separate render server processes it is better to use a single
crosvm instance to run all the tests.

Signed-off-by: Corentin Noël <corentin.noel@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21693>
 2023-03-31 12:39:49 +00:00
Corentin Noël c08c2a0963 ci: Uprev crosvm and virglrenderer 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21693>
 2023-03-31 12:39:49 +00:00
Guilherme Gallo a5de0174af ci/zink: Fix zink-tu-a618-traces perf job rules 
The pipeline should create this job only when it is under performance
enabled workflow, represented by the presence of
MESA_CI_PERFORMANCE_ENABLED variable.

For example:
The following pipeline
https://gitlab.freedesktop.org/gallo/mesa/-/pipelines/840525 has
`zink-tu-a618-traces-performance` job, even if it was not triggered by
marge-bot, which means that performance jobs should be disabled.

This job should appear in pipelines with performance jobs enabled
https://gitlab.freedesktop.org/gallo/mesa/-/pipelines/840529

Fixes: 93e3d37b47
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22155>
 2023-03-29 21:30:19 +00:00
Guilherme Gallo 38074e8d6d ci/zink: Add zink-turnip-manual-rules 
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
Guilherme Gallo 93e3d37b47 ci: Add piglit traces hidden jobs 
To better organize traces and traces-performance jobs that uses piglit
to replay traces.

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
David Heidelberg 4286e559cc ci: remove deqp from lava piglit and traces runs 
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
David Heidelberg bc5a48d48b ci: create lava-test without deqp HWCI_TEST_SCRIPT 
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
David Heidelberg 2314a0d59b ci: rename .lava-test to .lava-test-deqp to describe it correctly 
.lava-test hidden job was setting the HWCI_TEST_SCRIPT variable to deqp
runner. But that is not always the case. When we run piglit traces jobs,
we use piglit-traces.sh instead, for example.

Splitting into:
- .lava-test-deqp (deqp-runner + deqp)
- .lava-traces (deqp-runner + piglit)
- .lava-piglit (piglit-runner + piglit)

Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Co-authored-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
Guilherme Gallo 8e5c33f8a2 ci: Fix freedreno-rules-performance 
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
Guilherme Gallo 2112d8b1f2 ci: Improve piglit-traces "no-perf" filter 
We filter out traces that work only in standard replay mode but not
profile one via yq (jq for YAML) manipulation.

The previous query needed to be fixed in some scenarios, such as traces
labeled with only `["no-perf"]`, which was being ignored by the query.

This commit updates the yq query with newer syntax to cover all current
cases (at least for freedreno).

Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065>
 2023-03-24 21:58:22 +00:00
David Heidelberg 781c088d92 ci: bump Alpine to 3.17 (again) 
Now with fixed ccache 4.7.5.

`ccache` changelog:
Disabled the inode cache by default again since there have reports of ccache
processes hanging on futex calls related to the inode cache.

Signed-off-by: David Heidelberg <david.heidelberg@collabora.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22037>
 2023-03-23 11:19:56 +00:00
Jesse Natalie 24d5bdbb6e ci/windows: Update warp to 1.0.5 
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22034>
 2023-03-23 07:07:29 +00:00