Snapshot for 20240528, v19.0.0, 1de1ee9 (big-merge)

Question

Snapshot for 20240528, v19.0.0, 1de1ee9 (big-merge)

Closed this issue 6 months ago · 12 comments

Hello @kwk!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ 1de1ee9) snapshot for 20240528.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis: For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels: Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, arch/x86_64, os/fedora-rawhide, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-05-30T23:19:51.104082

Build Matrix

	llvm
fedora-39-aarch64 ✅ tests passed	✅
fedora-39-i386 ❌ Copr build(s) failed	❌
fedora-39-ppc64le ❌ Copr build(s) failed	❌
fedora-39-s390x ❌ Copr build(s) failed	❌
fedora-39-x86_64 ✅ tests passed	✅
fedora-40-aarch64 ✅ tests passed	✅
fedora-40-i386 ❌ Copr build(s) failed	❌
fedora-40-ppc64le ❌ Copr build(s) failed	❌
fedora-40-s390x ❌ Copr build(s) failed	❌
fedora-40-x86_64 ✅ tests passed	✅
fedora-rawhide-aarch64 ✅ tests passed	✅
fedora-rawhide-i386 ❌ Copr build(s) failed	❌
fedora-rawhide-ppc64le ❌ Copr build(s) failed	❌
fedora-rawhide-s390x ❌ Copr build(s) failed	❌
fedora-rawhide-x86_64 ✅ tests passed	✅
rhel-9-aarch64 ✅ tests passed 🔒	✅
rhel-9-s390x ❌ Copr build(s) failed	❌
rhel-9-x86_64 ✅ tests passed 🔒	✅

Build status legend

⭕ : canceled
❌ : failed
☑️ : forked
📥 : importing
🔜 : pending
🏃 : running
🚫 : skipped
⭐ : starting
✅ : succeeded
⌛ : waiting
❔ : unknown
⚠️ : pipeline error (only relevant to testing-farm)

Answer 1 · 2024-05-28T07:20:55.000Z

Errors found in Copr builds on `fedora-39-ppc64le`

rpm__directory_not_found

llvm on fedora-39-ppc64le (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.ppc64le/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm
INFO: chroot_scan: 3 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-39-ppc64le-1716860880.379242/root/var/log/dnf.log
/var/lib/mock/fedora-39-ppc64le-1716860880.379242/root/var/log/dnf.librepo.log
/var/lib/mock/fedora-39-ppc64le-1716860880.379242/root/var/log/dnf.rpm.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm) Config(fedora-39-ppc64le) 294 minutes 10 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 2 · 2024-05-28T07:20:58.000Z

Errors found in Copr builds on `fedora-40-ppc64le`

rpm__directory_not_found

llvm on fedora-40-ppc64le (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.ppc64le/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm
INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-40-ppc64le-1716860881.463945/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm) Config(fedora-40-ppc64le) 293 minutes 53 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 3 · 2024-05-28T09:23:14.000Z

Errors found in Copr builds on `fedora-39-i386`

unknown

llvm on fedora-39-i386 (see build log, contribute to log-detective)

Build log tail

Sometimes the end of the build log contains useful information.

ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm) Config(fedora-39-i686) 398 minutes 25 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish: clean chroot
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M 859970719b0f4d14b12da5cfd1be066d -D /var/lib/mock/fedora-39-i686-1716860810.346640/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.jp0ehvoa:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007"' '--setenv=PS1=<mock-chroot> \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb  --target i686 --nodeps /builddir/build/originals/llvm.spec'

Copr build error: Build failed

RPM build errors

If we have found RPM build errors in the log file, you'll find them here.

Errors to look into

If we have found the term error: (case insentitive) in the build log,
you'll find all occurrences here together with the preceding lines.

Processing files: compiler-rt-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.i686
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.i386/usr/lib/clang/19/bin/hwasan_symbolize
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/libclang_rt.*
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtbegin.o
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtend.o
--
/var/lib/mock/fedora-39-i686-1716860810.346640/root/var/log/dnf.rpm.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm) Config(fedora-39-i686) 398 minutes 25 seconds
--
Finish: clean chroot
ERROR: Command failed: 
--

Copr build error: Build failed

Answer 4 · 2024-05-28T09:23:18.000Z

Errors found in Copr builds on `fedora-40-i386`

unknown

llvm on fedora-40-i386 (see build log, contribute to log-detective)

Build log tail

Sometimes the end of the build log contains useful information.

ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm) Config(fedora-40-i686) 412 minutes 22 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish: clean chroot
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M b54f6d969b244ff0bf8d71dfedfe710f -D /var/lib/mock/fedora-40-i686-1716860833.891757/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.8lgqqq8a:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007"' '--setenv=PS1=<mock-chroot> \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb  --target i686 --nodeps /builddir/build/originals/llvm.spec'

Copr build error: Build failed

RPM build errors

If we have found RPM build errors in the log file, you'll find them here.

Errors to look into

If we have found the term error: (case insentitive) in the build log,
you'll find all occurrences here together with the preceding lines.

Processing files: compiler-rt-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.i686
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.i386/usr/lib/clang/19/bin/hwasan_symbolize
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/libclang_rt.*
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtbegin.o
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtend.o
--
INFO: /var/lib/mock/fedora-40-i686-1716860833.891757/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm) Config(fedora-40-i686) 412 minutes 22 seconds
--
Finish: clean chroot
ERROR: Command failed: 
--

Copr build error: Build failed

Answer 5 · 2024-05-28T09:23:22.000Z

Errors found in Copr builds on `fedora-rawhide-i386`

unknown

llvm on fedora-rawhide-i386 (see build log, contribute to log-detective)

Build log tail

Sometimes the end of the build log contains useful information.

ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm) Config(fedora-rawhide-i686) 406 minutes 54 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish: clean chroot
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M 2a64c21afb164ace9956e023711afa64 -D /var/lib/mock/fedora-rawhide-i686-1716860833.593444/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.p_4b1g68:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007"' '--setenv=PS1=<mock-chroot> \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb  --target i686 --nodeps /builddir/build/originals/llvm.spec'

Copr build error: Build failed

RPM build errors

If we have found RPM build errors in the log file, you'll find them here.

Errors to look into

If we have found the term error: (case insentitive) in the build log,
you'll find all occurrences here together with the preceding lines.

Processing files: compiler-rt-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.i686
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.i386/usr/lib/clang/19/bin/hwasan_symbolize
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/libclang_rt.*
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtbegin.o
error: File not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.i386/usr/lib/clang/19/lib/i686-redhat-linux-gnu/clang_rt.crtend.o
--
INFO: /var/lib/mock/fedora-rawhide-i686-1716860833.593444/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm) Config(fedora-rawhide-i686) 406 minutes 54 seconds
--
Finish: clean chroot
ERROR: Command failed: 
--

Copr build error: Build failed

Answer 6 · 2024-05-28T10:23:06.000Z

Errors found in Copr builds on `fedora-rawhide-s390x`

rpm__directory_not_found

llvm on fedora-rawhide-s390x (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.s390x/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm
INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-rawhide-s390x-1716860898.527168/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm) Config(fedora-rawhide-s390x) 494 minutes 28 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 7 · 2024-05-28T11:19:04.000Z

Errors found in Copr builds on `fedora-39-s390x`

rpm__directory_not_found

llvm on fedora-39-s390x (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.s390x/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm
INFO: chroot_scan: 3 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-39-s390x-1716860851.801031/root/var/log/dnf.log
/var/lib/mock/fedora-39-s390x-1716860851.801031/root/var/log/dnf.librepo.log
/var/lib/mock/fedora-39-s390x-1716860851.801031/root/var/log/dnf.rpm.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc39.src.rpm) Config(fedora-39-s390x) 553 minutes 9 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 8 · 2024-05-28T12:35:52.000Z

Errors found in Copr builds on `rhel-9-s390x`

rpm__directory_not_found

llvm on rhel-9-s390x (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.el9.s390x/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.el9.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.el9.src.rpm
INFO: chroot_scan: 3 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/rhel-9-s390x-1716860856.643862/root/var/log/dnf.log
/var/lib/mock/rhel-9-s390x-1716860856.643862/root/var/log/dnf.librepo.log
/var/lib/mock/rhel-9-s390x-1716860856.643862/root/var/log/dnf.rpm.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.el9.src.rpm) Config(rhel-9-s390x) 633 minutes 22 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 9 · 2024-05-28T12:45:59.000Z

/retest rhel-9-x86_64

Answer 10 · 2024-05-28T13:21:35.000Z

Errors found in Copr builds on `fedora-40-s390x`

rpm__directory_not_found

llvm on fedora-40-s390x (see build log, contribute to log-detective)

RPM build errors:
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.s390x/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm
INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-40-s390x-1716860877.620153/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc40.src.rpm) Config(fedora-40-s390x) 675 minutes 3 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 11 · 2024-05-28T15:24:17.000Z

Errors found in Copr builds on `fedora-rawhide-ppc64le`

rpm__directory_not_found

llvm on fedora-rawhide-ppc64le (see build log, contribute to log-detective)

RPM build errors:
++ jobs -p
+ exit 0
    Directory not found: /builddir/build/BUILDROOT/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.ppc64le/usr/lib/clang/19/bin
Finish: rpmbuild llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm
Finish: build phase for llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm
INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
INFO: /var/lib/mock/fedora-rawhide-ppc64le-1716860855.246197/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240528.g1de1ee9cbabd64-1.fc41.src.rpm) Config(fedora-rawhide-ppc64le) 797 minutes 15 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish

Answer 12 · 2024-05-29T09:27:29.000Z

Fixes: https://src.fedoraproject.org/rpms/llvm/pull-request/219, https://src.fedoraproject.org/rpms/llvm/pull-request/220, and Tulio built the LLVM 17 compat packages for RHEL.

Errors found in Copr builds on fedora-39-ppc64le

Errors found in Copr builds on fedora-40-ppc64le

Errors found in Copr builds on fedora-39-i386

Build log tail

RPM build errors

Errors to look into

Errors found in Copr builds on fedora-40-i386

Build log tail

RPM build errors

Errors to look into

Errors found in Copr builds on fedora-rawhide-i386

Build log tail

RPM build errors

Errors to look into

Errors found in Copr builds on fedora-rawhide-s390x

Errors found in Copr builds on fedora-39-s390x

Errors found in Copr builds on rhel-9-s390x

Errors found in Copr builds on fedora-40-s390x

Errors found in Copr builds on fedora-rawhide-ppc64le

Errors found in Copr builds on `fedora-39-ppc64le`

Errors found in Copr builds on `fedora-40-ppc64le`

Errors found in Copr builds on `fedora-39-i386`

Errors found in Copr builds on `fedora-40-i386`

Errors found in Copr builds on `fedora-rawhide-i386`

Errors found in Copr builds on `fedora-rawhide-s390x`

Errors found in Copr builds on `fedora-39-s390x`

Errors found in Copr builds on `rhel-9-s390x`

Errors found in Copr builds on `fedora-40-s390x`

Errors found in Copr builds on `fedora-rawhide-ppc64le`