Snapshot for 20240606, v19.0.0, a9342f2 (big-merge)

Question

Snapshot for 20240606, v19.0.0, a9342f2 (big-merge)

Closed this issue 6 months ago · 6 comments

Hello @kwk!

This issue exists to let you know that we are about to monitor the builds of the LLVM (v19.0.0, llvm/llvm-project@ a9342f2) snapshot for 20240606.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.

Log analysis: For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'rpm__file_not_found', 'cmake_error', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels: Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, build_failed_on/fedora-rawhide-x86_64, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-06-08T23:20:37.382406

Build Matrix

	llvm
fedora-39-aarch64 ✅ tests passed	✅
fedora-39-i386	✅
fedora-39-ppc64le ✅ tests passed 🔒	✅
fedora-39-s390x ❌ Copr build(s) failed	❌
fedora-39-x86_64 ✅ tests passed	✅
fedora-40-aarch64 ✅ tests passed	✅
fedora-40-i386	✅
fedora-40-ppc64le ❌ Copr build(s) failed	❌
fedora-40-s390x ❌ Copr build(s) failed	❌
fedora-40-x86_64 ✅ tests passed	✅
fedora-rawhide-aarch64 ✅ tests passed	✅
fedora-rawhide-i386	✅
fedora-rawhide-ppc64le ⚠️ pipeline error	✅
fedora-rawhide-s390x ❌ Copr build(s) failed	❌
fedora-rawhide-x86_64 ✅ tests passed	✅
rhel-9-aarch64 ✅ tests passed 🔒	✅
rhel-9-s390x ❌ Copr build(s) failed	❌
rhel-9-x86_64 ✅ tests passed 🔒	✅

Build status legend

⭕ : canceled
❌ : failed
☑️ : forked
📥 : importing
🔜 : pending
🏃 : running
🚫 : skipped
⭐ : starting
✅ : succeeded
⌛ : waiting
❔ : unknown
⚠️ : pipeline error (only relevant to testing-farm)

Answer 1 · 2024-06-06T02:33:37.000Z

Errors found in Copr builds on `fedora-40-ppc64le`

network_issue

llvm on fedora-40-ppc64le (see build log, contribute to log-detective)

Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':

Answer 2 · 2024-06-06T02:33:39.000Z

Errors found in Copr builds on `fedora-40-s390x`

network_issue

llvm on fedora-40-s390x (see build log, contribute to log-detective)

Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':
Errors during downloading metadata for repository 'updates':

Answer 3 · 2024-06-06T10:22:38.000Z

Errors found in Copr builds on `fedora-rawhide-s390x`

unknown

llvm on fedora-rawhide-s390x (see build log, contribute to log-detective)

Build log tail

Sometimes the end of the build log contains useful information.

ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240606.ga9342f2eab7993-1.fc41.src.rpm) Config(fedora-rawhide-s390x) 500 minutes 29 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish: clean chroot
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M d6151e838eba4a8e8bcf9e9ce04fe052 -D /var/lib/mock/fedora-rawhide-s390x-1717638599.909989/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.pzy_b7p9:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007"' '--setenv=PS1=<mock-chroot> \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb  --target s390x --nodeps /builddir/build/originals/llvm.spec'

Copr build error: Build failed

RPM build errors

If we have found RPM build errors in the log file, you'll find them here.

Errors to look into

If we have found the term error: (case insentitive) in the build log,
you'll find all occurrences here together with the preceding lines.

Jun 06 10:08:57 + /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/FileCheck --input-file /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll --check-prefix=ERR
Jun 06 10:08:57 /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll:32:8: error: ERR: expected string not found in input
--
Jun 06 10:08:57 /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt:1:1: note: scanning from here
Jun 06 10:08:57 /usr/bin/ld.gold: fatal error: Invalid time trace granularity: 
--
Jun 06 10:08:57 /builddir/build/BUILD/llvm-19.0.0~pre20240606.ga9342f2eab7993-build/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt:1:32: note: possible intended match here
Jun 06 10:08:57 /usr/bin/ld.gold: fatal error: Invalid time trace granularity: 
--
Jun 06 10:08:57 <<<<<<
Jun 06 10:08:57             1: /usr/bin/ld.gold: fatal error: Invalid time trace granularity:  
Jun 06 10:08:57 check:32'0     X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
--
Jun 06 10:11:46 
error: Bad exit status from /var/tmp/rpm-tmp.ihOV1f (%check)
--
INFO: /var/lib/mock/fedora-rawhide-s390x-1717638599.909989/root/var/log/dnf5.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240606.ga9342f2eab7993-1.fc41.src.rpm) Config(fedora-rawhide-s390x) 500 minutes 29 seconds
--
Finish: clean chroot
ERROR: Command failed: 
--

Copr build error: Build failed

Answer 4 · 2024-06-06T10:22:40.000Z

Errors found in Copr builds on `rhel-9-s390x`

test

llvm on rhel-9-s390x (see build log, contribute to log-detective)

TEST 'LLVM :: tools/gold/X86/time-trace.ll' FAILED

******************** TEST 'LLVM :: tools/gold/X86/time-trace.ll' FAILED ********************
Exit Code: 1

Command Output (stderr):
--
RUN: at line 1: /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/llvm-as /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll -o /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp.o
+ /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/llvm-as /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll -o /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp.o
RUN: at line 3: /usr/bin/ld.gold -plugin /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/lib64/LLVMgold.so     -m elf_x86_64 --plugin-opt=time-trace=/builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp2.json     -shared /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp.o -o /dev/null
+ /usr/bin/ld.gold -plugin /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/lib64/LLVMgold.so -m elf_x86_64 --plugin-opt=time-trace=/builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp2.json -shared /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp.o -o /dev/null
RUN: at line 6: /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/FileCheck --input-file /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp2.json /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll
+ /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/FileCheck --input-file /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp2.json /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll
RUN: at line 8: /usr/bin/ld.gold -plugin /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/lib64/LLVMgold.so     -m elf_x86_64 --plugin-opt=time-trace=/builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070

Answer 5 · 2024-06-06T11:20:17.000Z

Errors found in Copr builds on `fedora-39-s390x`

unknown

llvm on fedora-39-s390x (see build log, contribute to log-detective)

Build log tail

Sometimes the end of the build log contains useful information.

ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240606.ga9342f2eab7993-1.fc39.src.rpm) Config(fedora-39-s390x) 534 minutes 1 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
INFO: unmounting tmpfs.
Finish: clean chroot
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M da10e6c8e18548a1bfa050919d37ff6d -D /var/lib/mock/fedora-39-s390x-1717638516.921211/root -a -u mockbuild --capability=cap_ipc_lock --rlimit=RLIMIT_NOFILE=10240 --capability=cap_ipc_lock --bind=/tmp/mock-resolv.85y7s2_z:/etc/resolv.conf --bind=/dev/btrfs-control --bind=/dev/mapper/control --bind=/dev/fuse --bind=/dev/loop-control --bind=/dev/loop0 --bind=/dev/loop1 --bind=/dev/loop2 --bind=/dev/loop3 --bind=/dev/loop4 --bind=/dev/loop5 --bind=/dev/loop6 --bind=/dev/loop7 --bind=/dev/loop8 --bind=/dev/loop9 --bind=/dev/loop10 --bind=/dev/loop11 --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/builddir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin '--setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007"' '--setenv=PS1=<mock-chroot> \s-\v\$ ' --setenv=LANG=C.UTF-8 --resolv-conf=off bash --login -c '/usr/bin/rpmbuild -bb  --target s390x --nodeps /builddir/build/originals/llvm.spec'

Copr build error: Build failed

RPM build errors

If we have found RPM build errors in the log file, you'll find them here.

Errors to look into

If we have found the term error: (case insentitive) in the build log,
you'll find all occurrences here together with the preceding lines.

Jun 06 10:42:48 + /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/bin/FileCheck --input-file /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll --check-prefix=ERR
Jun 06 10:42:48 /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/test/tools/gold/X86/time-trace.ll:32:8: error: ERR: expected string not found in input
--
Jun 06 10:42:48 /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt:1:1: note: scanning from here
Jun 06 10:42:48 /usr/bin/ld.gold: fatal error: Invalid time trace granularity: 
--
Jun 06 10:42:48 /builddir/build/BUILD/llvm-project-a9342f2eab7993a3be1d1156070c0d2de21ed973/llvm/redhat-linux-build/test/tools/gold/X86/Output/time-trace.ll.tmp4.txt:1:32: note: possible intended match here
Jun 06 10:42:48 /usr/bin/ld.gold: fatal error: Invalid time trace granularity: 
--
Jun 06 10:42:48 <<<<<<
Jun 06 10:42:48             1: /usr/bin/ld.gold: fatal error: Invalid time trace granularity:  
Jun 06 10:42:48 check:32'0     X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
--
Jun 06 10:45:32 
error: Bad exit status from /var/tmp/rpm-tmp.DThNHD (%check)
--
/var/lib/mock/fedora-39-s390x-1717638516.921211/root/var/log/dnf.rpm.log
ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-19.0.0~pre20240606.ga9342f2eab7993-1.fc39.src.rpm) Config(fedora-39-s390x) 534 minutes 1 seconds
--
Finish: clean chroot
ERROR: Command failed: 
--

Copr build error: Build failed

Answer 6 · 2024-06-08T00:23:14.000Z

Duplicate of #542.

Errors found in Copr builds on fedora-40-ppc64le

Errors found in Copr builds on fedora-40-s390x

Errors found in Copr builds on fedora-rawhide-s390x

Build log tail

RPM build errors

Errors to look into

Errors found in Copr builds on rhel-9-s390x

Errors found in Copr builds on fedora-39-s390x

Build log tail

RPM build errors

Errors to look into

Errors found in Copr builds on `fedora-40-ppc64le`

Errors found in Copr builds on `fedora-40-s390x`

Errors found in Copr builds on `fedora-rawhide-s390x`

Errors found in Copr builds on `rhel-9-s390x`

Errors found in Copr builds on `fedora-39-s390x`