NixOS/ofborg

ofborg-eval-lib-tests sometimes fails at coreutils tests/du/basic

Artturin opened this issue · 2 comments

FAIL: tests/du/basic
====================

--- exp 2021-11-04 18:31:28.992008206 +0000
+++ out 2021-11-04 18:31:28.953008138 +0000
@@ -1,7 +1,7 @@
 1      d/sub/2
 2      d/sub
-9      d/1
-12     d
+1      d/1
+4      d
 ===
 2      d/sub
-10     d
+2      d
FAIL tests/du/basic.sh (exit status: 1)
nix build -f ./lib/tests/release.nix
nix-instantiate --eval --strict --show-trace ./maintainers/scripts/eval-release.nix
nix-build ./nixos/release-combined.nix -A nixos.iso_minimal.x86_64-linux

all three work locally on zfs

NixOS/nixpkgs#142602 (comment)
https://github.com/NixOS/nixpkgs/labels/10.rebuild-linux-stdenv

bit of discussion on matrix: https://matrix.to/#/!kjdutkOsheZdjqYmqp:nixos.org/$8mBL2zwaDHuYqbdKjZprIt5X-xjSxwbd9pXgqpum7lg?via=nixos.org&via=matrix.org&via=nixos.dev

The fact that 1) I was able to build it successfully on a machine that it previously failed on; 2) you and I both can build it locally; and 3) it will succeed eventually, after telling ofborg to re-evaluate the PR, leads be me to believe that this test is flaky somehow.

EDIT: Also note that the ofborg evaluators don't have compression enabled at all, so that can't be an issue.