nodejs/reliability

CI Reliability 2024-05-02

github-actions opened this issue · 0 comments

Failures in node-test-pull-request/58751 to node-test-pull-request/58844 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-05-02 00:08 10 1 23 10 56 1.25%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52714/, https://github.com/nodejs/node/pull/52751/)
Appeared test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58800/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58809/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure

Build Failure

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52713/, https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52674/, https://github.com/nodejs/node/pull/52727/, https://github.com/nodejs/node/pull/52627/, https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52744/, https://github.com/nodejs/node/pull/52587/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58758/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58835/
Example
error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
MSBUILD : error : This is an unhandled exception in MSBuild -- PLEASE UPVOTE AN EXISTING ISSUE OR FILE A NEW ONE AT https://aka.ms/msbuild/unhandled [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\mksnapshot_host.vcxproj]
MSBUILD : error :     System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown. [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\mksnapshot_host.vcxproj]
MSBUILD : error :    at Go9(RegexRunner ) [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\mksnapshot_host.vcxproj]
MSBUILD : error :    at System.Text.RegularExpressions.RegexRunner.Scan(Regex regex, String text, Int32 textbeg, Int32 textend, Int32 textstart, Int32 prevlen, Boolean quick, TimeSpan timeout) [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\mksnapshot_host.vcxproj]

Reason ERROR: No files found with the specified search criteria.
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52719/, https://github.com/nodejs/node/pull/52714/, https://github.com/nodejs/node/pull/52751/, https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52706/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/58754/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58817/
Example
ERROR: No files found with the specified search criteria.
        1 file(s) copied.

> set DEBUG_HELPER=1 

> call vcbuild.bat arm64 release msi

Reason Failed to trigger sub builds
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51575/, https://github.com/nodejs/node/pull/52583/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/58783/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58811/
Example
Failed to trigger sub builds

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52751/, https://github.com/nodejs/node/pull/52545/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/58806/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58807/
Example
fatal: No rebase in progress?

CCTest Failure

JSTest Failure

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52657/, https://github.com/nodejs/node/pull/52739/, https://github.com/nodejs/node/pull/52728/, https://github.com/nodejs/node/pull/52347/, https://github.com/nodejs/node/pull/52747/, https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52763/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-digitalocean-fedora37-x64-1, test-equinix-rhel8_container-arm64-1, test-ibm-rhel9-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-debian12-x64-1, test-rackspace-debian11-x64-1, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58760/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58834/
Example
not ok 4013 benchmark/test-benchmark-crypto
  ---
  duration_ms: 10483.62700
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9
        at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: 0,
      operator: 'strictEqual'
    }
    
    Node.js v23.0.0-pre
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test...

Reason parallel/test-error-serdes
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52372/, https://github.com/nodejs/node/pull/52713/, https://github.com/nodejs/node/pull/52714/, https://github.com/nodejs/node/pull/52728/, https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52730/, https://github.com/nodejs/node/pull/52727/)
Appeared test-rackspace-win2022_vs2022-x64-3, test-equinix-ubuntu2004_container-arm64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-5, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-rackspace-win2022_vs2022-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2019_vs2019-x64-4, test-macstadium-macos11.0-arm64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9
First CI https://ci.nodejs.org/job/node-test-pull-request/58751/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58788/
Example
not ok 942 parallel/test-error-serdes
  ---
  duration_ms: 120217.64000
  severity: fail
  exitcode: 1
  stack: |-
    timeout
  ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52719/, https://github.com/nodejs/node/pull/52692/, https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52747/, https://github.com/nodejs/node/pull/52767/, https://github.com/nodejs/node/pull/52609/, https://github.com/nodejs/node/pull/52763/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-ibm-ubi81_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-ibm-rhel8-x64-2, test-azure_msft-win10_vs2019-x64-2, test-ibm-alpine319_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58754/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58831/
Example
not ok 3074 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120085.65800
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Reason parallel/test-macos-app-sandbox
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52714/, https://github.com/nodejs/node/pull/52674/, https://github.com/nodejs/node/pull/52727/, https://github.com/nodejs/node/pull/52728/, https://github.com/nodejs/node/pull/52730/, https://github.com/nodejs/node/pull/52047/)
Appeared test-orka-macos11-x64-1, test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58770/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58792/
Example
not ok 1904 parallel/test-macos-app-sandbox
  ---
  duration_ms: 6418.62000
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-macos-app-sandbox.js:47:8)
        at Module._compile (node:internal/modules/cjs/loader:1480:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1564:10)
        at Module.load (node:internal/modules/cjs/loader:1287:32)
        at Module._load (node:internal/modules/cjs/loader:1103:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:168:12)
        at node:internal/main/run_main_module:30:49 {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: 0,
      operator: 'strictEqual'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52329/, https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52763/, https://github.com/nodejs/node/pull/52768/)
Appeared test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58759/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58844/
Example
not ok 3954 parallel/test-net-write-fully-async-buffer
  ---
  duration_ms: 360100.35100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52747/, https://github.com/nodejs/node/pull/52763/, https://github.com/nodejs/node/pull/52768/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/58796/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58832/
Example
not ok 2437 parallel/test-performance-function
  ---
  duration_ms: 409.53800
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1095
      process.nextTick(() => { throw err; });
                               ^
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v22.1.0
  ...


Reason pummel/test-crypto-timing-safe-equal-benchmarks
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52719/, https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52674/)
Appeared test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58765/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58772/
Example
not ok 3781 pummel/test-crypto-timing-safe-equal-benchmarks
  ---
  duration_ms: 1659.01300
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: timingSafeEqual should not leak information from its execution time (t=-4.802924630409026)
        at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/pummel/test-crypto-timing-safe-equal-benchmarks.js:109:1)
        at Module._compile (node:internal/modules/cjs/loader:1476:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1555:10)
        at Module.load (node:internal/modules/cjs/loader:1288:32)
        at Module._load (node:internal/modules/cjs/loader:1104:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:191:14)
        at node:internal/main/run_main_module:30:49 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '...

Reason pummel/test-fs-readfile-tostring-fail
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52719/, https://github.com/nodejs/node/pull/52723/, https://github.com/nodejs/node/pull/52714/)
Appeared test-orka-macos11-x64-1, test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58754/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58770/
Example
not ok 3785 pummel/test-fs-readfile-tostring-fail
  ---
  duration_ms: 192.72000
  severity: fail
  exitcode: 7
  stack: |-
    /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:77
      throw err;
      ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOSPC: no space left on device, write
        at Object.callback (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:35:37)
        at callback (node:internal/streams/writable:757:21)
        at onwriteError (node:internal/streams/writable:597:3)
        at onwrite (node:internal/streams/writable:640:7)
        at node:internal/fs/streams:513:5
        at node:internal/fs/streams:455:14
        at FSReqCallback.wrapper [as oncomplete] (node:fs:952:5) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOSPC: no space left on device, write] {
        errno: -28,
        code: 'ENOSPC'...

Reason sequential/test-single-executable-application-empty
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52727/, https://github.com/nodejs/node/pull/52728/, https://github.com/nodejs/node/pull/52730/)
Appeared test-orka-macos11-x64-1, test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58773/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58784/
Example
not ok 4146 sequential/test-single-executable-application-empty
  ---
  duration_ms: 18459.09700
  severity: fail
  exitcode: 1
  stack: |-
    Copied /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/out/Release/node to /Users/iojs/node-tmp/.tmp.4145/sea
    Injected /Users/iojs/node-tmp/.tmp.4145/sea-prep.blob into /Users/iojs/node-tmp/.tmp.4145/sea
    [process 34032]: --- stderr ---
    error: /Library/Developer/CommandLineTools/usr/bin/codesign_allocate: can't write output file: /Users/iojs/node-tmp/.tmp.4145/sea.cstemp (No space left on device)
    /Users/iojs/node-tmp/.tmp.4145/sea: the codesign_allocate helper tool cannot be found or used
    
    [process 34032]: --- stdout ---
    
    [process 34032]: status = 1, signal = null
    /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-single-executable-application-empty.js:53
      throw e;
      ^
    
    Error: Cannot sign /Users/iojs/node-tmp/.tmp.4145/sea: Error: - process terminated with status 1,...

Reason parallel/test-crypto-keygen-non-standard-public-exponent
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52347/, https://github.com/nodejs/node/pull/52744/)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-debian11_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58801/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58829/
Example
not ok 3805 parallel/test-crypto-keygen-non-standard-public-exponent
  ---
  duration_ms: 360028.98700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52747/, https://github.com/nodejs/node/pull/52763/)
Appeared test-equinix-rhel8_container-arm64-1, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58796/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58838/
Example
not ok 3875 parallel/test-file-write-stream4
  ---
  duration_ms: 360075.81700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52627/, https://github.com/nodejs/node/pull/52609/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/58802/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58827/
Example
not ok 2434 parallel/test-performance-eventlooputil
  ---
  duration_ms: 341.81800
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1095
      process.nextTick(() => { throw err; });
                               ^
    AssertionError [ERR_ASSERTION]: 131.10266304016113 < 131.10266305859375
        at Timeout.runCalcTest (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-eventlooputil.js:85:10)
        at Timeout.runCalcTest [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/common/index.js:469:15)
        at listOnTimeout (node:internal/timers:575:11)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52329/, https://github.com/nodejs/node/pull/52728/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-equinix-ubuntu2004_sharedlibs_container-arm64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/58775/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58787/
Example
not ok 3558 parallel/test-stream-readable-unpipe-resume
  ---
  duration_ms: 120101.95300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Progress

  • Build timed out (after 60 minutes). Marking the build as failed. (2)
  • error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] (8)
  • ERROR: No files found with the specified search criteria. (5)
  • Failed to trigger sub builds (2)
  • fatal: No rebase in progress? (2)
  • benchmark/test-benchmark-crypto (7)
  • parallel/test-error-serdes (7)
  • parallel/test-http2-large-write-multiple-requests (7)
  • parallel/test-macos-app-sandbox (6)
  • parallel/test-net-write-fully-async-buffer (5)
  • parallel/test-performance-function (3)
  • pummel/test-crypto-timing-safe-equal-benchmarks (3)
  • pummel/test-fs-readfile-tostring-fail (3)
  • sequential/test-single-executable-application-empty (3)
  • parallel/test-crypto-keygen-non-standard-public-exponent (2)
  • parallel/test-file-write-stream4 (2)
  • parallel/test-performance-eventlooputil (2)
  • parallel/test-stream-readable-unpipe-resume (2)