nodejs/build

github-bot broken?

richardlau opened this issue ยท 17 comments

I noticed that the bot reported starting a CI run in nodejs/node#52973 (comment) but no following comment linking to the Jenkins run nor statuses posted back to the PR. It looks like a Jenkins run was started: https://ci.nodejs.org/job/node-test-pull-request/59205/

post-build-status-update at first glance looks green, but clicking on the jobs and looking at the "Pipeline steps", e.g. https://ci.nodejs.org/job/post-build-status-update/2261443/flowGraphTable/, shows that the "httpRequest" step failed.
image

The console output can't find the build log, e.g.

java.io.FileNotFoundException: /var/lib/jenkins/jobs/post-build-status-update/builds/2261443/log (No such file or directory)
	at java.base/java.io.RandomAccessFile.open0(Native Method)
...

I'll see if I can find it on the Jenkins server (I think they get compressed there).

On ci:

root@infra-digitalocean-ubuntu14-x64-1:~# ls -al /var/lib/jenkins/jobs/post-build-status-update/builds/2261443
total 976
drwxr-xr-x   3 jenkins jenkins   4096 May 14 07:56 .
drwxr-xr-x 102 jenkins jenkins 933888 May 14 08:37 ..
-rw-r--r--   1 jenkins jenkins  35675 May 14 07:56 build.xml
-rw-r--r--   1 jenkins jenkins      0 May 14 07:56 changelog1986113076434187246.xml
-rw-r--r--   1 jenkins jenkins   6021 May 14 07:56 log.gz
-rw-r--r--   1 jenkins jenkins    102 May 14 07:56 log-index
drwxr-xr-x   2 jenkins jenkins   4096 May 14 07:56 workflow
root@infra-digitalocean-ubuntu14-x64-1:~#

From the uncompressed log:

[2024-05-14T11:56:22.706Z] Fetching upstream changes from https://github.com/nodejs/build.git
[2024-05-14T11:56:22.706Z]  > git --version # timeout=10
[2024-05-14T11:56:22.711Z]  > git --version # 'git version 2.34.1'
[2024-05-14T11:56:22.711Z]  > git fetch --tags --force --progress -- https://github.com/nodejs/build.git +refs/heads/*:refs/remotes/origin/* # timeout=10
[2024-05-14T11:56:23.047Z]  > git rev-parse origin/main^{commit} # timeout=10
[2024-05-14T11:56:23.258Z]  > git config core.sparsecheckout # timeout=10
[2024-05-14T11:56:23.264Z]  > git read-tree -mu HEAD # timeout=10
[2024-05-14T11:56:23.272Z]  > git checkout -f e2397a4d6638c7c644464be8ae219f8580ee6100 # timeout=10
[2024-05-14T11:56:23.963Z] HttpMethod: POST
[2024-05-14T11:56:23.963Z] URL: http://github-bot.nodejs.org:3333/node/jenkins/end
[2024-05-14T11:56:23.964Z] Content-Type: application/json; charset=UTF-8
[2024-05-14T11:56:23.995Z] Sending request to url: http://github-bot.nodejs.org:3333/node/jenkins/end
[2024-05-14T11:56:24.193Z] Treating class org.apache.http.conn.HttpHostConnectException(Connect to github-bot.nodejs.org:3333 [github-bot.nodejs.org/23.253.100.79] failed: Connection refused) as 408 Request Timeout

The bot isn't running -- on gh-bot:

root@infra-rackspace-debian8-x64-1:~# systemctl status github-bot
โ— github-bot.service - github-bot
   Loaded: loaded (/lib/systemd/system/github-bot.service; enabled)
   Active: activating (auto-restart) (Result: exit-code) since Tue 2024-05-14 13:00:13 UTC; 8s ago
  Process: 29335 ExecStart=/usr/bin/node server.js (code=exited, status=1/FAILURE)
 Main PID: 29335 (code=exited, status=1/FAILURE)

May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: code: 'MODULE_NOT_FOUND',
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: requireStack: [
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: '/home/iojs/github-bot/node_modules/path-scurry/dist/commonjs/index.js',
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: '/home/iojs/github-bot/node_modules/glob/dist/commonjs/glob.js',
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: '/home/iojs/github-bot/node_modules/glob/dist/commonjs/index.js',
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: '/home/iojs/github-bot/server.js'
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: ]
May 14 13:00:13 infra-rackspace-debian8-x64-1 node[29335]: }
May 14 13:00:13 infra-rackspace-debian8-x64-1 systemd[1]: github-bot.service: main process exited, code=exited, status=1/FAILURE
May 14 13:00:13 infra-rackspace-debian8-x64-1 systemd[1]: Unit github-bot.service entered failed state.
root@infra-rackspace-debian8-x64-1:~#

From journalctl

-- Logs begin at Tue 2024-05-14 10:38:04 UTC, end at Tue 2024-05-14 13:02:12 UTC. --
May 14 10:38:04 infra-rackspace-debian8-x64-1 systemd[1]: Stopping github-bot...
May 14 10:38:04 infra-rackspace-debian8-x64-1 systemd[1]: Starting github-bot...
May 14 10:38:04 infra-rackspace-debian8-x64-1 systemd[1]: Started github-bot.
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: internal/modules/cjs/loader.js:883
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: throw err;
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: ^
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: Error: Cannot find module 'node:path'
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: Require stack:
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: - /home/iojs/github-bot/node_modules/path-scurry/dist/commonjs/index.js
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: - /home/iojs/github-bot/node_modules/glob/dist/commonjs/glob.js
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: - /home/iojs/github-bot/node_modules/glob/dist/commonjs/index.js
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: - /home/iojs/github-bot/server.js
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Function.Module._resolveFilename (internal/modules/cjs/loader.js:880:15)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Function.Module._load (internal/modules/cjs/loader.js:725:27)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Module.require (internal/modules/cjs/loader.js:952:19)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at require (internal/modules/cjs/helpers.js:88:18)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Object.<anonymous> (/home/iojs/github-bot/node_modules/path-scurry/dist/commonjs/index.js:28:21)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Module._compile (internal/modules/cjs/loader.js:1063:30)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Object.Module._extensions..js (internal/modules/cjs/loader.js:1092:10)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Module.load (internal/modules/cjs/loader.js:928:32)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Function.Module._load (internal/modules/cjs/loader.js:769:14)
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: at Module.require (internal/modules/cjs/loader.js:952:19) {
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: code: 'MODULE_NOT_FOUND',
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: requireStack: [
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: '/home/iojs/github-bot/node_modules/path-scurry/dist/commonjs/index.js',
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: '/home/iojs/github-bot/node_modules/glob/dist/commonjs/glob.js',
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: '/home/iojs/github-bot/node_modules/glob/dist/commonjs/index.js',
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: '/home/iojs/github-bot/server.js'
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: ]
May 14 10:38:05 infra-rackspace-debian8-x64-1 node[14484]: }
May 14 10:38:05 infra-rackspace-debian8-x64-1 systemd[1]: github-bot.service: main process exited, code=exited, status=1/FAILURE
May 14 10:38:05 infra-rackspace-debian8-x64-1 systemd[1]: Unit github-bot.service entered failed state.

which is #3214 and the inability to update Node.js there until we update the OS all over again.

nodejs/github-bot@c5ba723

Landed 18 hours ago.

Can't we update Node.js to 14.21.3 (the last 14.x version), or at least 14.18? isaacs/node-glob@57f5551

Trott commented

Oof, sorry I did this with that glob update. That sure seemed safe.... ๐Ÿฅด

Trott commented

If upgrading to Node.js 14.18 or later is trouble, and even if it's not, a quick fix would be to revert the glob update.

Trott commented

If upgrading to Node.js 14.18 or later is trouble, and even if it's not, a quick fix would be to revert the glob update.

Oops, probably not because the bot will still install the latest glob and this was introduced in a patch release. I'll open a PR to pin glob instead, which isn't great, but will fix things if the Node.js upgrade isn't something that can happen quickly.

Trott commented

nodejs/github-bot#511 for a temporary workaround

FWIW apt update offers no update or newer verson of Node.js 14.

Trott commented

Hmm, pinning glob doesn't seem to have fixed it. I'm not sure how to look at the log file to confirm that glob is still the problem, but I'll reopen this.

Is the machine still in sync with its playbook? If it's not, I suggest we remove the Node.js installed via apt and instead just download it from nodejs.org and extract it to /usr/local

hmm. bot is still failing to start.

It seems like the deployment still has path-scurry 1.11.1 installed.

# npm ls
nodejs-github-bot@1.0.0-beta1 /home/iojs/github-bot
โ”œโ”€โ”ฌ @octokit/rest@19.0.13
โ”‚ โ”œโ”€โ”ฌ @octokit/core@4.2.1
โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/auth-token@3.0.3
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/graphql@5.0.5
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/request@6.2.3 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ universal-user-agent@6.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/request@6.2.3
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/endpoint@7.0.5
โ”‚ โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ is-plain-object@5.0.0 deduped
โ”‚ โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ universal-user-agent@6.0.0 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/request-error@3.0.3 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ is-plain-object@5.0.0
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”ฌ node-fetch@2.6.9
โ”‚ โ”‚ โ”‚ โ”‚ โ””โ”€โ”ฌ whatwg-url@5.0.0
โ”‚ โ”‚ โ”‚ โ”‚   โ”œโ”€โ”€ tr46@0.0.3
โ”‚ โ”‚ โ”‚ โ”‚   โ””โ”€โ”€ webidl-conversions@3.0.1
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ universal-user-agent@6.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/request-error@3.0.3
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ deprecation@2.3.1 deduped
โ”‚ โ”‚ โ”‚ โ””โ”€โ”ฌ once@1.4.0
โ”‚ โ”‚ โ”‚   โ””โ”€โ”€ wrappy@1.0.2
โ”‚ โ”‚ โ”œโ”€โ”ฌ @octokit/types@9.2.3
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ @octokit/openapi-types@17.2.0
โ”‚ โ”‚ โ”œโ”€โ”€ before-after-hook@2.2.2
โ”‚ โ”‚ โ””โ”€โ”€ universal-user-agent@6.0.0
โ”‚ โ”œโ”€โ”ฌ @octokit/plugin-paginate-rest@6.1.2
โ”‚ โ”‚ โ”œโ”€โ”€ @octokit/tsconfig@1.0.2
โ”‚ โ”‚ โ””โ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚ โ”œโ”€โ”€ @octokit/plugin-request-log@1.0.4
โ”‚ โ””โ”€โ”ฌ @octokit/plugin-rest-endpoint-methods@7.1.2
โ”‚   โ”œโ”€โ”€ @octokit/types@9.2.3 deduped
โ”‚   โ””โ”€โ”€ deprecation@2.3.1
โ”œโ”€โ”ฌ aigle@1.14.1
โ”‚ โ””โ”€โ”€ aigle-core@1.0.0
โ”œโ”€โ”ฌ basic-auth@2.0.1
โ”‚ โ””โ”€โ”€ safe-buffer@5.1.2
โ”œโ”€โ”ฌ body-parser@1.20.2
โ”‚ โ”œโ”€โ”€ bytes@3.1.2
โ”‚ โ”œโ”€โ”€ content-type@1.0.5
โ”‚ โ”œโ”€โ”ฌ debug@2.6.9
โ”‚ โ”‚ โ””โ”€โ”€ ms@2.0.0
โ”‚ โ”œโ”€โ”€ depd@2.0.0
โ”‚ โ”œโ”€โ”€ destroy@1.2.0
โ”‚ โ”œโ”€โ”ฌ http-errors@2.0.0
โ”‚ โ”‚ โ”œโ”€โ”€ depd@2.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ inherits@2.0.4
โ”‚ โ”‚ โ”œโ”€โ”€ setprototypeof@1.2.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ statuses@2.0.1 deduped
โ”‚ โ”‚ โ””โ”€โ”€ toidentifier@1.0.1
โ”‚ โ”œโ”€โ”ฌ iconv-lite@0.4.24
โ”‚ โ”‚ โ””โ”€โ”€ safer-buffer@2.1.2
โ”‚ โ”œโ”€โ”ฌ on-finished@2.4.1
โ”‚ โ”‚ โ””โ”€โ”€ ee-first@1.1.1
โ”‚ โ”œโ”€โ”ฌ qs@6.11.0
โ”‚ โ”‚ โ””โ”€โ”ฌ side-channel@1.0.4
โ”‚ โ”‚   โ”œโ”€โ”ฌ call-bind@1.0.2
โ”‚ โ”‚   โ”‚ โ”œโ”€โ”€ function-bind@1.1.1
โ”‚ โ”‚   โ”‚ โ””โ”€โ”€ get-intrinsic@1.2.1 deduped
โ”‚ โ”‚   โ”œโ”€โ”ฌ get-intrinsic@1.2.1
โ”‚ โ”‚   โ”‚ โ”œโ”€โ”€ function-bind@1.1.1 deduped
โ”‚ โ”‚   โ”‚ โ”œโ”€โ”ฌ has@1.0.3
โ”‚ โ”‚   โ”‚ โ”‚ โ””โ”€โ”€ function-bind@1.1.1 deduped
โ”‚ โ”‚   โ”‚ โ”œโ”€โ”€ has-proto@1.0.1
โ”‚ โ”‚   โ”‚ โ””โ”€โ”€ has-symbols@1.0.3
โ”‚ โ”‚   โ””โ”€โ”€ object-inspect@1.12.3
โ”‚ โ”œโ”€โ”ฌ raw-body@2.5.2
โ”‚ โ”‚ โ”œโ”€โ”€ bytes@3.1.2 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ http-errors@2.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ iconv-lite@0.4.24 deduped
โ”‚ โ”‚ โ””โ”€โ”€ unpipe@1.0.0 deduped
โ”‚ โ”œโ”€โ”ฌ type-is@1.6.18
โ”‚ โ”‚ โ”œโ”€โ”€ media-typer@0.3.0
โ”‚ โ”‚ โ””โ”€โ”ฌ mime-types@2.1.35
โ”‚ โ”‚   โ””โ”€โ”€ mime-db@1.52.0
โ”‚ โ””โ”€โ”€ unpipe@1.0.0
โ”œโ”€โ”ฌ bunyan@1.8.15
โ”‚ โ”œโ”€โ”ฌ dtrace-provider@0.8.8
โ”‚ โ”‚ โ””โ”€โ”€ nan@2.15.0
โ”‚ โ”œโ”€โ”€ moment@2.29.4
โ”‚ โ”œโ”€โ”ฌ mv@2.1.1
โ”‚ โ”‚ โ”œโ”€โ”ฌ mkdirp@0.5.6
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ minimist@1.2.6
โ”‚ โ”‚ โ”œโ”€โ”€ ncp@2.0.0
โ”‚ โ”‚ โ””โ”€โ”ฌ rimraf@2.4.5
โ”‚ โ”‚   โ””โ”€โ”ฌ glob@6.0.4
โ”‚ โ”‚     โ”œโ”€โ”ฌ inflight@1.0.6
โ”‚ โ”‚     โ”‚ โ”œโ”€โ”€ once@1.4.0 deduped
โ”‚ โ”‚     โ”‚ โ””โ”€โ”€ wrappy@1.0.2 deduped
โ”‚ โ”‚     โ”œโ”€โ”€ inherits@2.0.4 deduped
โ”‚ โ”‚     โ”œโ”€โ”ฌ minimatch@3.1.2
โ”‚ โ”‚     โ”‚ โ””โ”€โ”ฌ brace-expansion@1.1.11
โ”‚ โ”‚     โ”‚   โ”œโ”€โ”€ balanced-match@1.0.2 deduped
โ”‚ โ”‚     โ”‚   โ””โ”€โ”€ concat-map@0.0.1
โ”‚ โ”‚     โ”œโ”€โ”€ once@1.4.0 deduped
โ”‚ โ”‚     โ””โ”€โ”€ path-is-absolute@1.0.1
โ”‚ โ””โ”€โ”€ safe-json-stringify@1.2.0
โ”œโ”€โ”ฌ bunyan-middleware@1.0.2
โ”‚ โ”œโ”€โ”ฌ @types/bunyan@1.8.8
โ”‚ โ”‚ โ””โ”€โ”€ @types/node@17.0.23
โ”‚ โ”œโ”€โ”ฌ @types/express@4.17.13
โ”‚ โ”‚ โ”œโ”€โ”ฌ @types/body-parser@1.19.2
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”ฌ @types/connect@3.4.35
โ”‚ โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ @types/node@17.0.23 deduped
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ @types/node@17.0.23 deduped
โ”‚ โ”‚ โ”œโ”€โ”ฌ @types/express-serve-static-core@4.17.28
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @types/node@17.0.23 deduped
โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ @types/qs@6.9.7 deduped
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ @types/range-parser@1.2.4
โ”‚ โ”‚ โ”œโ”€โ”€ @types/qs@6.9.7
โ”‚ โ”‚ โ””โ”€โ”ฌ @types/serve-static@1.13.10
โ”‚ โ”‚   โ”œโ”€โ”€ @types/mime@1.3.2
โ”‚ โ”‚   โ””โ”€โ”€ @types/node@17.0.23 deduped
โ”‚ โ””โ”€โ”€ uuid@8.3.2
โ”œโ”€โ”ฌ codeowners-utils@1.0.2
โ”‚ โ”œโ”€โ”ฌ cross-spawn@7.0.3
โ”‚ โ”‚ โ”œโ”€โ”€ path-key@3.1.1
โ”‚ โ”‚ โ”œโ”€โ”ฌ shebang-command@2.0.0
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ shebang-regex@3.0.0
โ”‚ โ”‚ โ””โ”€โ”ฌ which@2.0.2
โ”‚ โ”‚   โ””โ”€โ”€ isexe@2.0.0
โ”‚ โ”œโ”€โ”ฌ find-up@4.1.0
โ”‚ โ”‚ โ”œโ”€โ”€ locate-path@5.0.0 deduped
โ”‚ โ”‚ โ””โ”€โ”€ path-exists@4.0.0
โ”‚ โ”œโ”€โ”€ ignore@5.2.0
โ”‚ โ””โ”€โ”ฌ locate-path@5.0.0
โ”‚   โ””โ”€โ”ฌ p-locate@4.1.0
โ”‚     โ””โ”€โ”ฌ p-limit@2.3.0
โ”‚       โ””โ”€โ”€ p-try@2.2.0
โ”œโ”€โ”ฌ debug@4.3.4
โ”‚ โ””โ”€โ”€ ms@2.1.2
โ”œโ”€โ”€ dotenv@16.4.5
โ”œโ”€โ”€ events-async@1.2.1
โ”œโ”€โ”ฌ express@4.19.2
โ”‚ โ”œโ”€โ”ฌ accepts@1.3.8
โ”‚ โ”‚ โ”œโ”€โ”€ mime-types@2.1.35 deduped
โ”‚ โ”‚ โ””โ”€โ”€ negotiator@0.6.3
โ”‚ โ”œโ”€โ”€ array-flatten@1.1.1
โ”‚ โ”œโ”€โ”€ body-parser@1.20.2 deduped
โ”‚ โ”œโ”€โ”ฌ content-disposition@0.5.4
โ”‚ โ”‚ โ””โ”€โ”€ safe-buffer@5.2.1 deduped
โ”‚ โ”œโ”€โ”€ content-type@1.0.5 deduped
โ”‚ โ”œโ”€โ”€ cookie@0.6.0
โ”‚ โ”œโ”€โ”€ cookie-signature@1.0.6
โ”‚ โ”œโ”€โ”ฌ debug@2.6.9
โ”‚ โ”‚ โ””โ”€โ”€ ms@2.0.0
โ”‚ โ”œโ”€โ”€ depd@2.0.0 deduped
โ”‚ โ”œโ”€โ”€ encodeurl@1.0.2
โ”‚ โ”œโ”€โ”€ escape-html@1.0.3
โ”‚ โ”œโ”€โ”€ etag@1.8.1
โ”‚ โ”œโ”€โ”ฌ finalhandler@1.2.0
โ”‚ โ”‚ โ”œโ”€โ”ฌ debug@2.6.9
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ ms@2.0.0
โ”‚ โ”‚ โ”œโ”€โ”€ encodeurl@1.0.2 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ escape-html@1.0.3 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ on-finished@2.4.1 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ parseurl@1.3.3 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ statuses@2.0.1 deduped
โ”‚ โ”‚ โ””โ”€โ”€ unpipe@1.0.0 deduped
โ”‚ โ”œโ”€โ”€ fresh@0.5.2
โ”‚ โ”œโ”€โ”€ http-errors@2.0.0 deduped
โ”‚ โ”œโ”€โ”€ merge-descriptors@1.0.1
โ”‚ โ”œโ”€โ”€ methods@1.1.2
โ”‚ โ”œโ”€โ”€ on-finished@2.4.1 deduped
โ”‚ โ”œโ”€โ”€ parseurl@1.3.3
โ”‚ โ”œโ”€โ”€ path-to-regexp@0.1.7
โ”‚ โ”œโ”€โ”ฌ proxy-addr@2.0.7
โ”‚ โ”‚ โ”œโ”€โ”€ forwarded@0.2.0
โ”‚ โ”‚ โ””โ”€โ”€ ipaddr.js@1.9.1
โ”‚ โ”œโ”€โ”€ qs@6.11.0 deduped
โ”‚ โ”œโ”€โ”€ range-parser@1.2.1
โ”‚ โ”œโ”€โ”€ safe-buffer@5.2.1
โ”‚ โ”œโ”€โ”ฌ send@0.18.0
โ”‚ โ”‚ โ”œโ”€โ”ฌ debug@2.6.9
โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ ms@2.0.0
โ”‚ โ”‚ โ”œโ”€โ”€ depd@2.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ destroy@1.2.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ encodeurl@1.0.2 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ escape-html@1.0.3 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ etag@1.8.1 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ fresh@0.5.2 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ http-errors@2.0.0 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ mime@1.6.0
โ”‚ โ”‚ โ”œโ”€โ”€ ms@2.1.3
โ”‚ โ”‚ โ”œโ”€โ”€ on-finished@2.4.1 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ range-parser@1.2.1 deduped
โ”‚ โ”‚ โ””โ”€โ”€ statuses@2.0.1 deduped
โ”‚ โ”œโ”€โ”ฌ serve-static@1.15.0
โ”‚ โ”‚ โ”œโ”€โ”€ encodeurl@1.0.2 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ escape-html@1.0.3 deduped
โ”‚ โ”‚ โ”œโ”€โ”€ parseurl@1.3.3 deduped
โ”‚ โ”‚ โ””โ”€โ”€ send@0.18.0 deduped
โ”‚ โ”œโ”€โ”€ setprototypeof@1.2.0
โ”‚ โ”œโ”€โ”€ statuses@2.0.1
โ”‚ โ”œโ”€โ”€ type-is@1.6.18 deduped
โ”‚ โ”œโ”€โ”€ utils-merge@1.0.1
โ”‚ โ””โ”€โ”€ vary@1.1.2
โ””โ”€โ”ฌ glob@10.3.12
  โ”œโ”€โ”ฌ foreground-child@3.1.1
  โ”‚ โ”œโ”€โ”€ cross-spawn@7.0.3 deduped
  โ”‚ โ””โ”€โ”€ signal-exit@4.0.1
  โ”œโ”€โ”ฌ jackspeak@2.3.6
  โ”‚ โ”œโ”€โ”ฌ @isaacs/cliui@8.0.2
  โ”‚ โ”‚ โ”œโ”€โ”ฌ string-width@5.1.2
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ eastasianwidth@0.2.0
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ emoji-regex@9.2.2
  โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ strip-ansi@7.1.0 deduped
  โ”‚ โ”‚ โ”œโ”€โ”ฌ string-width-cjs@npm:string-width@4.2.3
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ emoji-regex@8.0.0
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ is-fullwidth-code-point@3.0.0
  โ”‚ โ”‚ โ”‚ โ””โ”€โ”ฌ strip-ansi@6.0.1
  โ”‚ โ”‚ โ”‚   โ””โ”€โ”€ ansi-regex@5.0.1
  โ”‚ โ”‚ โ”œโ”€โ”ฌ strip-ansi@7.1.0
  โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ ansi-regex@6.0.1
  โ”‚ โ”‚ โ”œโ”€โ”ฌ strip-ansi-cjs@npm:strip-ansi@6.0.1
  โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ ansi-regex@5.0.1
  โ”‚ โ”‚ โ”œโ”€โ”ฌ wrap-ansi@8.1.0
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ ansi-styles@6.2.1
  โ”‚ โ”‚ โ”‚ โ”œโ”€โ”€ string-width@5.1.2 deduped
  โ”‚ โ”‚ โ”‚ โ””โ”€โ”€ strip-ansi@7.1.0 deduped
  โ”‚ โ”‚ โ””โ”€โ”ฌ wrap-ansi-cjs@npm:wrap-ansi@7.0.0
  โ”‚ โ”‚   โ”œโ”€โ”ฌ ansi-styles@4.3.0
  โ”‚ โ”‚   โ”‚ โ””โ”€โ”ฌ color-convert@2.0.1
  โ”‚ โ”‚   โ”‚   โ””โ”€โ”€ color-name@1.1.4
  โ”‚ โ”‚   โ”œโ”€โ”ฌ string-width@4.2.3
  โ”‚ โ”‚   โ”‚ โ”œโ”€โ”€ emoji-regex@8.0.0
  โ”‚ โ”‚   โ”‚ โ”œโ”€โ”€ is-fullwidth-code-point@3.0.0 deduped
  โ”‚ โ”‚   โ”‚ โ””โ”€โ”€ strip-ansi@6.0.1 deduped
  โ”‚ โ”‚   โ””โ”€โ”ฌ strip-ansi@6.0.1
  โ”‚ โ”‚     โ””โ”€โ”€ ansi-regex@5.0.1
  โ”‚ โ””โ”€โ”€ @pkgjs/parseargs@0.11.0
  โ”œโ”€โ”ฌ minimatch@9.0.1
  โ”‚ โ””โ”€โ”ฌ brace-expansion@2.0.1
  โ”‚   โ””โ”€โ”€ balanced-match@1.0.2
  โ”œโ”€โ”€ minipass@7.0.4
  โ””โ”€โ”ฌ path-scurry@1.11.1
    โ”œโ”€โ”€ lru-cache@10.2.2
    โ””โ”€โ”€ minipass@7.1.1

Maybe trying to get a manual Node.js 14 installed as a temporary solution would be worth pursuing.

Is the machine still in sync with its playbook? If it's not, I suggest we remove the Node.js installed via apt and instead just download it from nodejs.org and extract it to /usr/local

I've downloaded Node.js 14.21.3 onto the machine and extracted it to /usr/local. Had to edit /lib/systemd/system/github-bot.service so that it used /usr/local/bin/node instead of /usr/bin/node. It looks like the bot has now been able to start:

root@infra-rackspace-debian8-x64-1:/home/iojs# systemctl status github-bot
โ— github-bot.service - github-bot
   Loaded: loaded (/lib/systemd/system/github-bot.service; enabled)
   Active: active (running) since Wed 2024-05-15 17:52:29 UTC; 1s ago
 Main PID: 19176 (node)
   CGroup: /system.slice/github-bot.service
           โ””โ”€19176 /usr/local/bin/node server.js

May 15 17:52:29 infra-rackspace-debian8-x64-1 systemd[1]: Started github-bot.
May 15 17:52:29 infra-rackspace-debian8-x64-1 node[19176]: {"name":"bot","hostname":"infra-rackspace-debian8-x64-1","pid":19176,"level":30,"msg":"Loading: ./scripts/ping.js","time":"2024-05-15T1...591Z","v":0}
May 15 17:52:29 infra-rackspace-debian8-x64-1 node[19176]: {"name":"bot","hostname":"infra-rackspace-debian8-x64-1","pid":19176,"level":30,"msg":"Loading: ./scripts/node-ping-owners.js","time":"...595Z","v":0}
May 15 17:52:29 infra-rackspace-debian8-x64-1 node[19176]: {"name":"bot","hostname":"infra-rackspace-debian8-x64-1","pid":19176,"level":30,"msg":"Loading: ./scripts/jenkins-status.js","time":"20...687Z","v":0}
May 15 17:52:29 infra-rackspace-debian8-x64-1 node[19176]: {"name":"bot","hostname":"infra-rackspace-debian8-x64-1","pid":19176,"level":30,"msg":"Loading: ./scripts/event-relay.js","time":"2024-...688Z","v":0}
May 15 17:52:29 infra-rackspace-debian8-x64-1 node[19176]: {"name":"bot","hostname":"infra-rackspace-debian8-x64-1","pid":19176,"level":30,"msg":"Listening on port 3333","time":"2024-05-15T17:52...693Z","v":0}
Hint: Some lines were ellipsized, use -l to show in full.
root@infra-rackspace-debian8-x64-1:/home/iojs#

httpRequest step in the pipeline (see #3720 (comment)) is passing now and I can see status checks being posted back to PRs.

Trott commented

@richardlau Should we land nodejs/github-bot#514 and keep an eye on things?