shell-init errors
Closed this issue · 3 comments
tylercal commented
Description of problem
At the end of my deployment, I get three identical and non-useful errors
remote: shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
There are no other warnings or indicators that something is wrong. I turn on trace and get the following before each error
remote: + source /var/lib/dokku/core-plugins/available/common/functions
remote: ++ set -eo pipefail
remote: ++ [[ -n 1 ]]
remote: ++ set -x
remote: + [[ ! -n 1 ]]
remote: ++ basename /var/lib/dokku/plugins/enabled/20_events/deploy-source-set
remote: + dokku_log_plugn_trigger_call deploy-source-set snapbiller git-push 561a22aabbfd4085152df475967b87c83ffc8dd6
remote: + declare 'desc=log plugn trigger calls'
remote: + local l_hook=deploy-source-set
remote: + shift
remote: + dokku_log_event 'INVOKED: deploy-source-set( snapbiller git-push 561a22aabbfd4085152df475967b87c83ffc8dd6 ) NAME=device FINGERPRINT=SHA256:value DOKKU_PID=184775'
remote: + declare 'desc=log dokku events'
remote: + logger -t dokku-event -i -- 'INVOKED: deploy-source-set( snapbiller git-push 561a22aabbfd4085152df475967b87c83ffc8dd6 ) NAME=device FINGERPRINT=SHA256:value DOKKU_PID=184775'
remote: shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
and
remote: + return 0
remote: ++ rm -rf /tmp/dokku-184775-git_build_app_repo.seshti
remote: + return 0
remote: ++ rm -rf /tmp/dokku-184775-git_build_app_repo.seshti
remote: + release_app_deploy_lock snapbiller
remote: + declare 'desc=release advisory lock used in deploys'
remote: + local APP=snapbiller
remote: + local APP_DEPLOY_LOCK_FILE=/var/lib/dokku/data/apps/snapbiller/.deploy.lock
remote: + release_advisory_lock /var/lib/dokku/data/apps/snapbiller/.deploy.lock
remote: + declare 'desc=release advisory lock'
remote: + local LOCK_FILE=/var/lib/dokku/data/apps/snapbiller/.deploy.lock
remote: + local LOCK_FD=200
remote: + flock -u 200
remote: + rm -f /var/lib/dokku/data/apps/snapbiller/.deploy.lock
remote: + return 0
remote: ++ rm -rf /tmp/dokku-184775-git_build_app_repo.seshti
remote: + plugn trigger deploy-source-set snapbiller git-push 561a22aabbfd4085152df475967b87c83ffc8dd6
remote: shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
remote: shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
My guess is it is an old plug-in that I removed, but the trace isn't really giving me any hints that I can see of where to start tracking that down.
Steps to reproduce
I'm not sure that I know how to reproduce yet. logspout and it's associated hostname plugins were the 2 things I removed recently since they haven't been maintained. Could just be coincidence.
dokku report $APP_NAME
-----> uname: Linux DokkuVM 5.4.0-170-generic #188-Ubuntu SMP Wed Jan 10 09:51:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
-----> memory:
total used free shared buff/cache available
Mem: 7945 2061 704 158 5180 5415
Swap: 0 0 0
-----> disk utilization:
Filesystem Size Used Avail Use% Mounted on
/dev/sdb1 62G 37G 26G 60% /
/dev/sda1 16G 28K 15G 1% /mnt
-----> disk inode utilization:
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sdb1 7.9M 1.4M 6.5M 18% /
/dev/sda1 1.0M 12 1.0M 1% /mnt
-----> docker version:
Client: Docker Engine - Community
Version: 24.0.2
API version: 1.43
Go version: go1.20.4
Git commit: cb74dfc
Built: Thu May 25 21:52:13 2023
OS/Arch: linux/amd64
Context: default
Server: Docker Engine - Community
Engine:
Version: 24.0.2
API version: 1.43 (minimum version 1.12)
Go version: go1.20.4
Git commit: 659604f
Built: Thu May 25 21:52:13 2023
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: 1.6.21
GitCommit: 3dce8eb055cbb6872793272b4f20ed16117344f8
runc:
Version: 1.1.7
GitCommit: v1.1.7-0-g860f061
docker-init:
Version: 0.19.0
GitCommit: de40ad0
-----> docker daemon info:
Client: Docker Engine - Community
Version: 24.0.2
Context: default
Debug Mode: true
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: v0.10.5
Path: /usr/libexec/docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc.)
Version: v2.18.1
Path: /usr/libexec/docker/cli-plugins/docker-compose
Server:
Containers: 22
Running: 20
Paused: 0
Stopped: 2
Images: 71
Server Version: 24.0.2
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Cgroup Version: 1
WARNING: No swap limit support
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 3dce8eb055cbb6872793272b4f20ed16117344f8
runc version: v1.1.7-0-g860f061
init version: de40ad0
Security Options:
apparmor
seccomp
Profile: builtin
Kernel Version: 5.4.0-170-generic
Operating System: Ubuntu 20.04.6 LTS
OSType: linux
Architecture: x86_64
CPUs: 2
Total Memory: 7.76GiB
Name: DokkuVM
ID: CA3Z:GOHT:SO22:RWHD:BQCZ:QF4Y:ZIUH:POZD:HOZE:D7LY:HD6Y:YQCR
Docker Root Dir: /var/lib/docker
Debug Mode: false
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
-----> herokuish version:
herokuish: v0.7.3
buildpacks:
heroku-buildpack-multi v1.2.0
heroku-buildpack-ruby v265
heroku-buildpack-nodejs v235
heroku-buildpack-clojure v91
heroku-buildpack-python v242
heroku-buildpack-java v73
heroku-buildpack-gradle v39
heroku-buildpack-scala v96
heroku-buildpack-play v26
heroku-buildpack-php v244
heroku-buildpack-go v184
heroku-buildpack-nginx v25
buildpack-null v3
-----> dokku version: dokku version 0.34.0
-----> dokku-event-listener version: 0.15.0build+5268732
-----> dokku-update version: dokku-update 0.7.2
-----> docker-container-healthchecker version: 0.9.0
-----> docker-image-labeler version: 0.6.1build+c6e15a9
-----> git version: git version 2.25.1
-----> lambda-builder version: 0.6.0
-----> netrc version: 0.8.0build+0751c1b
! pack binary is not available
-----> plugn version: plugn: 0.13.0build+fd5297a
-----> sigil version: 0.10.1build+e443be0
-----> sshcommand version: sshcommand 0.17.1
-----> dokku plugins:
00_dokku-standard 0.34.0 enabled dokku core standard plugin
20_events 0.34.0 enabled dokku core events logging plugin
app-json 0.34.0 enabled dokku core app-json plugin
apps 0.34.0 enabled dokku core apps plugin
builder 0.34.0 enabled dokku core builder plugin
builder-dockerfile 0.34.0 enabled dokku core builder-dockerfile plugin
builder-herokuish 0.34.0 enabled dokku core builder-herokuish plugin
builder-lambda 0.34.0 enabled dokku core builder-lambda plugin
builder-nixpacks 0.34.0 enabled dokku core builder-nixpacks plugin
builder-null 0.34.0 enabled dokku core builder-null plugin
builder-pack 0.34.0 enabled dokku core builder-pack plugin
buildpacks 0.34.0 enabled dokku core buildpacks plugin
caddy-vhosts 0.34.0 enabled dokku core caddy-vhosts plugin
certs 0.34.0 enabled dokku core certificate management plugin
checks 0.34.0 enabled dokku core checks plugin
common 0.34.0 enabled dokku core common plugin
config 0.34.0 enabled dokku core config plugin
cron 0.34.0 enabled dokku core cron plugin
docker-options 0.34.0 enabled dokku core docker-options plugin
domains 0.34.0 enabled dokku core domains plugin
enter 0.34.0 enabled dokku core enter plugin
git 0.34.0 enabled dokku core git plugin
haproxy-vhosts 0.34.0 enabled dokku core haproxy-vhosts plugin
letsencrypt 0.20.3 enabled Automated installation of let's encrypt TLS certificates
logs 0.34.0 enabled dokku core logs plugin
maintenance 0.8.0 enabled Maintenance mode for apps
network 0.34.0 enabled dokku core network plugin
nginx-vhosts 0.34.0 enabled dokku core nginx-vhosts plugin
openresty-vhosts 0.34.0 enabled dokku core openresty-vhosts plugin
plugin 0.34.0 enabled dokku core plugin plugin
ports 0.34.0 enabled dokku core ports plugin
postgres 1.36.4 enabled dokku postgres service plugin
proxy 0.34.0 enabled dokku core proxy plugin
ps 0.34.0 enabled dokku core ps plugin
redirect 0.9.1 enabled Plugin for managing application redirects
redis 1.37.4 enabled dokku redis service plugin
registry 0.34.0 enabled dokku core registry plugin
repo 0.34.0 enabled dokku core repo plugin
resource 0.34.0 enabled dokku core resource plugin
run 0.34.0 enabled dokku core run plugin
scheduler 0.34.0 enabled dokku core scheduler plugin
scheduler-docker-local 0.34.0 enabled dokku core scheduler-docker-local plugin
scheduler-k3s 0.34.0 enabled dokku core scheduler-k3s plugin
scheduler-null 0.34.0 enabled dokku core scheduler-null plugin
shell 0.34.0 enabled dokku core shell plugin
ssh-keys 0.34.0 enabled dokku core ssh-keys plugin
storage 0.34.0 enabled dokku core storage plugin
trace 0.34.0 enabled dokku core trace plugin
traefik-vhosts 0.34.0 enabled dokku core traefik-vhosts plugin
=====> snapbiller app-json information
App json computed selected: app.json
App json global selected: app.json
App json selected:
=====> snapbiller app information
App created at: 1677024018
App deploy source: git-push
App deploy source metadata: 561a22aabbfd4085152df475967b87c83ffc8dd6
App dir: /home/dokku/snapbiller
App locked: false
=====> snapbiller builder information
Builder build dir:
Builder computed build dir:
Builder computed selected:
Builder global build dir:
Builder global selected:
Builder selected:
=====> snapbiller builder-dockerfile information
Builder dockerfile computed dockerfile path: Dockerfile
Builder dockerfile global dockerfile path: Dockerfile
Builder dockerfile dockerfile path:
=====> snapbiller builder-herokuish information
Builder herokuish computed allowed: true
Builder herokuish global allowed: true
Builder herokuish allowed:
=====> snapbiller builder-lambda information
Builder lambda computed lambdayml path: lambda.yml
Builder lambda global lambdayml path: lambda.yml
Builder lambda lambdayml path:
=====> snapbiller builder-nixpacks information
Builder nixpacks computed nixpackstoml path: nixpacks.toml
Builder nixpacks global nixpackstoml path: nixpacks.toml
Builder nixpacks nixpackstoml path:
Builder nixpacks computed no cache: false
Builder nixpacks global no cache: false
Builder nixpacks no cache:
=====> snapbiller builder-pack information
Builder pack computed projecttoml path: project.toml
Builder pack global projecttoml path: project.toml
Builder pack projecttoml path:
=====> snapbiller buildpacks information
Buildpacks computed stack: gliderlabs/herokuish:latest-22
Buildpacks global stack:
Buildpacks list:
Buildpacks stack:
=====> snapbiller caddy information
Caddy image: lucaslorentz/caddy-docker-proxy:2.8
Caddy letsencrypt email:
Caddy letsencrypt server: https://acme-v02.api.letsencrypt.org/directory
Caddy log level: ERROR
Caddy polling interval: 5s
Caddy tls internal: false
=====> snapbiller ssl information
Ssl dir: /home/dokku/snapbiller/tls
Ssl enabled: true
Ssl hostnames: snapbiller.com
Ssl expires at: May 10 23:00:20 2024 GMT
Ssl issuer: C = US, O = Let's Encrypt, CN = R3
Ssl starts at: Feb 10 23:00:21 2024 GMT
Ssl subject: subject=CN = snapbiller.com
Ssl verified: verified by a certificate authority
=====> snapbiller checks information
Checks disabled list: none
Checks skipped list: none
Checks computed wait to retire: 60
Checks global wait to retire: 60
Checks wait to retire:
=====> snapbiller docker options information
Docker options build: --link dokku.postgres.snapbiller:dokku-postgres-snapbiller
Docker options deploy: --link dokku.postgres.snapbiller:dokku-postgres-snapbiller --restart=on-failure:10
Docker options run: --link dokku.postgres.snapbiller:dokku-postgres-snapbiller
=====> snapbiller domains information
Domains app enabled: true
Domains app vhosts: snapbiller.com
Domains global enabled: true
Domains global vhosts: snapbiller.westus2.cloudapp.azure.com dokku.roomj.com
=====> snapbiller git information
Git deploy branch: main
Git global deploy branch: master
Git keep git dir: false
Git rev env var: GIT_REV
Git sha: d5e2e5f
Git source image:
Git last updated at: 1711512283
=====> snapbiller haproxy information
Haproxy image: byjg/easy-haproxy:4.4.0
Haproxy letsencrypt email:
Haproxy letsencrypt server: https://acme-v02.api.letsencrypt.org/directory
Haproxy log level: ERROR
=====> snapbiller letsencrypt information
Letsencrypt active: true
Letsencrypt autorenew: true
Letsencrypt computed dns provider:
Letsencrypt global dns provider:
Letsencrypt dns provider:
Letsencrypt computed email: tylercal@gmail.com
Letsencrypt global email: tylercal@gmail.com
Letsencrypt email: tylercal@gmail.com
Letsencrypt expiration: 1715382020
Letsencrypt computed graceperiod: 2592000
Letsencrypt global graceperiod:
Letsencrypt graceperiod:
Letsencrypt computed lego docker args:
Letsencrypt global lego docker args:
Letsencrypt lego docker args:
Letsencrypt computed server: https://acme-v02.api.letsencrypt.org/directory
Letsencrypt global server:
Letsencrypt server:
=====> snapbiller logs information
Logs computed max size: 10m
Logs global max size: 10m
Logs global vector sink:
Logs max size:
Logs vector global image: timberio/vector:0.36.1-debian
Logs vector sink:
=====> snapbiller maintenance information
Maintenance enabled: false
=====> snapbiller network information
Network attach post create:
Network attach post deploy:
Network bind all interfaces: false
Network computed attach post create:
Network computed attach post deploy:
Network computed bind all interfaces: false
Network computed initial network:
Network computed tld:
Network global attach post create:
Network global attach post deploy:
Network global bind all interfaces: false
Network global initial network:
Network global tld:
Network initial network:
Network static web listener:
Network tld:
Network web listeners: 172.17.0.3:5000 172.17.0.18:5000
=====> snapbiller nginx information
Nginx access log format:
Nginx computed access log format:
Nginx global access log format:
Nginx access log path:
Nginx computed access log path: /var/log/nginx/snapbiller-access.log
Nginx global access log path: /var/log/nginx/snapbiller-access.log
Nginx bind address ipv4:
Nginx computed bind address ipv4:
Nginx global bind address ipv4:
Nginx bind address ipv6:
Nginx computed bind address ipv6: ::
Nginx global bind address ipv6: ::
Nginx client max body size:
Nginx computed client max body size: 1m
Nginx global client max body size: 1m
Nginx disable custom config:
Nginx computed disable custom config: false
Nginx global disable custom config: false
Nginx error log path:
Nginx computed error log path: /var/log/nginx/snapbiller-error.log
Nginx global error log path: /var/log/nginx/snapbiller-error.log
Nginx hsts include subdomains:
Nginx computed hsts include subdomains: true
Nginx global hsts include subdomains: true
Nginx hsts max age:
Nginx computed hsts max age: 15724800
Nginx global hsts max age: 15724800
Nginx hsts preload:
Nginx computed hsts preload: false
Nginx global hsts preload: false
Nginx hsts:
Nginx computed hsts: true
Nginx global hsts: true
Nginx last visited at:
Nginx nginx conf sigil path:
Nginx computed nginx conf sigil path: nginx.conf.sigil
Nginx global nginx conf sigil path: nginx.conf.sigil
Nginx proxy buffer size:
Nginx computed proxy buffer size: 4k
Nginx global proxy buffer size: 4k
Nginx proxy buffering:
Nginx computed proxy buffering: on
Nginx global proxy buffering: on
Nginx proxy buffers:
Nginx computed proxy buffers: 8 4k
Nginx global proxy buffers: 8 4k
Nginx proxy busy buffers size:
Nginx computed proxy busy buffers size: 8k
Nginx global proxy busy buffers size: 8k
Nginx proxy read timeout:
Nginx computed proxy read timeout: 60s
Nginx global proxy read timeout: 60s
Nginx underscore in headers:
Nginx computed underscore in headers: off
Nginx global underscore in headers: off
Nginx x forwarded for value:
Nginx computed x forwarded for value: $remote_addr
Nginx global x forwarded for value: $remote_addr
Nginx x forwarded port value:
Nginx computed x forwarded port value: $server_port
Nginx global x forwarded port value: $server_port
Nginx x forwarded proto value:
Nginx computed x forwarded proto value: $scheme
Nginx global x forwarded proto value: $scheme
Nginx x forwarded ssl:
Nginx computed x forwarded ssl:
Nginx global x forwarded ssl:
/var/lib/dokku/plugins/available/openresty-vhosts/command-functions: line 64: fn-openresty-allowed-letsencrypt-domains-func-base64: command not found
=====> snapbiller openresty information
Openresty access log format:
Openresty access log path: /var/log/nginx/snapbiller-access.log
Openresty allowed letsencrypt domains func base64:
Openresty bind address ipv4:
Openresty bind address ipv6: ::
Openresty client max body size:
Openresty error log path: /var/log/nginx/snapbiller-error.log
Openresty global hsts: true
Openresty computed hsts: true
Openresty hsts:
Openresty hsts include subdomains: true
Openresty hsts max age: 15724800
Openresty hsts preload: false
Openresty image: dokku/openresty-docker-proxy:0.7.0
Openresty letsencrypt email:
Openresty letsencrypt server: https://acme-v02.api.letsencrypt.org/directory
Openresty proxy buffer size: 4k
Openresty proxy buffering: on
Openresty proxy buffers: 8 4k
Openresty proxy busy buffers size: 8k
Openresty proxy read timeout: 60s
Openresty underscore in headers: off
Openresty x forwarded for value: $remote_addr
Openresty x forwarded port value: $server_port
Openresty x forwarded proto value: $scheme
Openresty x forwarded ssl:
=====> snapbiller ports information
Ports map: http:80:5000 https:443:5000
Ports map detected: http:80:5000 https:443:5000
=====> snapbiller proxy information
Proxy computed type: nginx
Proxy enabled: true
Proxy global type: nginx
Proxy type:
=====> snapbiller ps information
Deployed: true
Processes: 2
Ps can scale: true
Ps computed procfile path: Procfile
Ps global procfile path: Procfile
Ps procfile path:
Ps restart policy: on-failure:10
Restore: true
Running: true
Status web 1: running (CID: d8206bbc28d)
Status web 2: running (CID: 1ce54f68d3c)
=====> snapbiller registry information
Registry computed image repo: dokku/snapbiller
Registry computed push on release: false
Registry computed server:
Registry global image repo template:
Registry global push on release:
Registry global server:
Registry image repo:
Registry push extra tags:
Registry push on release:
Registry server:
Registry tag version:
=====> snapbiller resource information
=====> snapbiller scheduler information
Scheduler computed selected: docker-local
Scheduler global selected: docker-local
Scheduler selected:
=====> snapbiller scheduler-docker-local information
Scheduler docker local init process: true
Scheduler docker local parallel schedule count:
=====> snapbiller scheduler-k3s information
Scheduler k3s computed deploy timeout: 300s
Scheduler k3s computed image pull secrets:
Scheduler k3s computed letsencrypt server: prod
Scheduler k3s computed namespace: default
Scheduler k3s computed rollback on failure: false
Scheduler k3s deploy timeout:
Scheduler k3s global deploy timeout: 300s
Scheduler k3s global image pull secrets:
Scheduler k3s global ingress class: nginx
Scheduler k3s global kube context:
Scheduler k3s global kubeconfig path: /etc/rancher/k3s/k3s.yaml
Scheduler k3s global letsencrypt email prod:
Scheduler k3s global letsencrypt email stag:
Scheduler k3s global letsencrypt server: prod
Scheduler k3s global namespace: default
Scheduler k3s global network interface: eth0
Scheduler k3s global rollback on failure: false
Scheduler k3s image pull secrets:
Scheduler k3s letsencrypt server:
Scheduler k3s namespace:
Scheduler k3s rollback on failure:
=====> snapbiller storage information
Storage build mounts:
Storage deploy mounts:
Storage run mounts:
=====> snapbiller traefik information
Traefik api enabled: false
Traefik api vhost: traefik.dokku.me
Traefik basic auth password:
Traefik basic auth username:
Traefik dashboard enabled: false
Traefik image: traefik:2.11.0
Traefik letsencrypt email:
Traefik letsencrypt server: https://acme-v02.api.letsencrypt.org/directory
Traefik log level: ERROR
Additional information
No response
Output of failing commands after running: dokku trace:off
No response
Output of failing commands after running: dokku trace:on
No response
josegonzalez commented
How are you performing deployments? Is this via git push, image deployment, or something else?
josegonzalez commented
Ah looks like a git push triggers this: https://github.com/dokku/docs/actions/runs/8455270890/job/23162344081
ps:rebuild and git:sync don't, so I'll look into what might have caused it. Maybe new functionality in 0.34 did...
josegonzalez commented
Closing as there is an open pull request.