Docker error="unauthorized: authentication required"
nevrrmind opened this issue · 10 comments
Describe the bug
I don't know what the error is, but the log is full of it.
Feb 08 09:45:28 mynode dockerd[6513]: time="2024-02-08T09:45:28.348126277+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:45:28 mynode dockerd[6513]: time="2024-02-08T09:45:28.347910850+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:44:25 mynode dockerd[6513]: time="2024-02-08T09:44:25.938703484+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:44:25 mynode dockerd[6513]: time="2024-02-08T09:44:25.938598694+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:43:22 mynode dockerd[6513]: time="2024-02-08T09:43:22.168403604+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:43:22 mynode dockerd[6513]: time="2024-02-08T09:43:22.168212344+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:42:20 mynode dockerd[6513]: time="2024-02-08T09:42:20.343621783+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:42:20 mynode dockerd[6513]: time="2024-02-08T09:42:20.343455983+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:41:18 mynode dockerd[6513]: time="2024-02-08T09:41:18.122792152+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:41:18 mynode dockerd[6513]: time="2024-02-08T09:41:18.122560224+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:40:15 mynode dockerd[6513]: time="2024-02-08T09:40:15.859866224+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:40:15 mynode dockerd[6513]: time="2024-02-08T09:40:15.859738834+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:39:13 mynode dockerd[6513]: time="2024-02-08T09:39:13.675515116+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:39:13 mynode dockerd[6513]: time="2024-02-08T09:39:13.675232946+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:38:11 mynode dockerd[6513]: time="2024-02-08T09:38:11.358092159+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Feb 08 09:38:11 mynode dockerd[6513]: time="2024-02-08T09:38:11.357940392+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n"
Feb 08 09:37:09 mynode dockerd[6513]: time="2024-02-08T09:37:09.055511835+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required"
Expected behavior
Normal working Docker
MyNode hardware (please complete the following information):
- Device: [VM]
- Debian 12
- Linux mynode 6.1.0-17-amd64 86_64 GNU/Linux
- Version [0.3.26]
Any idea where the problem is?
That used to be an issue in older versions of docker on Debian 10. I have never seen it on Debian 12. is it stopping docker from running any containers?
admin@mynode:~$ docker -v
Docker version 25.0.3, build 4debf41
admin@mynode:~$ docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
It seems like no containers are running.
Does rebooting help? You could also try resetting docker via the settings page to see if there was some corrupt docker data causing issues.
Neither reboot nor reset
Feb 09 07:39:12 mynode dockerd[7002]: time="2024-02-09T07:39:12.618449228+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required" Feb 09 07:39:12 mynode dockerd[7002]: time="2024-02-09T07:39:12.618301354+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n" Feb 09 07:38:10 mynode dockerd[7002]: time="2024-02-09T07:38:10.811780314+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required" Feb 09 07:38:10 mynode dockerd[7002]: time="2024-02-09T07:38:10.811634798+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n" Feb 09 07:37:09 mynode dockerd[7002]: time="2024-02-09T07:37:09.094469786+01:00" level=info msg="Ignoring extra error returned from registry" error="unauthorized: authentication required" Feb 09 07:37:09 mynode dockerd[7002]: time="2024-02-09T07:37:09.094367250+01:00" level=error msg="Not continuing with pull after error: errors:\ndenied: requested access to the resource is denied\nunauthorized: authentication required\n" Feb 09 07:37:07 mynode systemd[1]: Started docker.service - Docker Application Container Engine. Feb 09 07:37:07 mynode dockerd[7002]: time="2024-02-09T07:37:07.310273587+01:00" level=info msg="API listen on /run/docker.sock" Feb 09 07:37:06 mynode dockerd[7002]: time="2024-02-09T07:37:06.126000106+01:00" level=info msg="Daemon has completed initialization" Feb 09 07:37:06 mynode dockerd[7002]: time="2024-02-09T07:37:06.111710413+01:00" level=info msg="Docker daemon" commit=f417435 containerd-snapshotter=false storage-driver=overlay2 version=25.0.3 Feb 09 07:37:05 mynode dockerd[7002]: time="2024-02-09T07:37:05.911257251+01:00" level=info msg="Loading containers: done." Feb 09 07:37:03 mynode dockerd[7002]: time="2024-02-09T07:37:03.876504475+01:00" level=info msg="Loading containers: start." Feb 09 07:37:01 mynode dockerd[7002]: time="2024-02-09T07:37:01.308913974+01:00" level=info msg="Starting up" Feb 09 07:36:58 mynode systemd[1]: Starting docker.service - Docker Application Container Engine...
I'm grateful for any help.
Can you try running this command via the linux terminal? If it doesn't help, also try rebooting after running the command to restart docker.
docker logout
Can you try running this command via the linux terminal? If it doesn't help, also try rebooting after running the command to restart docker.
docker logout
docker logut, Restart, Reboot, Re-install... nothing is working :/
Feb 20 21:21:35 mynode mempool[20284]: + sleep 5s
Feb 20 21:21:35 mynode mempool[20284]: + '[' true == true ']'
Feb 20 21:21:35 mynode mempool[20284]: + isRunning=true
Feb 20 21:21:35 mynode mempool[21028]: ++ docker inspect '--format={{.State.Running}}' mempool_db_1
Feb 20 21:21:35 mynode mempool[20284]: + '[' 1 ']'
Feb 20 21:21:35 mynode mempool[20284]: + [[ '' == *\i\n\f\o\r\m\a\t\i\o\n\_\s\c\h\e\m\a* ]]
Feb 20 21:21:35 mynode mempool[20284]: + databases=
Feb 20 21:21:35 mynode mempool[20283]: db_1 | 2024-02-20 20:21:35 7 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:35 mynode mempool[21007]: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:35 mynode mempool[21007]: ++ docker exec -i mempool_db_1 mysql -uroot -padmin -e 'SHOW DATABASES;'
Feb 20 21:21:30 mynode mempool[20284]: + sleep 5s
Feb 20 21:21:30 mynode mempool[20284]: + '[' true == true ']'
Feb 20 21:21:30 mynode mempool[20284]: + isRunning=true
Feb 20 21:21:30 mynode mempool[20979]: ++ docker inspect '--format={{.State.Running}}' mempool_db_1
Feb 20 21:21:30 mynode mempool[20284]: + '[' 1 ']'
Feb 20 21:21:30 mynode mempool[20284]: + [[ '' == *\i\n\f\o\r\m\a\t\i\o\n\_\s\c\h\e\m\a* ]]
Feb 20 21:21:30 mynode mempool[20284]: + databases=
Feb 20 21:21:30 mynode mempool[20283]: db_1 | 2024-02-20 20:21:30 6 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:30 mynode mempool[20957]: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:30 mynode mempool[20957]: ++ docker exec -i mempool_db_1 mysql -uroot -padmin -e 'SHOW DATABASES;'
Feb 20 21:21:25 mynode mempool[20284]: + sleep 5s
Feb 20 21:21:25 mynode mempool[20284]: + '[' true == true ']'
Feb 20 21:21:25 mynode mempool[20284]: + isRunning=true
Feb 20 21:21:25 mynode mempool[20763]: ++ docker inspect '--format={{.State.Running}}' mempool_db_1
Feb 20 21:21:25 mynode mempool[20284]: + '[' 1 ']'
Feb 20 21:21:25 mynode mempool[20284]: + [[ '' == *\i\n\f\o\r\m\a\t\i\o\n\_\s\c\h\e\m\a* ]]
Feb 20 21:21:25 mynode mempool[20284]: + databases=
Feb 20 21:21:25 mynode mempool[20283]: db_1 | 2024-02-20 20:21:25 5 [Warning] Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:25 mynode mempool[20738]: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
Feb 20 21:21:25 mynode mempool[20283]: db_1 | 2024-02-20 20:21:25 4 [Warning] Aborted connection 4 to db: 'unconnected' user: 'unauthenticated' host: '172.26.0.3' (This connection closed normally without authentication)
Feb 20 21:21:25 mynode mempool[20283]: db_1 | 2024-02-20 20:21:25 3 [Warning] Aborted connection 3 to db: 'unconnected' user: 'unauthenticated' host: '172.26.0.4' (This connection closed normally without authentication)
Feb 20 21:21:25 mynode mempool[20283]: db_1 | Version: '10.9.3-MariaDB-1:10.9.3+maria~ubu2204' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution
Feb 20 21:21:25 mynode mempool[20283]: db_1 | 2024-02-20 20:21:25 0 [Note] mariadbd: ready for connections.
Feb 20 21:21:24 mynode mempool[20738]: ++ docker exec -i mempool_db_1 mysql -uroot -padmin -e 'SHOW DATABASES;'
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 1 [Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1146: Table 'mysql.gtid_slave_pos' doesn't exist
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [ERROR] mariadbd: Event Scheduler: An error occurred when initializing system tables. Disabling the Event Scheduler.
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [ERROR] Cannot open mysql.event
Feb 20 21:21:24 mynode mempool[20283]: api_1 | wait-for-it.sh: db:3306 is available after 7 seconds
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [Warning] Can't open and lock time zone table: Table 'mysql.time_zone_leap_second' doesn't exist trying to live without them
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [ERROR] Missing system table mysql.proxies_priv; please run mysql_upgrade to create it
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [Note] Server socket created on IP: '::'.
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [Note] Server socket created on IP: '0.0.0.0'.
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist
Feb 20 21:21:24 mynode mempool[20283]: db_1 | 2024-02-20 20:21:24 0 [Note] DDL_LOG: Crash recovery executed 1 entries
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Warning] You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] Plugin 'FEEDBACK' is disabled.
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: log sequence number 36864; transaction id 4
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1"
Feb 20 21:21:22 mynode mempool[20283]: db_1 | 2024-02-20 20:21:22 0 [Note] InnoDB: 128 rollback segments are active.
Feb 20 21:21:21 mynode mempool[20283]: db_1 | 2024-02-20 20:21:21 0 [Note] InnoDB: Starting final batch to recover 3 pages from redo log.
Feb 20 21:21:20 mynode mempool[20283]: db_1 | 2024-02-20 20:21:20 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=17103
Feb 20 21:21:19 mynode mempool[20284]: + sleep 5s
Feb 20 21:21:19 mynode mempool[20284]: + '[' true == true ']'
Feb 20 21:21:19 mynode mempool[20284]: + isRunning=true
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: File system buffers for log disabled (block size=512 bytes)
Feb 20 21:21:19 mynode mempool[20695]: ++ docker inspect '--format={{.State.Running}}' mempool_db_1
Feb 20 21:21:19 mynode mempool[20284]: + '[' 1 ']'
Feb 20 21:21:19 mynode mempool[20284]: + isRunning=
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: Completed initialization of buffer pool
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Warning] mariadbd: io_uring_queue_init() failed with errno 1
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: Using generic crc32 instructions
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: Number of transaction pools: 1
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
Feb 20 21:21:19 mynode mempool[20283]: db_1 | 2024-02-20 20:21:19 0 [Note] mariadbd: Aria engine: recovery done
Feb 20 21:21:19 mynode mempool[20283]: db_1 | recovered pages: 0% 100% (0.2 seconds);
Feb 20 21:21:18 mynode mempool[20283]: db_1 | 2024-02-20 20:21:18 0 [Note] mariadbd: Aria engine: starting recovery
Feb 20 21:21:18 mynode mempool[20283]: db_1 | 2024-02-20 20:21:18 0 [Note] mariadbd (server 10.9.3-MariaDB-1:10.9.3+maria~ubu2204) starting as process 1 ...
Feb 20 21:21:18 mynode mempool[20283]: db_1 | 2024-02-20 20:21:18+00:00 [Note] [Entrypoint]: MariaDB upgrade (mariadb-upgrade) required, but skipped due to $MARIADB_AUTO_UPGRADE setting
Feb 20 21:21:18 mynode mempool[20283]: db_1 | 2024-02-20 20:21:18+00:00 [Note] [Entrypoint]: MariaDB upgrade information missing, assuming required
Feb 20 21:21:17 mynode mempool[20283]: web_1 | /var/www/mempool/browser/resources
Feb 20 21:21:17 mynode mempool[20283]: db_1 | 2024-02-20 20:21:17+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.9.3+maria~ubu2204 started.
Feb 20 21:21:17 mynode mempool[20283]: db_1 | 2024-02-20 20:21:17+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
Feb 20 21:21:17 mynode mempool[20283]: db_1 | 2024-02-20 20:21:16+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.9.3+maria~ubu2204 started.
Feb 20 21:21:17 mynode mempool[20283]: api_1 | wait-for-it.sh: waiting 720 seconds for db:3306
Feb 20 21:21:17 mynode mempool[20283]: Attaching to mempool_web_1, mempool_db_1, mempool_api_1
Feb 20 21:21:17 mynode mempool[20283]: Starting mempool_api_1 ... done
Feb 20 21:21:17 mynode mempool[20283]: Starting mempool_db_1 ... done
Feb 20 21:21:17 mynode mempool[20283]: Starting mempool_web_1 ... done
Feb 20 21:21:11 mynode mempool[20283]: Starting mempool_api_1 ...
Feb 20 21:21:11 mynode mempool[20283]: Starting mempool_web_1 ...
Feb 20 21:21:11 mynode mempool[20283]: Starting mempool_db_1 ...
That's the mempool log. Is docker still failing? If you can, can you create a new VM to see if it also has the same issue?
idk if it's a docker-based problem 🤷♂️ The log is full of entries like that:
Feb 21 09:21:09 mynode dockerd[6453]: 2024/02/21 09:21:09 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Feb 21 09:21:09 mynode dockerd[6453]: time="2024-02-21T09:21:09.926361875+01:00" level=error msg="Handler for GET /v1.44/containers/ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9/json returned error: write unix /run/docker.sock->@: write: broken pipe"
Feb 21 09:21:05 mynode dockerd[6453]: time="2024-02-21T09:21:05.679427515+01:00" level=warning msg="ShouldRestart failed, container will not be restarted" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 daemonShuttingDown=false error="restart canceled" execDuration=20.148621589s exitStatus="{1 2024-02-21 08:21:05.613739298 +0000 UTC}" hasBeenManuallyStopped=true restartCount=9
Feb 21 09:21:05 mynode dockerd[6453]: time="2024-02-21T09:21:05.652092272+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:20:54 mynode dockerd[6453]: time="2024-02-21T09:20:54.995187320+01:00" level=warning msg="ShouldRestart failed, container will not be restarted" container=853a81d319f9e88517907a7cc8addd149f18b876ed0ab2fd369aa447f02475b8 daemonShuttingDown=false error="restart canceled" execDuration=2m49.661493026s exitStatus="{0 2024-02-21 08:20:54.924811042 +0000 UTC}" hasBeenManuallyStopped=true restartCount=0
Feb 21 09:20:54 mynode dockerd[6453]: time="2024-02-21T09:20:54.967044365+01:00" level=info msg="ignoring event" container=853a81d319f9e88517907a7cc8addd149f18b876ed0ab2fd369aa447f02475b8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:20:52 mynode dockerd[6453]: time="2024-02-21T09:20:52.561009102+01:00" level=warning msg="ShouldRestart failed, container will not be restarted" container=16ab541ecc74f1014fb87459bcea93175ff71a0b0ec59339ef86c66877735fc6 daemonShuttingDown=false error="restart canceled" execDuration=2m45.857859222s exitStatus="{0 2024-02-21 08:20:52.484884031 +0000 UTC}" hasBeenManuallyStopped=true restartCount=0
Feb 21 09:20:52 mynode dockerd[6453]: time="2024-02-21T09:20:52.529314587+01:00" level=info msg="ignoring event" container=16ab541ecc74f1014fb87459bcea93175ff71a0b0ec59339ef86c66877735fc6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:20:15 mynode dockerd[6453]: time="2024-02-21T09:20:15.694332012+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:19:51 mynode dockerd[6453]: time="2024-02-21T09:19:51.309089704+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:19:33 mynode dockerd[6453]: time="2024-02-21T09:19:33.467144566+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:19:21 mynode dockerd[6453]: time="2024-02-21T09:19:21.788778106+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:19:09 mynode dockerd[6453]: time="2024-02-21T09:19:09.498875821+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:18:57 mynode dockerd[6453]: time="2024-02-21T09:18:57.995153075+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:18:47 mynode dockerd[6453]: time="2024-02-21T09:18:47.510796748+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:18:35 mynode dockerd[6453]: time="2024-02-21T09:18:35.766477423+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:18:23 mynode dockerd[6453]: time="2024-02-21T09:18:23.026067618+01:00" level=info msg="ignoring event" container=ffda25f6df87884134ed9046d3945251899e5fd660e1f7803a8ed72a0e490fc9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 21 09:18:12 mynode dockerd[6453]: 2024/02/21 09:18:12 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
Of course I can set up a new VM, but that again takes "forever" for the blockchain.
OK, now you could try clearing the docker data again. It seems docker is running better, but there are errors removing old containers and that should clear them out.