UniFi OS - Dream Machines 2.x

Question

UniFi OS - Dream Machines 2.x

StiviiK opened this issue 2 years ago · 153 comments

Ubiquiti recently annouced in the latest update notes for the UniFi OS - Dream Machines, they will migrate to 2.x soon.
https://community.ui.com/releases/UniFi-OS-Dream-Machines-1-12-30/a4f85653-7bc6-461a-8715-94298cb69164

If I am not mistaken, that means they will align the firmware with the firmware of the UDM SE.
Do you know what are the effects of that and how the work of this awesome project will be affected?
I am only aware that this will drop Podman?

Answer 1 · 2022-09-22T15:54:40.000Z

I've been wondering the same thing.

Answer 2 · 2022-11-16T09:15:47.000Z

So this means a couple things I believe. You will have to install podman via our udm-se builds probably. Beyond that the baseOS will have systemd now and if I remember correctly they let you customize. I think it will get rid of the need for the deb install and we will just have to update all instructions here to take 2.0 into account.

Answer 3 · 2022-11-16T18:29:32.000Z

That's good to hear, I've been holding off upgrading because quite used to using Pihole :)

Answer 4 · 2022-11-17T00:19:04.000Z

Curious if anyone had success with recent versions and installing podman from udm-se? My UDM is stuck on 1.11.4 (with podman 1.x) because of trauma from updating firmwares in the past

Answer 5 · 2022-12-15T13:11:58.000Z

Version 2.4 is now live for UDM (base, pro): https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-23/aebbba64-9e7e-4151-bcca-34ed08761f08
Thanks a lot for your work so far! I am badly wanting to get DNS-Requests redirected :)

Answer 6 · 2022-12-15T16:05:26.000Z

Has anyone performed the migration to 2.4.23?

Did any data related to on_boot remain on disk?

Does the migration nuke everything?

I'm hesitant to upgrade this early as I do need my DNS redirect and cloudflared services to remain running.

Answer 7 · 2022-12-15T16:24:16.000Z

All erased on my UDMB, no data folder in mnt

Answer 8 · 2022-12-15T16:25:33.000Z

Has anyone performed the migration to 2.4.23?

Did any data related to on_boot remain on disk?

Does the migration nuke everything?

I'm hesitant to upgrade this early as I do need my DNS redirect and cloudflared services to remain running.

For me it got rid of the on_boot.d folder and any podman containers I had it also completely got rid of podman. It leaves Unifi OS related configs such as network but anything custom is gone.

Answer 9 · 2022-12-15T18:07:53.000Z

Yes, everything was purged from this partition

Answer 10 · 2022-12-15T18:14:02.000Z

root@udmp:/persistent# dpkg -i udm-boot_1.0.5_all.deb 
Selecting previously unselected package udm-boot.
(Reading database ... 50954 files and directories currently installed.)
Preparing to unpack udm-boot_1.0.5_all.deb ...
/var/lib/dpkg/tmp.ci/preinst: 19: /var/lib/dpkg/tmp.ci/preinst: /sbin/ssh-proxy: not found
dpkg: error processing archive udm-boot_1.0.5_all.deb (--install):
 subprocess new pre-installation script returned error exit status 127
/var/lib/dpkg/tmp.ci/postrm: 24: /var/lib/dpkg/tmp.ci/postrm: /sbin/ssh-proxy: not found

Well the current installation does not run, cleaning it with

root@udmp:~# dpkg --purge --force-all udm-boot

But with this update tools like ansible are working fine now

Answer 11 · 2022-12-15T23:03:55.000Z

All erased on my UDMB, no data folder in mnt

For me, /mnt/data/ is missing, but /mnt/.rwfs/data exists. However, it looks like it's been cleared out.
unifi-os shell results in -bash: unifi-os: command not found
The install script fails with Missing dependencie(s): `podman`

Not sure why /mnt/data is missing—the overlayfs is mounted

overlayfs-root on / type overlay (rw,noatime,nodiratime,lowerdir=/mnt/.rofs,upperdir=/mnt/.rwfs/data,workdir=/mnt/.rwfs/.workdir)

Edit: derp, it's mounted at /data, I guess that's the new location in 2.x.

How are people installing podman?

Edit 2: Got it working. I downloaded the install script, and modified the case "$(udm_model)" statement to run the udr|udmse case for udm:

From b368017f4f3e83161549e36c93ada2dede7d6ffc Mon Sep 17 00:00:00 2001
From: Bennett Perkins <bennettperkins@gmail.com>
Date: Fri, 16 Dec 2022 07:49:03 +0800
Subject: [PATCH] got remote_install.sh working on UDM 2.4.23

---
 on-boot-script/remote_install.sh | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/on-boot-script/remote_install.sh b/on-boot-script/remote_install.sh
index 62de92c..87ce59e 100755
--- a/on-boot-script/remote_install.sh
+++ b/on-boot-script/remote_install.sh
@@ -160,7 +160,7 @@ depends_on curl
 ON_BOOT_D_PATH="$DATA_DIR/on_boot.d"
 
 case "$(udm_model)" in
-  udm|udmpro)
+  udmpro)
     echo "UDM/Pro detected, installing on-boot script..."
     depends_on podman
 
@@ -172,7 +172,7 @@ case "$(udm_model)" in
 
     echo "UDM Boot Script installed"
     ;;
-  udr|udmse)
+  udr|udmse|udm)
     echo "UDR/UDMSE detected, installing on-boot script..."
     depends_on systemctl
 
-- 
2.37.1 (Apple Git-137.1)

Answer 12 · 2022-12-15T23:10:13.000Z

The install script fails with Missing dependencie(s): `podman`

You will have to install podman via our udm-se builds probably.

In README.md
All artifacts can be found on IPFS https://unifi.boostchicken.io/

Extract the zip to the root of your device! Look at the assets on the Podman workflow.

Answer 13 · 2022-12-16T01:21:19.000Z

Using @bennetp123's advice, I was also able to install after updating my UDM base using the modified remote_install.sh
I tested the https://github.com/fire1ce/UDM-Persistent-SSH-Keys script and made two modifications to 99-ssh-keys.sh to use the /data path and to test for the existence of and make the /root/.ssh folder if necessary.

After that I'm able to ssh in with my key after reboot!

Answer 14 · 2022-12-16T02:12:35.000Z

In README.md
All artifacts can be found on IPFS https://unifi.boostchicken.io/
Extract the zip to the root of your device! Look at the assets on the Podman workflow.

can someone confirm this working on UDM? Last upgrade I had to leave podman at 1.0 since the updated variants didn't work for me. Do those SE builds work on normal UDM as well?

Also how is the unifi-shell now executed? Previously that was a podman container, but that is no longer the case I presume?

Answer 15 · 2022-12-16T06:19:03.000Z

This worked for me but my testing is limited.
If you're willing to test it, you can use this:

curl -fsL "https://raw.githubusercontent.com/jinkang23/unifios-utilities/main/on-boot-script/remote_install.sh" | /bin/sh

I just submitted PR to add this change: #451

Answer 16 · 2022-12-16T07:13:40.000Z

Thanks, @jinkang23 , I tested it and it seems to be working. One question: The CNI Bridge is not needed if I only want to execute a startup script. Is it needed anyway, as there are no more containers on UDM FW2.x onwards?

Answer 17 · 2022-12-16T11:11:32.000Z

In README.md
All artifacts can be found on IPFS https://unifi.boostchicken.io/
Extract the zip to the root of your device! Look at the assets on the Podman workflow.

can someone confirm this working on UDM? Last upgrade I had to leave podman at 1.0 since the updated variants didn't work for me. Do those SE builds work on normal UDM as well?

I can confirm it's working, at least enough to get podman run --rm -it busybox working (edit: I got pihole up and running too, so I'd say it's thoroughly working)—though I needed to create some missing files manually, as outlined in #384:

/etc/containers/registries.conf
/etc/containers/policy.json
/etc/containers/storage.json

I used udmpro-podman-install.zip from https://unifi.boostchicken.io/ —not sure if that's the right version, or if there is even a difference between them (udmse-podman-install.zip seems to work fine too, though I didn't try to run any containers).

Also how is the unifi-shell now executed? Previously that was a podman container, but that is no longer the case I presume?

No idea—podman ps can't see it so I guess it doesn't exist 🙃

Answer 18 · 2022-12-16T15:56:24.000Z

Thanks, @jinkang23 , I tested it and it seems to be working. One question: The CNI Bridge is not needed if I only want to execute a startup script. Is it needed anyway, as there are no more containers on UDM FW2.x onwards?

Yea, I'm not sure about that. I figured it was there because you can still technically install podman. I suppose you could remove them afterwards if you don't plan on using it.

Answer 19 · 2022-12-16T19:19:04.000Z

I would suppose so as well. I just deleted the install (05...) and startup (06...) script and be fine with it.
I can also confirm that it is working well and also surviving reboots.

Thanks again for your efforts, very much appreciated, happy camper here :)

Answer 20 · 2022-12-17T01:47:59.000Z

Thanks for the comments all! I know what my evening project will be, fingers crossed it goes equally smooth. I only have 2 podman containers to migrate but let's see...

Did upgrading the firmware wipe everything that was previously persisted in /mnt/data or did data files stay / got migrated to /data?

Answer 21 · 2022-12-17T02:34:14.000Z

Did upgrading the firmware wipe everything that was previously persisted in /mnt/data or did data files stay / got migrated to /data?

The migration will delete all data.

Answer 22 · 2022-12-19T06:26:52.000Z

For anyone looking to install Podman I put together a build here. It's distributed through a Debian package so easy to install and remove (setup could done easily as an on_boot script). It uses current versions of Podman and its dependencies. So far working well for me on my UDMP on 2.4 and I plan to maintain this going forward.

Heavily inspired by the work done in this repo and the comments here about getting podman running. Wanted to share as it seemed it might save some people headache getting it working.

Answer 23 · 2022-12-19T14:23:46.000Z

Does the configuration of Podman also get lost?

As in, if I install podman again after the update, will all my previously running containers be running in the state they were before the update? Or do I have to re-create / restore everything by hand?

Answer 24 · 2022-12-19T14:35:48.000Z

Does the configuration of Podman also get lost?

As in, if I install podman again after the update, will all my previously running containers be running in the state they were before the update? Or do I have to re-create / restore everything by hand?

The migration will delete all data.

Answer 25 · 2022-12-20T09:58:15.000Z

For anyone looking to install Podman I put together a build here. It's distributed through a Debian package so easy to install and remove (setup could done easily as an on_boot script). It uses current versions of Podman and its dependencies. So far working well for me on my UDMP on 2.4 and I plan to maintain this going forward.

Heavily inspired by the work done in this repo and the comments here about getting podman running. Wanted to share as it seemed it might save some people headache getting it working.

Thank you so much! My UDM-PRO auto-updated over night to the 2.4 Firmware and everything was gone. With your Podman build I managed to bring back up my multicast-relay on my UDM-PRO.

Answer 26 · 2022-12-23T09:18:13.000Z

Looks like they pulled the 2.x upgrade for UDM again. Anyone happen to have the firmware upgrade downloaded?

Answer 27 · 2022-12-23T11:30:35.000Z

@dvcrn It's in early access: https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-23

Answer 28 · 2022-12-23T11:51:45.000Z

@tscheckenbach I'm enrolled in EA, but that link you sent is 404ing for me

Glenn posted a week ago that they pulled the 2.x firmware: https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-23/aebbba64-9e7e-4151-bcca-34ed08761f08#comment/5cc499c9-0744-4cc2-a448-d9f2ac8c98dd

Answer 29 · 2022-12-28T19:37:08.000Z

curl -fsL "https://raw.githubusercontent.com/jinkang23/unifios-utilities/main/on-boot-script/remote_install.sh" |

This worked for me, thanks.

Answer 30 · 2022-12-29T08:43:46.000Z

Why are you using a special podman package to install podman? On my udm se podman is available via apt:

podman/stable 3.0.1+dfsg1-3+deb11u1 arm64

Can't i just install podman via apt?

Answer 31 · 2022-12-29T11:02:40.000Z

For anyone looking to install Podman I put together a build here. It's distributed through a Debian package so easy to install and remove (setup could done easily as an on_boot script). It uses current versions of Podman and its dependencies. So far working well for me on my UDMP on 2.4 and I plan to maintain this going forward.

Heavily inspired by the work done in this repo and the comments here about getting podman running. Wanted to share as it seemed it might save some people headache getting it working.

I was getting this error

gpg --no-default-keyring \

--keyring /usr/share/keyrings/unifi-blueberry.gpg
--keyserver keyserver.ubuntu.com
--recv-keys C320FD3D3BF10DA7415B29F700CCEE392D0CA761
gpg: failed to create temporary file '/root/.gnupg/.#lk0x00000055821f3c30.UDM-Zinho.26885': No such file or directory
gpg: connecting dirmngr at '/root/.gnupg/S.dirmngr' failed: No such file or directory
gpg: keyserver receive failed: No dirmngr

Fixed running gpg -k

Answer 32 · 2022-12-30T00:58:43.000Z

Can't i just install podman via apt?

Erm. You know that's a good question—I never even tried, to be honest 😂

It doesn't seem to be available on my UDM (Unifi OS 2.4.x)—I get E: Unable to locate package podman. I'm guessing your UDMSE is using Unifi OS 3.x, not 2.x? The version number 3.0.1+dfsg1-3+deb11u1 suggests you're running Debian 11, while my UDM seems to be based on Debian 9.

That said, it's probably a good idea to try the Debian-provided package, if it's available. Easier to keep up-to-date with security patches, etc.

Answer 33 · 2022-12-30T07:46:28.000Z

Your are right. UDMSE is on v3.0.13. It is using debian 11.5. Installation of podman via apt is running through seamlessly. I haven't tried to run any containers yet.

Answer 34 · 2023-01-02T09:50:40.000Z

Been slowly following this as I've used unfios-utilities for a long while now.

Anyone know how how to create the following persistant route on a UDM Pro running 2.4x and have it stay after reboot?
Up until now I have been using unifios-utilities to achieve this. More to ensure the route is persistant after reboots.

ip rule add pref 32001 from 192.168.188.6 lookup 210
ip route add default via 192.168.189.254 dev eth8 table 210

This bascially tells machine 192.168.188.6 to use a default gateway of 192.168.189.254 via eth8 on the UDM Pro which is WAN2.

UDM Pro firmware 2.4.23

I can create this route easily via SSH but it wont stay after reboots anymore. Previous to the latest 2.4x firmware, unifios- utilities was required to keep persisting the route as it would be flushed after several seconds. On the new 2.4x firmware and the new archtecture, the routes seem to persist until reboot which is an improvement.

Answer 35 · 2023-01-02T12:20:06.000Z

Been slowly following this as I've used unfios-utilities for a long while now.

Anyone know how how to create the following persistant route on a UDM Pro running 2.4x and have it stay after reboot? Up until now I have been using unifios-utilities to achieve this. More to ensure the route is persistant after reboots.
ip rule add pref 32001 from 192.168.188.6 lookup 210
ip route add default via 192.168.189.254 dev eth8 table 210
This bascially tells machine 192.168.188.6 to use a default gateway of 192.168.189.254 via eth8 on the UDM Pro which is WAN2.

UDM Pro firmware 2.4.23

I can create this route easily via SSH but it wont stay after reboots anymore. Previous to the latest 2.4x firmware, unifios- utilities was required to keep persisting the route as it would be flushed after several seconds. On the new 2.4x firmware and the new archtecture, the routes seem to persist until reboot which is an improvement.

Have you tried adding this in a boot script?

Answer 36 · 2023-01-02T16:49:32.000Z

Have you tried adding this in a boot script?

Not using 2.4x firmware for the UDM Pro. I see above a few updates which provide an update of unifios-utilities for the 2.4x firmware. Would this be the simplest approach?

Answer 37 · 2023-01-03T23:08:00.000Z

Been slowly following this as I've used unfios-utilities for a long while now.

Anyone know how how to create the following persistant route on a UDM Pro running 2.4x and have it stay after reboot? Up until now I have been using unifios-utilities to achieve this. More to ensure the route is persistant after reboots.
ip rule add pref 32001 from 192.168.188.6 lookup 210
ip route add default via 192.168.189.254 dev eth8 table 210
This bascially tells machine 192.168.188.6 to use a default gateway of 192.168.189.254 via eth8 on the UDM Pro which is WAN2.

UDM Pro firmware 2.4.23

I can create this route easily via SSH but it wont stay after reboots anymore. Previous to the latest 2.4x firmware, unifios- utilities was required to keep persisting the route as it would be flushed after several seconds. On the new 2.4x firmware and the new archtecture, the routes seem to persist until reboot which is an improvement.

Have a look here for one possible solution. Replacing script contents w/your commands, obviously.

Answer 38 · 2023-01-07T11:23:34.000Z

Anyone know how how to create the following persistant route on a UDM Pro running 2.4x and have it stay after reboot? Up until now I have been using unifios-utilities to achieve this. More to ensure the route is persistant after reboots.
ip rule add pref 32001 from 192.168.188.6 lookup 210
ip route add default via 192.168.189.254 dev eth8 table 210
This bascially tells machine 192.168.188.6 to use a default gateway of 192.168.189.254 via eth8 on the UDM Pro which is WAN2.

Isn't this now possible in the default network app on the UI? Look for Settings / Traffic Management / Routes and create a route, select your device with IP 192.168.188.6 and select WAN2 as interface. I'm using it to send test traffic down my LTE failover while the main WAN is active.

Answer 39 · 2023-01-07T17:51:37.000Z

Anyone know how how to create the following persistant route on a UDM Pro running 2.4x and have it stay after reboot? Up until now I have been using unifios-utilities to achieve this. More to ensure the route is persistant after reboots.
ip rule add pref 32001 from 192.168.188.6 lookup 210
ip route add default via 192.168.189.254 dev eth8 table 210
This bascially tells machine 192.168.188.6 to use a default gateway of 192.168.189.254 via eth8 on the UDM Pro which is WAN2.
Isn't this now possible in the default network app on the UI? Look for Settings / Traffic Management / Routes and create a route, select your device with IP 192.168.188.6 and select WAN2 as interface. I'm using it to send test traffic down my LTE failover while the main WAN is active.

Yes and no. I can create select the device and select WAN2 but I need to change the default gateway of my specific device to use an upstream device which it doesnt allow. At least I have tried this and doesnt work.

Answer 40 · 2023-01-17T13:34:29.000Z

OK, everyone. I have merged all the changes that became of this. The remote_install.sh should work for 1.x and 2.x branches. Podman installs seem to work as well. Can anyone tell me different?

Answer 41 · 2023-01-21T16:40:52.000Z

Will there be a guide on how to install Podman and make on-boot script load with 2.4.X/2.5.X firmware offline? With current 1.12.X firmwsare it is easy because it simply requires uploading UDM-Boot.deb file to UniFi-OS shell and executing:
dpkg -i 4-UDM-Boot.deb
systemctl enable udm-boot

Can the same be done with UDM 2.4.X/2.5.X? Maybe downloadable Podman.deb + UDM-Boot.deb + some other commands to active bootable scripts?

Answer 42 · 2023-01-22T04:47:23.000Z

FIY - The upgrade to 2.x has been made available again - https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-26/6a9dc748-180b-4724-b6cf-0082554554fa

/edit: whoops, 2.4.26 has been pulled again due to issues some people experienced upgrading from 2.4.23 to 2.4.26 - https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-26/6a9dc748-180b-4724-b6cf-0082554554fa#comment/2e39aa03-c77b-486f-b1a6-9a9b098e71ef

As of now that means there is still no upgrade path from 1.x to 2.x for us folks that haven't upgraded yet

Answer 43 · 2023-01-24T10:54:16.000Z

Will there be a guide on how to install Podman and make on-boot script load with 2.4.X/2.5.X firmware offline? With current 1.12.X firmwsare it is easy because it simply requires uploading UDM-Boot.deb file to UniFi-OS shell and executing: dpkg -i 4-UDM-Boot.deb systemctl enable udm-boot

Can the same be done with UDM 2.4.X/2.5.X? Maybe downloadable Podman.deb + UDM-Boot.deb + some other commands to active bootable scripts?

#452

Answer 44 · 2023-01-24T11:31:21.000Z

Some findings....

There is a partition:

/dev/disk/by-partlabel/persistent  2.0G  200M  1.6G  11% /persistent

And content:

root@udmp:~# find /persistent/
/persistent/
/persistent/system
/persistent/dpkg
/persistent/dpkg/stretch
/persistent/dpkg/stretch/actions
/persistent/dpkg/stretch/actions/uid-agent
/persistent/dpkg/stretch/actions/libsigsegv2
/persistent/dpkg/stretch/actions/unifi-access
/persistent/dpkg/stretch/actions/unifi-pion-gw
/persistent/dpkg/stretch/actions/gawk
/persistent/dpkg/stretch/actions/unifi-base-ucore
/persistent/dpkg/stretch/actions/unifi-protect
/persistent/dpkg/stretch/actions/unifi
/persistent/dpkg/stretch/actions/unifi-talk
/persistent/dpkg/stretch/actions/udm-boot
/persistent/dpkg/stretch/actions/libmpfr4
/persistent/dpkg/stretch/packages
/persistent/dpkg/stretch/packages/unifi-pion-gw_1.0.26_arm64.deb
/persistent/dpkg/stretch/packages/libasound2-data_1.1.3-5_all.deb
/persistent/dpkg/stretch/packages/gawk_1:4.1.4+dfsg-1_arm64.deb
/persistent/dpkg/stretch/packages/libmpfr4_3.1.5-1_arm64.deb
/persistent/dpkg/stretch/packages/openjdk-11-jre-headless_11.0.6+10-1~bpo9+1_arm64.deb
/persistent/dpkg/stretch/packages/unifi-base-ucore_1.18.0_arm64.deb
/persistent/dpkg/stretch/packages/libasound2_1.1.3-5_arm64.deb
/persistent/dpkg/stretch/packages/unifi_7.3.83-19645-1_all.deb
/persistent/dpkg/stretch/packages/libsigsegv2_2.10-5_arm64.deb
/persistent/dpkg/stretch/status
/persistent/dpkg/stretch/status/unifi
/persistent/dpkg/stretch/status/ulp-go
/persistent/lost+found
/persistent/unifi-core
/persistent/unifi-core/setup.id
/persistent/report
/persistent/report/trace-1674558920-xdmg

Maybe as in 1.x releases, this can be used to reinstall packages automatically on at least minor firmware updates.
At least from the partition name and structure it could be interpreted as such functionality.

unifi_7.3.83-19645-1_all.deb represents my network version and was upgraded after the firmware 2.4.26 upgrade.
Also the files in actions contains kind of commands what to do with the packages...
i.e.
/persistent/dpkg/stretch/actions/unifi contains:

unpack

/persistent/dpkg/stretch/actions/unifi-protect and /persistent/dpkg/stretch/actions/unifi-access contains:

remove

If my interpretation is right, this makes sense, as I only have network (unifi) installed.

/persistent/dpkg/stretch/status/unifi may be related to services, as they contain enable.
Maybe usable to start a service with the same name as the file.

Answer 45 · 2023-01-27T06:10:00.000Z

Will there be a guide on how to install Podman and make on-boot script load with 2.4.X/2.5.X firmware offline? With current 1.12.X firmwsare it is easy because it simply requires uploading UDM-Boot.deb file to UniFi-OS shell and executing: dpkg -i 4-UDM-Boot.deb systemctl enable udm-boot
Can the same be done with UDM 2.4.X/2.5.X? Maybe downloadable Podman.deb + UDM-Boot.deb + some other commands to active bootable scripts?

#452

Great - thank you! Now if only someone could PM me with a link to privately uploaded UDM FW 2.4.6. That would be awesome and I would beging experimentation.

Answer 46 · 2023-01-30T13:41:46.000Z

2.4.27 came out today (https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-27/353e9672-ce67-4ed4-9b8f-4ebfcd92e90e). Migrated from 1.12.38.

Install script for udm tools ran without errors
No podman available after install
Installed podman from https://unifi.boostchicken.io
podman ps throws error: "ERRO[0000] Failed to built-in GetDriver graph btrfs /var/lib/containers/storage"
even after reboot

Answer 47 · 2023-01-30T20:07:28.000Z

2.4.27 came out today (https://community.ui.com/releases/UniFi-OS-Dream-Machines-2-4-27/353e9672-ce67-4ed4-9b8f-4ebfcd92e90e). Migrated from 1.12.38.
* Install script for udm tools ran without errors

* No podman available after install

> * Installed podman from https://unifi.boostchicken.io

* podman ps throws error: "ERRO[0000] Failed to built-in GetDriver graph btrfs /var/lib/containers/storage"

* even after reboot

I upgraded my UDM-Pro from 1.12.33 to 2.2.27 (via 1.12.38) today. As announced it broke my PiHole install. Trying to get it back. My initial install was about 2 years ago. Since then I only had to upgrade the Pihole image whenever a new version came out.

It seems quite a bit has changed/evolved on the 'boostchicken' side, so I am trying to get my bearings back (not that there was much to begin with... ).

I am now the point where unifi complains that I do not have podman installed. I tried "https://unifi.boostchicken.io" but this site does not seem to be available.

Any help would be greatly appreciated!

Answer 48 · 2023-01-30T20:29:27.000Z

@waffles0042 did you try https://github.com/unifi-blueberry/addon-podman as mentioned above?

I just tried that address and was able to access it:

Answer 49 · 2023-01-30T21:10:06.000Z

@waffles0042 did you try https://github.com/unifi-blueberry/addon-podman as mentioned above?

I just tried that address and was able to access it:

Thank you very much @pedropombeiro ; no I had not seen it. With that I was able to get podman to work. I also got the last part done: pihole is running again. Looks I am back in business again! Thanks much!

Answer 50 · 2023-01-31T09:21:16.000Z

on 2.4.27 on the udm pro podman works fine (https://github.com/unifi-utilities/unifios-utilities/tree/main/podman-install)
perfect for the udm pro is that you can outsource the storage to volume1. so now homeassistant works well without the memory being full from time to time.
just a namespace error popped up every now and then, but doesn't seem to get in the way of execution

Answer 51 · 2023-01-31T18:53:07.000Z

installed podman on 2.4.27 using the udmpro podman for the UDM base. for some reason it was defaulting to the udm se version for the udm base. went with udmpro since they share the same cpu (udm-base and udmp)

installed using the latest script for on_boot (1.0.6 at the time of this writing)
podman installed as expected on udm base once udmpro zip was specified from https://unifi.boostchicken.io/
got my wpa_supplicant up and running in no time :)

tl:dr -

it works on v1.0.6 but podman script is wonky had to specify udmpro zip on the udm base (egg unit)

Answer 52 · 2023-02-01T14:29:07.000Z

Went through the upgrade rodeo today on a normal UDM (not SE)

Podman from this repository didn't work, the blueberry version did. My other things look to be working fine so far (had to update /mnt/data to /data and CNI plugins script). Even the ansible scripts that I used to provision my UDM 1.x mostly worked without bigger changes.

Will monitor and report back!

Answer 53 · 2023-02-02T10:19:25.000Z

I am running into some weird podman (blueberry version) issues (may be configuration related, but wanted to share anyway).

After reboot, some containers (like homebridge) go into a state where podman reports them running:

podman ps
CONTAINER ID  IMAGE                             COMMAND     CREATED         STATUS            PORTS       NAMES
6240527c1fe9  docker.io/oznu/homebridge:latest              22 minutes ago  Up 7 minutes ago              homebridge

When I check the logs it seems like nothing is happening and they're just frozen, but when I try to exec into them:

podman exec -it homebridge sh
Error: OCI runtime error: runc: exec failed: cannot exec in a stopped container

podman restart homebridge
ERRO[0000] cannot start a container that has stopped
Error: `/usr/bin/runc start 6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7` failed: exit status 1

podman start homebridge

Error: unable to start container "6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7": container 6240527c1fe9eca0b1b50c79394bd68facbb2d175155dc65d9eca14f7283fcb7 must be in Created or Stopped state to be started: container state improper

Basically the container is reported as running, but completely unresponsive. If I recreate the container everything is good again, until UDM restarts.

Anyone noticing something similar?

/EDIT: I removed the blueberry version and installed the one from this repository, but forced udmpro instead of the default for my normal UDM. This version actually works so I think we need to update the podman script to select the udmpro variant instead

Answer 54 · 2023-02-12T18:29:55.000Z

@waffles0042 did you try https://github.com/unifi-blueberry/addon-podman as mentioned above?
I just tried that address and was able to access it:

Thank you very much @pedropombeiro ; no I had not seen it. With that I was able to get podman to work. I also got the last part done: pihole is running again. Looks I am back in business again! Thanks much!

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

Answer 55 · 2023-02-12T19:54:55.000Z

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

A little search for the warning yielded this, seeming to point that the warning is harmless:

https://pullanswer.com/questions/podman-4-3-issues-udm-se-2-5-11#28034155

Answer 56 · 2023-02-12T21:48:47.000Z

PiHole has been running fine since my UDMP upgrade to 2.x some 2 weeks ago. However, when I tried upgrading to the latest PiHole version by pulling the latest PiHole image I kept getting this warning "WARN[0000] Failed to read current user namespace mappings". PiHole still upgraded fine, but I am wondering how I could rid of the warning. Any help would be greatly appreciated!

A little search for the warning yielded this, seeming to point that the warning is harmless:

https://pullanswer.com/questions/podman-4-3-issues-udm-se-2-5-11#28034155

Thank you for your comment and the link. Thus far, I have not experienced any issues and all seems to be working for me. I am just not used to seeing this warning when upgrading my pihole container.

Answer 57 · 2023-02-13T15:20:29.000Z

I assume with Blueberry Podman DEB or the UDM-Boot 1.0.7, the DEB files can be installed with "dpkg -i" offline and doing so should recreate the on_boot.d directory...? Are there any other steps after running "dpkg -i"?

With firmware 1.X the DEB file had to be placed into UniFi-OS Shell directory and "dpkg -i" had to be performed from UniFi-OS Shell as well. In firmware 2.X, UniFi-OS Shell was removed. With UniFi-OS Shell removed, to where do I copy Blueberry Podman DEB or UDM-Boot 1.0.7 DEB files and from where do I run "dpkg -i" ? I need to perform the whole procedure offline.

Answer 58 · 2023-02-14T17:29:12.000Z

I just got the 2.x onto my UDMP today and am looking at putting back all the config I had (pi-hole, LE cert, fan silence DDNS)
One of the things I'm looking at is that the script to install puts to /data for the 2.x release, rather than /persistent (which seems to be the persistent 2G of storage.
Should I install there - i.e. modify the install script?

Answer 59 · 2023-02-14T18:17:52.000Z

I think it has something to do with this (last 3 bottom posts) - #472 .

Let us know how it goes. I am eager to jump to 2.4.7, but I want to make sure UDM-Boot is fully functional and doesn't have bugs installation bugs or other reported bugs.

Answer 60 · 2023-02-14T20:11:06.000Z

I have just updated to 2.x.
I moved my pi-hole off to a VM for the upgrade to make sure nothing broke too hard.
After reviewing the updated remote install script, I modified the directory to point to /persistent instead of /data (this line: https://github.com/unifi-utilities/unifios-utilities/blob/main/on-boot-script/remote_install.sh#L10)

I ran the installer script and all seemed to go well. I then installed the unify-blueberry 0.2.0 release of pod man and created the cloudflare-ddns updater and the pihole-dote container.

I needed to update some paths in the 05-install-cni-plugins.sh (change/mnt/data to /persistent) to make it work
I also needed to update udm-le with the new certificate paths; PR submitted to that repository.

It looks like the .deb on boot package is not required now? Just the systemd scripts? Is that the case?

And the fan control under 2.x is done without a boot script; apt install fan control and configure.

A relatively painless update?
It's nice to have rsync on the UDMP at last!

Answer 61 · 2023-02-14T21:21:00.000Z

Why have it in /persistent is important? Does it not persist if in /data directory?

Answer 62 · 2023-02-15T00:33:43.000Z

Why have it in /persistent is important? Does it not persist if in /data directory?

it does, /data is persisted between boot

Answer 63 · 2023-02-15T08:11:25.000Z

I just got "auto updated" last night and now my pihole is gone including podman.
It seems like the previous data directory is gone where the config for the docker containers was stored.
Is there any way to get it back?

Answer 64 · 2023-02-15T09:24:08.000Z

I just got "auto updated" last night and now my pihole is gone including podman.

It seems like the previous data directory is gone where the config for the docker containers was stored.

Is there any way to get it back?

Unfortunately no. Ubiquiti explicitly mentioned multiple times that all custom data will be gone after the upgrade / migration.
Tip, never let you UniFi OS console update automatically. I would recommend to always trigger an update manually. (And check beforehand the update notes.)

Answer 65 · 2023-02-15T13:58:59.000Z

I'm coming across a few issues after having upgraded to 2.4.27, with some paths not existing. For instance:

/etc/containers/libpod.conf referenced by 05-container-common.sh does not exist on my UDM Pro, so this script fails at startup.
Same thing for /etc/init.d/crond in 25-add-cron-jobs.sh.
podman is also really slow to pull/create containers, compared with 1.x.

Anyone else seeing this?

UPDATE: I went through each script to try to figure out what is happening, and for instance for crond I replaced it with cron. I have Pi-hole running again, although I lost its configuration and my latest backup is a bit too old. But at least I'm now on 2.4 with a working system and will be able to fix the remaining issues with time.

Answer 66 · 2023-02-15T15:38:57.000Z

Why have it in /persistent is important? Does it not persist if in /data directory?

it does, /data is persisted between boot

From reading #416 (comment), it would seem that the new unifi-os has a specific persistent partition for things that should not be removed, say during software upgrades.
I would prefer to keep all my custom config there, so as to try and minimize the breaks. Of course, this might be wiped too; but I think this /persistent area is supposed to be more persistent than the rest of the filesystem.

Answer 67 · 2023-02-15T15:51:58.000Z

/etc/containers/libpod.conf referenced by 05-container-common.sh does not exist on my UDM Pro, so this script fails at startup.

@pedropombeiro The /etc/containers/containers.conf has the log size config; this now seems a sensible default. In my install, I just removed the 05-container-common.sh script.

Answer 68 · 2023-02-15T21:19:11.000Z

Another thing that changed is the target location for firewall logs. They used to go to /var/log/messages, but now they go to /var/log/ulog/syslogemu.log.

Answer 69 · 2023-02-16T02:20:09.000Z

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error:
"Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting.
See system logs and 'systemctl status udm-boot.service' for details."

I don't get the same issue when I run the following commands that do spawn on_boot.d directory:
curl -fsL "https://raw.githubusercontent.com/unifi-utilities/unifios-utilities/HEAD/on-boot-script/remote_install.sh" | /bin/sh
curl -L https://unifi.boostchicken.io/udm-boot_1.0.7_all.deb -o udm-boot_1.0.7_all.deb
dpkg -i udm-boot_1.0.7_all.deb
systemctl enable udm-boot"

Any way to package the whole thing into one DEB file to make on_boot.d work from offline commands that don't download anything???

Where is SSH key store user private keys now? UDM now supports ED25519 keys. The script to persistant SSH key needs to be updated with whichever new directories that contain user private keys.

Answer 70 · 2023-02-16T03:49:54.000Z

UDM now supports ED25519 keys.

@GY8VSdYYzvL8-K6T where have you seen this? I have UniFi OS 2.4.27 and Network 7.3.83, and if I go to System/Advanced/Device Authentication, it only accepts public keys starting with ssh-rsa. It does not accept ones starting with ssh-ed25519 🤔

Answer 71 · 2023-02-16T14:19:54.000Z

That's different from root SSH access that can be enabled in the same place where you see "Turn Off" and "Restart" and "Factory Reset". If you enable SSH there, the machine signature fingerprint is ED25519. That means it recognizes ED25519. You can also go to "/etc/ssh" and see that it has "ssh_host_ed25519_key" key pairs that earlier versions of UDM Base/Pro doesn't have.

The Device Authentication Public Keys method can still be limited to RSA, but the root login should now accept ED25519 based on my findings. I just don't know where the "authorized_keys" file for root is located.

Answer 72 · 2023-02-16T14:30:15.000Z

I figured it out. You need to create "/root/.ssh" directory and within it create "authorized_keys" file. It does accept ED25519 keys that way.

Answer 73 · 2023-02-17T12:26:00.000Z

Does anyone experienced issues with podman pull on this new image? It feels like stuck a lot of times, also throwing errors like the following:

Error: writing blob: adding layer with blob "sha256:8f60cbaebd1956c10fac9cfb418e3540822764a32ca75c84fab37f51d6a4ee91": error creating layer with ID "cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775": open /var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/bin/bash: file exists

This has been thrown after several minutes of the pull process (while the image is relatively small. I am not sure how to debug this..If I rerun the pull command it will struck on another layer next time.

Answer 74 · 2023-02-17T12:48:22.000Z

@adradr Mine is also much slower than before. Regarding the errors, I'd check for free space in the /mnt/.rwfs volume (mine is at 72%, running Pi-hole and a couple of other smaller Docker containers). You can use df -h in the SSH terminal to check that.

Answer 75 · 2023-02-17T12:49:41.000Z

Does anyone experienced issues with podman pull on this new image? It feels like stuck a lot of times, also throwing errors like the following:
Error: writing blob: adding layer with blob "sha256:8f60cbaebd1956c10fac9cfb418e3540822764a32ca75c84fab37f51d6a4ee91": error creating layer with ID "cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775": open /var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/bin/bash: file exists
This has been thrown after several minutes of the pull process (while the image is relatively small. I am not sure how to debug this..If I rerun the pull command it will struck on another layer next time.

I realized I am running out of space regularly, this may cause this as I guess it takes more time after it downloads and unpacks.

du -h var/lib/containers/storage/vfs/dir | sort -rh | head -50
7.7G	var/lib/containers/storage/vfs/dir
558M	var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
558M	var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885
558M	var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8
458M	var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/usr
458M	var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885/usr
458M	var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8/usr
348M	var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a
348M	var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364
348M	var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646
326M	var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c
322M	var/lib/containers/storage/vfs/dir/e91301e27921bd5e8c8b8fc6cb270b27e4c3d884eb1364f29f847d76c10673bd
322M	var/lib/containers/storage/vfs/dir/713be83d1a358cc67c72886f38996210c7f5b058f5b46f5d4e17f650d2e94d05
322M	var/lib/containers/storage/vfs/dir/3225a77464ab369ff84b6967f60ae1118eb56d7e0e9fb06dd6e6a4940e14431a
273M	var/lib/containers/storage/vfs/dir/b7f0f96e44f53f3bf96f11b453f0256884536ecf3a076fb4096b247ef0eae637
273M	var/lib/containers/storage/vfs/dir/5167835fdf637c34ed1b38be543cfd940d678f6aa5e87b9aa2f6f4a668077fdf
248M	var/lib/containers/storage/vfs/dir/c2bd9a05e1df39428e99ddcfe16c36ec4789392eb024b0ad5d021b41bc8e508a
244M	var/lib/containers/storage/vfs/dir/e7332d099c1a06021c5b962992a8582a90fb734ff5c565264c13c7fc327a2e35
244M	var/lib/containers/storage/vfs/dir/dc1e957a23f7539e6799f677b0f4064c7a235eddb9155dc8399c375427b6edb9
244M	var/lib/containers/storage/vfs/dir/53ea01349548a91dc3d83a7738a688c9820351c74493e94670180e6f5cb52794
244M	var/lib/containers/storage/vfs/dir/4fed4bd926fddb8d0479c1d854bf8ac5e251ae426df23cd2327c960b0837194b
244M	var/lib/containers/storage/vfs/dir/48a0e0d88953e8eff8498efeb528a6c84d7f1ab36ed4f5605f0f8c20bd0a5ba1
235M	var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr
235M	var/lib/containers/storage/vfs/dir/e91301e27921bd5e8c8b8fc6cb270b27e4c3d884eb1364f29f847d76c10673bd/usr
235M	var/lib/containers/storage/vfs/dir/713be83d1a358cc67c72886f38996210c7f5b058f5b46f5d4e17f650d2e94d05/usr
235M	var/lib/containers/storage/vfs/dir/3225a77464ab369ff84b6967f60ae1118eb56d7e0e9fb06dd6e6a4940e14431a/usr
225M	var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775/usr/lib
225M	var/lib/containers/storage/vfs/dir/c4477b3d9e2471c3f6b6cef62c594a187192eba3ba655812a6607dcbbdb52885/usr/lib
225M	var/lib/containers/storage/vfs/dir/bf2c66849a48371d155758f9879ec6d3a8a70b830dd8d0b726b10a6effba84b8/usr/lib
214M	var/lib/containers/storage/vfs/dir/e7332d099c1a06021c5b962992a8582a90fb734ff5c565264c13c7fc327a2e35/usr
214M	var/lib/containers/storage/vfs/dir/dc1e957a23f7539e6799f677b0f4064c7a235eddb9155dc8399c375427b6edb9/usr
214M	var/lib/containers/storage/vfs/dir/53ea01349548a91dc3d83a7738a688c9820351c74493e94670180e6f5cb52794/usr
214M	var/lib/containers/storage/vfs/dir/4fed4bd926fddb8d0479c1d854bf8ac5e251ae426df23cd2327c960b0837194b/usr
214M	var/lib/containers/storage/vfs/dir/48a0e0d88953e8eff8498efeb528a6c84d7f1ab36ed4f5605f0f8c20bd0a5ba1/usr
203M	var/lib/containers/storage/vfs/dir/dd9e5b0fbdb2e827bc5d43fabf1b83f80f31e5ffa35aa145e3f80d33a4a4cb94
203M	var/lib/containers/storage/vfs/dir/5a00e8151a01d969f19f45d2a88b9150ba8bbdb810a09a6529493df356834d92
178M	var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a/tmp
178M	var/lib/containers/storage/vfs/dir/b7f0f96e44f53f3bf96f11b453f0256884536ecf3a076fb4096b247ef0eae637/usr
178M	var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364/tmp
178M	var/lib/containers/storage/vfs/dir/5167835fdf637c34ed1b38be543cfd940d678f6aa5e87b9aa2f6f4a668077fdf/usr
178M	var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646/tmp
175M	var/lib/containers/storage/vfs/dir/a2a755c9fe4e76a4de40b7ce5a60a1e3dfadbc61591304fb662a569a19d44a05
175M	var/lib/containers/storage/vfs/dir/3edb4cf7d3ab9ef4dd747aec6b838a0b523a7d12df93fc2c3e683fa4fd43ef83
174M	var/lib/containers/storage/vfs/dir/dfdc5c43aa32ed9a80c13ddbb82ba412ff26cb5195450697245e017c7b93ec5a/tmp/openresty
174M	var/lib/containers/storage/vfs/dir/520faad0dbc3b761f35aac1b6a4fb14a52b0cf8dd741befe0f25e77b2aa79364/tmp/openresty
174M	var/lib/containers/storage/vfs/dir/17901b3132741066229e4fc6bf7a6bd7fdfea2739f982624a43a8c29f321e646/tmp/openresty
173M	var/lib/containers/storage/vfs/dir/768a8fa550669457265dac388e1d8780a421a1d7f0d2ced1a3a18d0a900e0b7e
173M	var/lib/containers/storage/vfs/dir/739c028509638f32f8867f82ccbaca554ca3495546c8df562b3ae1f1e4be1a41
173M	var/lib/containers/storage/vfs/dir/06448847114b3176a050c39f95fa0acbacd92aa0bd15702b77e129f3bdafc3e5
171M	var/lib/containers/storage/vfs/dir/e6494cc329aa71fa31f2402a5860168ffab861762392d14b1eef87f08e0504f2

I am not really what are these containers. I woke up today that my UDM Pro auto-updated to 2.4.27 and my pihole and proxymanager disappeared. I am still in the process of understanding what this update brought in terms of changes.

I am reconfiguring my previous setup, and only have pihole running yet, so unsure about these containers in /mnt/.rwfs/data/var/lib/.

podman ps
CONTAINER ID  IMAGE                           COMMAND     CREATED      STATUS          PORTS       NAMES
fae3f45f1245  docker.io/pihole/pihole:latest              2 hours ago  Up 2 hours ago              pihole

Answer 76 · 2023-02-17T13:49:29.000Z

I'd do a podman system prune -a to clean up all Docker state and recover that disk space.

Answer 77 · 2023-02-17T16:03:36.000Z

Maybe also move the podman container storage area out to your hard-drive partition?
/etc/containers/storage.conf configures.

Answer 78 · 2023-02-17T16:54:01.000Z

@emlynmac the /persistent partition

Maybe also move the podman container storage area out to your hard-drive partition?
/etc/containers/storage.conf configures.

@emlynmac That's a good idea. Do I need to write a on_boot.d script to make that change on every boot?

Answer 79 · 2023-02-17T16:56:29.000Z

Can someone who is not using podman (or has moved its storage to the hard-drive) please confirm that the /var/lib/containers/storage path is empty? I stopped all containers and pruned the docker system, but there are still 3.6G laying there:

$ du -h -d 1 /var/lib/containers/storage
3.6G	/var/lib/containers/storage/vfs
156K	/var/lib/containers/storage/libpod
1.7M	/var/lib/containers/storage/vfs-layers
4.0K	/var/lib/containers/storage/tmp
4.0K	/var/lib/containers/storage/mounts
92K	/var/lib/containers/storage/vfs-containers
60K	/var/lib/containers/storage/vfs-images
4.0K	/var/lib/containers/storage/secrets
3.6G	/var/lib/containers/storage

Answer 80 · 2023-02-17T17:00:09.000Z

@emlynmac the /persistent partition

Maybe also move the podman container storage area out to your hard-drive partition?
/etc/containers/storage.conf configures.

@emlynmac That's a good idea. Do I need to write a on_boot.d script to make that change on every boot?
@pedropombeiro
I edited to the hard drive parition as the /persistent is capped at 2G.
Either would work I think, just moves it off the root fs.

I would think that the configuration is persisted, and installed with the initial version with whatever comes with the Podman .deb package.

Answer 81 · 2023-02-17T17:03:08.000Z

I'm a bit concerned by the 2.4.27 release, in terms of CPU usage:

Before the update, the CPU usage hovered around 20% for weeks in a very stable manner, but now there are periods where the java process just goes into overdrive :-/

Answer 82 · 2023-02-17T17:09:03.000Z

@pedropombeiro what tool are you getting those nice graphics from?

Answer 83 · 2023-02-17T17:13:43.000Z

@pedropombeiro what tool are you getting those nice graphics from?

I have the node-exporter Docker container running on the UDM Pro, and then I have a Grafana server running on my NAS pulling the stats, with the stock node-exporter dashboard.

Answer 84 · 2023-02-17T17:21:47.000Z

I'd do a podman system prune -a to clean up all Docker state and recover that disk space.

I did a pruning but it was able to prune 0B of space. Still don't understand what occupies that much space since I only have one pihole running.

df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   31M  365M   8% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  9.2G     0 100% /mnt/.rwfs
overlayfs-root                     9.3G  9.2G     0 100% /
/dev/disk/by-partlabel/log         976M   73M  837M   8% /var/log
/dev/disk/by-partlabel/persistent  2.0G   11M  1.8G   1% /persistent
tmpfs                              2.0G  104K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
tmpfs                               16M  9.7M  6.4M  61% /var/log/ulog
shm                                 63M  2.9M   60M   5% /var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/shm
tmpfs                               64M 1020K   64M   2% /var/opt/unifi/tmp

Answer 85 · 2023-02-17T17:25:06.000Z

@adradr did you try delving into /mnt/.rwfs with du -h -d 1 /mnt/.rwfs and proceeding downwards to pinpoint what is causing the 100% usage?

Answer 86 · 2023-02-17T17:27:57.000Z

For future reference, confirmed that the changes to /etc/containers/storage.conf persist with reboots:

$ docker info
...
store:
  configFile: /etc/containers/storage.conf
  containerStore:
    number: 4
    paused: 0
    running: 4
    stopped: 0
  graphDriverName: vfs
  graphOptions: {}
  graphRoot: /volume1/var/lib/containers/storage
  graphRootAllocated: 117610516480
  graphRootUsed: 47095312384
  graphStatus: {}
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 4
  runRoot: /volume1/run/containers/storage
  volumePath: /volume1/var/lib/containers/storage/volumes
...

Answer 87 · 2023-02-17T17:53:15.000Z

Checked which processes were using any of the files under /var/lib/containers

lsof +D /var/lib/containers

and deleted it given no processes had any files open there, saving a further 3.6GB:

My /mnt/.rwfs volume is now only 21%:

$ df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   41M  355M  11% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  1.8G  7.0G  21% /mnt/.rwfs
overlayfs-root                     9.3G  1.8G  7.0G  21% /
/dev/disk/by-partlabel/log         976M  129M  781M  15% /var/log
/dev/disk/by-partlabel/persistent  2.0G  259M  1.6G  15% /persistent
tmpfs                              2.0G  108K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
/dev/sda1                          110G   44G   65G  41% /volume1
tmpfs                               16M  844K   16M   6% /var/log/ulog
shm                                 63M  7.4M   56M  12% /volume1/var/lib/containers/storage/vfs-containers/83157258d55cec3d5091d9d407116aae1bea073750335826f805418b1c2bafa3/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/0d8851a757fcb1ba2fbd364b0a95bb6dd1634117fac1c2416eefc2adebdaef94/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/bad5d869bfa1c46dfa95768dd28cb4f65054142db92e1d4ed12f39ab5e6b46e4/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/d1982d622961729964126ad7e704c13bbc0f393989fbb0ca58de8564c7d4bdc5/userdata/shm
tmpfs                               64M     0   64M   0% /var/opt/unifi/tmp
tmpfs                              512M  4.1M  508M   1% /var/opt/unifi-protect/tmp

Answer 88 · 2023-02-17T18:35:37.000Z

Checked which processes were using any of the files under /var/lib/containers

lsof +D /var/lib/containers

and deleted it given no processes had any files open there, saving a further 3.6GB:

My /mnt/.rwfs volume is now only 21%:

$ df -h
Filesystem                         Size  Used Avail Use% Mounted on
udev                               2.0G     0  2.0G   0% /dev
tmpfs                              395M   41M  355M  11% /run
/dev/disk/by-partlabel/root        2.0G  839M  996M  46% /boot/firmware
/dev/loop0                         833M  833M     0 100% /mnt/.rofs
/dev/disk/by-partlabel/overlay     9.3G  1.8G  7.0G  21% /mnt/.rwfs
overlayfs-root                     9.3G  1.8G  7.0G  21% /
/dev/disk/by-partlabel/log         976M  129M  781M  15% /var/log
/dev/disk/by-partlabel/persistent  2.0G  259M  1.6G  15% /persistent
tmpfs                              2.0G  108K  2.0G   1% /dev/shm
tmpfs                              5.0M     0  5.0M   0% /run/lock
tmpfs                              2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                              987M   72K  987M   1% /tmp
/dev/sda1                          110G   44G   65G  41% /volume1
tmpfs                               16M  844K   16M   6% /var/log/ulog
shm                                 63M  7.4M   56M  12% /volume1/var/lib/containers/storage/vfs-containers/83157258d55cec3d5091d9d407116aae1bea073750335826f805418b1c2bafa3/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/0d8851a757fcb1ba2fbd364b0a95bb6dd1634117fac1c2416eefc2adebdaef94/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/bad5d869bfa1c46dfa95768dd28cb4f65054142db92e1d4ed12f39ab5e6b46e4/userdata/shm
shm                                 63M     0   63M   0% /volume1/var/lib/containers/storage/vfs-containers/d1982d622961729964126ad7e704c13bbc0f393989fbb0ca58de8564c7d4bdc5/userdata/shm
tmpfs                               64M     0   64M   0% /var/opt/unifi/tmp
tmpfs                              512M  4.1M  508M   1% /var/opt/unifi-protect/tmp

I did an lsof also and I noticed my currently running container only uses a small portion of the files under /mnt/.rwfs/..

podman ps
CONTAINER ID  IMAGE                           COMMAND     CREATED      STATUS          PORTS       NAMES
fae3f45f1245  docker.io/pihole/pihole:latest              8 hours ago  Up 5 hours ago              pihole

Based on this this is my container id fae3f45f1245 and if you take a look at the lsof output only the first 5 entries are related to my running container:

lsof +D /mnt/.rwfs/data/var/lib/containers
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
lsof: no pwd entry for UID 999
COMMAND     PID     USER   FD   TYPE DEVICE SIZE/OFF   NODE NAME
conmon     2419     root    6w   REG  135,6    40110 404873 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctr.log
conmon     2419     root   12r  FIFO  135,6      0t0 404886 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctl
conmon     2419     root   14w  FIFO  135,6      0t0 404886 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/ctl
conmon     2419     root   15r  FIFO  135,6      0t0 404887 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/winsz
conmon     2419     root   16w  FIFO  135,6      0t0 404887 /mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca/userdata/winsz
s6-svscan  2481     root  txt    REG  135,6    42168 547424 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-svscan
s6-svscan  2481     root    3w   REG  135,6        0 549533 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/lock
s6-svscan  2481     root    5r  FIFO  135,6      0t0 549534 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/control
s6-svscan  2481     root    6w  FIFO  135,6      0t0 549534 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/.s6-svscan/control
s6-superv  2581     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2581     root    3w   REG  135,6        0 549535 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/lock
s6-superv  2581     root    4r  FIFO  135,6      0t0 549536 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/control
s6-superv  2581     root    5w  FIFO  135,6      0t0 549536 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/supervise/control
s6-linux-  2583     root  txt    REG  135,6    42152 547445 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-linux-init-1.0.8.0/command/s6-linux-init-shutdownd
s6-linux-  2583     root    3r  FIFO  135,6      0t0 549532 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/fifo
s6-linux-  2583     root    4w  FIFO  135,6      0t0 549532 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/service/s6-linux-init-shutdownd/fifo
s6-superv  2611     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2611     root    3w   REG  135,6        0 612298 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/lock
s6-superv  2611     root    4r  FIFO  135,6      0t0 612299 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/control
s6-superv  2611     root    5w  FIFO  135,6      0t0 612299 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-oneshot-runner/supervise/control
s6-superv  2612     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2612     root    3w   REG  135,6        0 612284 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/lock
s6-superv  2612     root    4r  FIFO  135,6      0t0 612290 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/control
s6-superv  2612     root    5w  FIFO  135,6      0t0 612290 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/supervise/control
s6-superv  2613     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2613     root    3w   REG  135,6        0 612287 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/lock
s6-superv  2613     root    4r  FIFO  135,6      0t0 612306 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/control
s6-superv  2613     root    5w  FIFO  135,6      0t0 612306 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/supervise/control
s6-superv  2614     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2614     root    3w   REG  135,6        0 612302 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/lock
s6-superv  2614     root    4r  FIFO  135,6      0t0 612303 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/control
s6-superv  2614     root    5w  FIFO  135,6      0t0 612303 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-access-log/supervise/control
s6-superv  2615     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2615     root    3w   REG  135,6        0 612296 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/lock
s6-superv  2615     root    4r  FIFO  135,6      0t0 612314 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/control
s6-superv  2615     root    5w  FIFO  135,6      0t0 612314 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/s6rc-fdholder/supervise/control
s6-superv  2616     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2616     root    3w   REG  135,6        0 612276 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/lock
s6-superv  2616     root    4r  FIFO  135,6      0t0 612313 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/control
s6-superv  2616     root    5w  FIFO  135,6      0t0 612313 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/supervise/control
s6-superv  2617     root  txt    REG  135,6    50408 547415 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-supervise
s6-superv  2617     root    3w   REG  135,6        0 612308 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/lock
s6-superv  2617     root    4r  FIFO  135,6      0t0 612309 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/control
s6-superv  2617     root    5w  FIFO  135,6      0t0 612309 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd-error-log/supervise/control
s6-ipcser  2626     root  txt    REG  135,6    29912 547402 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/package/admin/s6-2.11.1.2/command/s6-ipcserverd
bash       2651     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2651     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2651     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2651     root  255r   REG  135,6       69 612252 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/cron/run
cron       2659     root  txt    REG  135,6    51560 277778 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/sbin/cron
cron       2659     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547083 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libcap-ng.so.0.0.0 (path dev=0,19, inode=2258)
cron       2659     root  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547076 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libaudit.so.1.0.0 (path dev=0,19, inode=2247)
cron       2659     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547143 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libselinux.so.1 (path dev=0,19, inode=2367)
cron       2659     root  mem    REG  135,6          547125 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpam.so.0.85.1 (stat: No such file or directory)
cron       2659     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
cron       2659     root    3u   REG  135,6        3 549549 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/crond.pid
bash       2844     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2844     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2844     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2844     root  255r   REG  135,6     2361 612254 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/pihole-FTL/run
bash       2851     root  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
bash       2851     root  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
bash       2851     root  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       2851     root  255r   REG  135,6     1291 612270 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/s6-rc:s6-rc-init:GDFHCc/servicedirs/lighttpd/run
lighttpd   2857 www-data  txt    REG  135,6   375208 277801 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/sbin/lighttpd
lighttpd   2857 www-data  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147387 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_staticfile.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147368 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_dirlisting.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147373 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_fastcgi.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147362 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_accesslog.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147383 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_setenv.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147378 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_redirect.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147364 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_alias.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147361 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_access.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          147375 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/lighttpd/mod_indexfile.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          146682 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxxhash.so.0.8.0 (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          146618 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libnettle.so.8.4 (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data  mem    REG  135,6          547132 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpcre.so.3.13.3 (path dev=0,19, inode=2352)
lighttpd   2857 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lighttpd   2857 www-data    3w   REG  135,6        4 549564 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/run/lighttpd.pid
lighttpd   2857 www-data    5w   REG  135,6      941 532814 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/error-pihole.log
lighttpd   2857 www-data    6w   REG  135,6      358 549565 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/access.log
lighttpd   2857 www-data    7w   REG  135,6    37656 546492 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/lighttpd/access-pihole.log
lsof: no pwd entry for UID 999
bash       2870      999  txt    REG  135,6  1282512 545828 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/bin/bash
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
lsof: no pwd entry for UID 999
bash       2870      999  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  txt    REG  135,6 20089760 547936 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/pihole-FTL
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547118 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_dns-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          146491 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/gconv/gconv-modules.cache (path dev=0,19, inode=5467)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547120 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libnss_files-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
lsof: no pwd entry for UID 999
pihole-FT  2873      999   26w   REG  135,6 10977280 549553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/var/log/pihole/pihole.log
php-cgi    2918 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2918 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2918 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2918 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2918 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2918 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2918 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2962 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2962 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2962 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2962 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2962 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2962 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2963 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2963 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2963 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2963 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2963 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2963 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2964 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2964 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2964 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2964 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2964 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2964 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  txt    REG  135,6  4598608 547932 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/bin/php-cgi7.4
php-cgi    2965 www-data  mem    REG  135,6          547100 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgpg-error.so.0.29.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146553 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libgcrypt.so.20.2.8 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146543 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libexslt.so.0.8.20 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146678 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxslt.so.1.1.34 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277704 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xsl.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277703 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlwriter.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277702 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xmlreader.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277700 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/tokenizer.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277699 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvshm.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277698 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvsem.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277697 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sysvmsg.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277696 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sqlite3.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277695 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/sockets.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277694 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/simplexml.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277693 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/shmop.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146608 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libmd.so.0.0.4 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146524 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libbsd.so.0.11.3 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547150 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libtinfo.so.6.2 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146537 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libedit.so.2.0.63 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277692 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/readline.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277691 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/posix.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277690 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/phar.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146655 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsqlite3.so.0.8.6 (path dev=0,19, inode=5834)
php-cgi    2965 www-data  mem    REG  135,6          277689 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo_sqlite.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277686 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/json.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146569 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicui18n.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146571 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuio.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267060 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/intl.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267059 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/iconv.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267058 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/gettext.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267057 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ftp.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267056 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/fileinfo.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146545 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libffi.so.7.1.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267055 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ffi.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267054 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/exif.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267053 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/dom.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267052 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/ctype.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          267051 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/calendar.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277701 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/xml.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277688 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/pdo.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547141 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/librt-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          277687 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/php/20190902/opcache.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547098 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libgcc_s.so.1 (path dev=0,19, inode=2282)
php-cgi    2965 www-data  mem    REG  135,6          146660 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libstdc++.so.6.0.28 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146567 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicudata.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547106 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/liblzma.so.5.2.5 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146577 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libicuuc.so.67.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547135 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libpthread-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547080 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libc-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146653 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libsodium.so.23.3.0 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547156 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libz.so.1.2.11 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146633 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libpcre2-8.so.0.10.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146525 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libcrypto.so.1.1 (path dev=0,19, inode=5546)
php-cgi    2965 www-data  mem    REG  135,6          146658 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libssl.so.1.1 (path dev=0,19, inode=5838)
php-cgi    2965 www-data  mem    REG  135,6          146676 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libxml2.so.2.9.10 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547090 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libdl-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547107 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libm-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547139 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/libresolv-2.31.so (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          146509 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/usr/lib/aarch64-linux-gnu/libargon2.so.1 (stat: No such file or directory)
php-cgi    2965 www-data  mem    REG  135,6          547068 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c/lib/aarch64-linux-gnu/ld-2.31.so (stat: No such file or directory)
bash       7645     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
lsof      11293     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775
lsof      11294     root  cwd    DIR  135,6     4096 515635 /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/cdfdaf5ca65d47f0b8997b4e4029e1b5d98d46651112459240f6ec00b5270775

Answer 89 · 2023-02-17T18:36:38.000Z

Did you install podman using this method (updated 2 weeks ago)?

Answer 90 · 2023-02-17T18:39:37.000Z

Did you install podman using this method (updated 2 weeks ago)?

No, I used the unifi-blueberry DEB package from #416 (comment)

Answer 91 · 2023-02-17T22:47:54.000Z

Did you install podman using this method (updated 2 weeks ago)?

No, I used the unifi-blueberry DEB package from #416 (comment)

Thanks I will take a look. I used the method I linked. Otherwise it works okay, but no docker / docker compose yet.

@adradr did you try delving into /mnt/.rwfs with du -h -d 1 /mnt/.rwfs and proceeding downwards to pinpoint what is causing the 100% usage?

Now I opened the folders under /mnt/.rwfs/var/lib/containers/storage/vfs/dir/.. and it seems like there are 3 types of duplicates with modifications dates before the 2.4.27 upgrade. Before the upgrade I hasn't been using "external" storage drive for podman. But what I don't understand that the changelog states that everything will be lost in the upgrade. Can it be that somehow there are still files remained after the upgrade? And it seems like one of these was the previous pihole container from before the UDM update. 10 Feb 16 00:57 pihole.docker.tag

cd /mnt/.rwfs/data/var/lib/containers/storage/vfs/dir; for i in $(ls ); do ls -lhta $i;done

total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:44 ./
drwxr-xr-x 37 root root 4.0K Nov  7 22:49 etc/
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:41 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:38 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:39 ./
drwxrwxrwt  4 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:38 ./
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:37 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 44 root root 4.0K Feb 16 00:57 etc/
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:35 ./
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:47 ./
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:40 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:43 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:45 ./
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:45 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:44 ./
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxr-xr-x 37 root root 4.0K Nov  7 22:49 etc/
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:38 ./
drwxrwxrwt  3 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:39 ./
drwxrwxrwt  4 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:33 ./
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 bin/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x 30 root root 4.0K Feb  8 14:00 etc/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 sbin/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 var/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:36 ./
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x 28 root root 4.0K Oct 24 02:00 etc/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:47 ./
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:49 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:19 root/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:46 ./
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
drwx------  3 root root 4.0K Nov  7 22:52 root/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 13:25 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:20 root/
drwxrwxrwt  2 root root 4.0K Nov  7 23:20 tmp/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 13:24 ./
drwxr-xr-x 41 root root 4.0K Nov  7 23:20 etc/
drwx------  4 root root 4.0K Nov  7 23:20 root/
drwxr-xr-x  8 root root 4.0K Nov  7 23:19 lib/
drwxr-xr-x  2 root root 4.0K Nov  7 23:18 bin/
-rw-r--r--  1 root root  152 Nov  7 23:17 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 23:00 tmp/
drwxr-xr-x  3 root root 4.0K Nov  7 23:00 opt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:37 ./
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x 28 root root 4.0K Oct 24 02:00 etc/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 80K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:34 ./
drwxr-xr-x 43 root root 4.0K Feb 12 03:17 etc/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x 11 root root 4.0K Feb  8 14:00 usr/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:45 ./
drwxr-xr-x 39 root root 4.0K Nov  7 22:52 etc/
-rw-r--r--  1 root root   96 Nov  7 22:52 built-for-arch
drwxrwxrwt  2 root root 4.0K Nov  7 22:49 tmp/
drwxr-xr-x  7 root root 4.0K Nov  7 22:49 lib/
drwx------  3 root root 4.0K Nov  7 22:48 root/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:42 ./
drwxrwxrwt  5 root root 4.0K Nov  7 22:47 tmp/
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
drwx------  2 root root 4.0K Nov  7 22:21 root/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 12:37 ./
drwxr-xr-x 34 root root 4.0K Nov  7 22:21 etc/
-rw-r--r--  1 root root   38 Nov  7 22:19 built-for-arch
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 bin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 dev/
drwxr-xr-x  7 root root 4.0K Oct 24 02:00 lib/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 media/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 mnt/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 opt/
drwx------  2 root root 4.0K Oct 24 02:00 root/
drwxr-xr-x  3 root root 4.0K Oct 24 02:00 run/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 sbin/
drwxr-xr-x  2 root root 4.0K Oct 24 02:00 srv/
drwxrwxrwt  2 root root 4.0K Oct 24 02:00 tmp/
drwxr-xr-x 10 root root 4.0K Oct 24 02:00 usr/
drwxr-xr-x 11 root root 4.0K Oct 24 02:00 var/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 boot/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 home/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 proc/
drwxr-xr-x  2 root root 4.0K Sep  3 14:00 sys/
total 84K
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 20 root root 4.0K Feb 17 11:38 ./
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 44 root root 4.0K Feb 16 00:57 etc/
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 opt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  3 root root 4.0K Feb  8 14:00 run/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxrwxrwt  2 root root 4.0K Feb  8 14:00 tmp/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
total 3.0M
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:44 ./
-rw-r--r--  1 root root    0 Feb 16 01:00 .piholeFirstBoot
drwxrwxrwt  3 root root 4.0K Feb 16 01:00 tmp/
drwxr-xr-x 47 root root 4.0K Feb 16 00:59 etc/
drwxr-xr-x  5 root root 4.0K Feb 16 00:59 run/
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/
total 3.0M
drwxrwxrwt  3 root root 4.0K Feb 17 23:17 tmp/
drwxr-xr-x 47 root root 4.0K Feb 17 14:45 etc/
drwxr-xr-x  9 root root 4.0K Feb 17 14:45 run/
drwx------ 32 root root 4.0K Feb 17 13:31 ../
dr-xr-xr-x 22 root root 4.0K Feb 17 11:49 ./
drwxr-xr-x  3 root root 4.0K Feb 16 00:59 opt/
-rw-r--r--  1 root root 2.9M Feb 16 00:59 macvendor.db
-rw-r--r--  1 root root   10 Feb 16 00:57 pihole.docker.tag
drwxr-xr-x 11 root root 4.0K Feb 16 00:57 usr/
drwxr-xr-x  2 root root 4.0K Feb 12 03:07 bin/
drwxr-xr-x  2 root root 4.0K Feb 12 03:06 sbin/
drwxr-xr-x 12 root root 4.0K Feb 12 03:06 var/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 dev/
drwxr-xr-x  8 root root 4.0K Feb  8 14:00 lib/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 media/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 mnt/
drwx------  2 root root 4.0K Feb  8 14:00 root/
drwxr-xr-x  2 root root 4.0K Feb  8 14:00 srv/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 boot/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 home/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 proc/
drwxr-xr-x  2 root root 4.0K Dec  9 20:15 sys/
drwxr-xr-x  2 root root  12K Jun 29  2022 command/
-rwxr-xr-x  1 root root  907 Jun 29  2022 s6-init*
drwxr-xr-x  6 root root 4.0K Jun 29  2022 package/

Answer 92 · 2023-02-17T22:52:05.000Z

Another thing I noticed in the lsof +D /mnt/.rwfs/data/var/lib/containers is that most of the output contains an error stat: No such file or directory at the end of its NAME column. So if I filter out these lines I get 3 directories which I guess are actually read. One of these matches my currently running podman pihole container.

/mnt/.rwfs/data/var/lib/containers/storage/vfs-containers/fae3f45f124598ea127b9871209b9ca45640469183b2525d26f8d7b4277490ca
/mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/e9a92843fe59b7d888a7b03c10c6025dddf0414369548df458735341d5927e7c
/mnt/.rwfs/data/var/lib/containers/storage/vfs/dir/06448847114b3176a050c39f95fa0acbacd92aa0bd15702b77e129f3bdafc3e5

Do you think I could remove the rest of the folders? @pedropombeiro

Answer 93 · 2023-02-17T23:40:06.000Z

Before the upgrade I hasn't been using "external" storage drive for podman.

Correct me if I'm wrong, but you don't seem to be using an external storage drive for podman in 2.4.27 either. My external SSD drive is at /volume1.

Do you think I could remove the rest of the folders? @pedropombeiro

Personally, I wouldn't touch it while podman is running. If you have an external drive, I would stop podman, delete all images/containers, change /etc/containers/storage.conf to point to the external volume, bring the containers back up, and then delete the /var/lib/containers/storage directory.

Answer 94 · 2023-02-18T08:11:35.000Z

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error: "Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting. See system logs and 'systemctl status udm-boot.service' for details."

@GY8VSdYYzvL8-K6T have you found a solution for it? I have just upgraded and running into the same issue.

Update
I've updated /lib/systemd/system/udm-boot.service and changed ExecStart to

ExecStart=bash -c 'mkdir -p /data/on_boot.d && find -L /data/on_boot.d -mindepth 1 -maxdepth 1 -type f -print0 | sort -z | xargs -0 -r -n 1 -- sh -c '\''if test -x "$0"; then echo "%n: running $0"; "$0"; else case "$0" in *.sh) echo "%n: sourcing $0"; . "$0";; *) echo "%n: ignoring $0";; esac; fi'\'

As it needs bash to run and was also using the wrong paths. I got the info from the udmse_on_boot_systemd function from the install script, which I didn't use (stupid me). If using the script it should be fine

Answer 95 · 2023-02-18T16:42:54.000Z

There are quite a few new things, but in relation to UDM-Boot, when I run "dpkg -i UDM-Boot.deb" command, on_boot.d directory doesn't spawn and I get this error: "Failed to restart udm-boot.service: Unit udm-boot.service has a bad unit file setting. See system logs and 'systemctl status udm-boot.service' for details."

@GY8VSdYYzvL8-K6T have you found a solution for it? I have just upgraded and running into the same issue.

Update I've updated /lib/systemd/system/udm-boot.service and changed ExecStart to
ExecStart=bash -c 'mkdir -p /data/on_boot.d && find -L /data/on_boot.d -mindepth 1 -maxdepth 1 -type f -print0 | sort -z | xargs -0 -r -n 1 -- sh -c '\''if test -x "$0"; then echo "%n: running $0"; "$0"; else case "$0" in *.sh) echo "%n: sourcing $0"; . "$0";; *) echo "%n: ignoring $0";; esac; fi'\'
As it needs bash to run and was also using the wrong paths. I got the info from the udmse_on_boot_systemd function from the install script, which I didn't use (stupid me). If using the script it should be fine

I don't know Linux scripting and commands that well. I know the remote script works without any errors and creates the needed on-boot directory, but it also installs Podman, which I do not think I need because I use simple on-boot scripts, such as SysCTL tweaks, IPTables, EBTables, IFConfig, and don't use any additional applications. Maybe I am wrong and I do need Podman for such scripts...?

This is the working script I mentioned above:
curl -fsL "https://raw.githubusercontent.com/unifi-utilities/unifios-utilities/HEAD/on-boot-script/remote_install.sh" | /bin/sh

I am not able to extract needed information from it to isolate the parts I need (on-boot directory and on-boot service without podman).

I'd appreciate if someone can just create a fully functional DEB file I can use offline after factory reset without having to be connected to the Internet.

Answer 96 · 2023-02-18T16:55:29.000Z

Before the upgrade I hasn't been using "external" storage drive for podman.

Correct me if I'm wrong, but you don't seem to be using an external storage drive for podman in 2.4.27 either. My external SSD drive is at /volume1.

Do you think I could remove the rest of the folders? @pedropombeiro

Personally, I wouldn't touch it while podman is running. If you have an external drive, I would stop podman, delete all images/containers, change /etc/containers/storage.conf to point to the external volume, bring the containers back up, and then delete the /var/lib/containers/storage directory.

I tried the method you mentioned but does not wants to update podman to the new path... I even removed the podman install script from on_boot.d and installed podman using the .deb package you mentioned from another thread.

cat /etc/containers/storage.conf

[storage]
driver = "vfs"
runroot = "/volume1/run/containers/storage"
graphroot = "/volume1/var/lib/containers/storage"

podman info

WARN[0000] Failed to read current user namespace mappings
host:
  arch: arm64
  buildahVersion: 1.28.0
...
store:
  configFile: /etc/containers/storage.conf
...
  graphDriverName: vfs
...
  graphRoot: /var/lib/containers/storage
  graphRootAllocated: 9935884288
  graphRootUsed: 9086468096
  graphStatus: {}
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 1
  runRoot: /run/containers/storage
  volumePath: /var/lib/containers/storage/volumes
...

Answer 97 · 2023-02-19T03:38:41.000Z

I own an UDMB currently running on 1.12.38.

First question may I know if i need to remove all the container in podman except unifiOS before upgrade?

Second question is do the latest release work on unifiOS 2.x?

Thanks for help.

This is my first time comment here

Answer 98 · 2023-02-19T03:39:56.000Z

You don't need to remove anything. The upgrade process will wipe your UDM so make sure you have a backup

And yes the latest releases work on unifiOS 2.x. Sometimes a bit wonky but so far no major issues besides what's written in this thread

Answer 99 · 2023-02-19T04:01:24.000Z

You don't need to remove anything. The upgrade process will wipe your UDM so make sure you have a backup

And yes the latest releases work on unifiOS 2.x. Sometimes a bit wonky but so far no major issues besides what's written in this thread

Cool! Good to hear, once the upgrade complete I follow the instructions in the main page and I will be good to go?

Thanks again!

Answer 100 · 2023-02-19T07:46:03.000Z

Cool! Good to hear, once the upgrade complete I follow the instructions in the main page and I will be good to go?

Yep, just install by running the script. This will correct issues with systems as well. Also if you use podman make sure to follow the instructions here:
https://github.com/unifi-utilities/unifios-utilities/tree/main/podman-install