theohbrothers/docker-packer

CI runner running out of disk space for job with many incremental builds

Opened this issue · 0 comments

Bug

https://github.com/theohbrothers/docker-packer/actions/runs/6309620603/attempts/2

build-1-7-7-ubuntu-20-04
The job running on runner GitHub Actions 2 has exceeded the maximum execution time of 360 minutes.

build-1-7-7-ubuntu-20-04
Runner GitHub Actions 2 did not respond to a cancelation request with 00:05:00.

build-1-7-7-ubuntu-20-04
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 64 MB

df -h output of job:

                total        used        free      shared  buff/cache   available
Mem:         7088112      576932     5216364       22548     1294816     6170180
Swap:        4194300           0     4194300
Filesystem      Size  Used Avail Use% Mounted on
/dev/root        84G   65G   19G  78% /
tmpfs           3.4G  172K  3.4G   1% /dev/shm
tmpfs           1.4G  1.1M  1.4G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/sdb15      105M  6.1M   99M   6% /boot/efi
/dev/sda1        14G  4.1G  9.0G  31% /mnt
tmpfs           693M   12K  693M   1% /run/user/1001

Expectation

No error.

Discussion

Upon rerunning the job, it succeeded. df -h:

                total        used        free      shared  buff/cache   available
Mem:         7088120      585224     5207600       22008     1295296     6162548
Swap:        4194300           0     4194300
Filesystem      Size  Used Avail Use% Mounted on
/dev/root        84G   62G   22G  75% /
tmpfs           3.4G  172K  3.4G   1% /dev/shm
tmpfs           1.4G  1.1M  1.4G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/sda15      105M  6.1M   99M   6% /boot/efi
/dev/sdb1        14G  4.1G  9.0G  31% /mnt
tmpfs           693M   12K  693M   1% /run/user/1001

Hence it might be a random unfortunate circumstance where a runner had less disk space than most shared runners.