Cannot run docker image: ModuleNotFoundError: No module named 'av'
Closed this issue · 4 comments
The problem
Built the image per the instructions. When attempting docker run, I get:
[ ok ] Starting Avahi mDNS/DNS-SD Daemon: avahi-daemon.
Traceback (most recent call last):
File "ap2-receiver.py", line 25, in <module>
from ap2.connections.stream import Stream
File "/airplay2/ap2/connections/stream.py", line 5, in <module>
from .audio import AudioRealtime, AudioBuffered
File "/airplay2/ap2/connections/audio.py", line 7, in <module>
import av
ModuleNotFoundError: No module named 'av'
What commit exhibits the issue?
Was there a last known working commit?
No response
What type of installation are you running?
Docker
With which python3 version do you run Receiver?
3.9.2
OS the receiver runs on
Raspberry Pi OS
OS the sender runs
Raspberry Pi OS
Which sender client was used
No response
Command invocation
docker run -it --rm --device /dev/snd --net host --volume pwd/pairings/:/airplay2/pairings/ ap2-receiver
Please include --debug output which helps to illustrate the problem
[ ok ] Starting Avahi mDNS/DNS-SD Daemon: avahi-daemon.
Traceback (most recent call last):
File "ap2-receiver.py", line 25, in
from ap2.connections.stream import Stream
File "/airplay2/ap2/connections/stream.py", line 5, in
from .audio import AudioRealtime, AudioBuffered
File "/airplay2/ap2/connections/audio.py", line 7, in
import av
ModuleNotFoundError: No module named 'av'
Additional information
Built docker image using the command in readme.md. Only one error (red): debconf: delaying package configuration, since apt-utils is not installed. apt-utils is, in fact, installed though. Module av is also installed on the host, although not sure if that's relevant even.
Same issue here. Theres nothing left to be added.
This bug appears to have been introduced by commit 1bb03ca (PR link), I can't recreate it in earlier commits.
I'm a bit perplexed by what's happening, but I have a consistent/quick way of reproducing it on my M1 Mac:
docker build -f docker/Dockerfile -t ap2-receiver .
docker run -it --entrypoint bash ap2-receiver # launch a bash shell
# commands to run in the bash shell
pip3 freeze | grep av # av should be in the freeze output, but it's not...
# you can see python3.7 site-packages has the av files
root@e397a60f713e:/# ls -l /usr/lib/python3.7/site-packages/
total 8
drwxr-xr-x 11 root root 4096 May 3 18:24 av
drwxr-xr-x 2 root root 4096 May 3 18:24 av-9.2.0-py3.7.egg-info
# Also notice the directory above is NOT in sys.path
root@0b83343bf3e4:/# python3 -m site
sys.path = [
'/',
'/usr/lib/python37.zip',
'/usr/lib/python3.7',
'/usr/lib/python3.7/lib-dynload',
'/usr/local/lib/python3.7/dist-packages',
'/usr/lib/python3/dist-packages',
]
# All the other packages are in two other directories that ARE in sys.path
root@e397a60f713e:/# ls /usr/lib/python3/dist-packages/
Crypto keyring
PyAudio-0.2.11.egg-info keyring-17.1.1.egg-info
PyGObject-3.30.4.egg-info keyrings
SecretStorage-2.3.1.egg-info keyrings.alt-3.1.1.egg-info
__pycache__ pip
_cffi_backend.cpython-37m-aarch64-linux-gnu.so pip-18.1.egg-info
_dbus_bindings.cpython-37m-aarch64-linux-gnu.so pkg_resources
_dbus_glib_bindings.cpython-37m-aarch64-linux-gnu.so pyaudio.py
_portaudio.cpython-36m-aarch64-linux-gnu.so pycrypto-2.6.1.egg-info
_portaudio.cpython-37m-aarch64-linux-gnu.so pygtkcompat
asn1crypto pyxdg-0.25.egg-info
asn1crypto-0.24.0.egg-info secretstorage
cryptography setuptools
cryptography-2.6.1.egg-info setuptools-40.8.0.egg-info
dbus six-1.12.0.egg-info
easy_install.py six.py
entrypoints.egg-info wheel
entrypoints.py wheel-0.32.3.egg-info
gi xdg
root@0b83343bf3e4:/# ls /usr/local/lib/python3.7/dist-packages/
Crypto ifaddr
__pycache__ ifaddr-0.1.7.dist-info
biplist netifaces-0.11.0.egg-info
biplist-1.0.3.egg-info netifaces.cpython-37m-aarch64-linux-gnu.so
certifi numpy
certifi-2021.10.8.dist-info numpy-1.21.6-py3.7.egg-info
charset_normalizer pycryptodome-3.14.1.egg-info
charset_normalizer-2.0.12.dist-info requests
data requests-2.27.1.dist-info
hexdump-3.3.egg-info srptools
hexdump.py srptools-1.0.1.dist-info
hkdf-0.0.3.egg-info urllib3
hkdf.py urllib3-1.26.9.dist-info
idna zeroconf
idna-3.3.dist-info zeroconf-0.38.3.dist-info
Removing --no-cache-dir from the Dockerfile pip install fixes the issue. Additionally, the av files move from /usr/lib/python3.7/site-packages/ to /usr/local/lib/python3.7/dist-packages/.
I was able to track this down to a specific version of the av library. With --no-cache-dir enabled in the pip install, everything works fine with av==8.1.0 and fails with av==9.0.0, which was tagged in March 2022 (av release history).
However, version 8.1.0 doesn't appear to work properly on ARM, it gives an error first reported in 2019 (av github issue)
>>> import av
eTraceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.7/dist-packages/av/__init__.py", line 9, in <module>
from av._core import time_base, pyav_version as __version__, library_versions
ImportError: /usr/lib/aarch64-linux-gnu/libgomp.so.1: cannot allocate memory in static TLS block
This can be worked around with LD_PRELOAD=/usr/lib/aarch64-linux-gnu/libgomp.so.1