Docker container error: Could not load library libcudnn_ops_infer.so.8

Question

Docker container error: Could not load library libcudnn_ops_infer.so.8

Closed this issue 3 months ago · 2 comments

The error message is as follows:

Client 583ffd78-2bfe-4e1e-bbbc-8efed00e1904 connected
2024-05-20T08:38:53.837582891Z Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory

Answer 1 · 2024-05-20T09:28:47.000Z

The NVIDIA CUDA® Deep Neural Network library (cuDNN) is included in runtime docker image.

Overview of NVIDA Docker images

Answer 2 · 2024-05-30T03:30:41.000Z

If someone encounters the above issue in a local development environment (without using Docker), you can refer to this issue:

SYSTRAN/faster-whisper#516

I am using a venv-based virtual environment locally, so I add the following environment variable when starting:

# Replace <path-to-repo> with the actual path
LD_LIBRARY_PATH=<path-to-repo>/.venv/lib64/python3.10/site-packages/nvidia/cudnn/lib/