abetlen/llama-cpp-python

Prebuilt cuda wheel has a GLIBC version mismatch on Ubuntu 20.04.

Opened this issue · 0 comments

I use pip to install this wheel successfully: https://github.com/abetlen/llama-cpp-python/releases/download/v0.2.90-cu124/llama_cpp_python-0.2.90-cp312-cp312-linux_x86_64.whl

When running, it says RuntimeError: Failed to load shared library '/usr/local/anaconda3/envs/py312cuda124/lib/python3.12/site-packages/llama_cpp/lib/libllama.so': /lib/x86_64-linux-gnu/libc.so.6: version 'GLIBC_2.32' not found (required by /usr/local/anaconda3/envs/py312cuda124/lib/python3.12/site-packages/llama_cpp/lib/libllama.so)

After searching, my ubuntu 20.04 only has GLIBC 2.31. Is this wheel built in a higher ubuntu version? Which wheel is built in 20.04?