ninja: build stopped: subcommand failed.
kurugai opened this issue · 2 comments
The following error occurs during installation. I don't know why. I hope you can tell me the solution.
language : python 3.10
environment: win11 wsl ubuntu
conda create -n exui python=3.10
conda activate exui
git clone https://github.com/turboderp/exui
cd exui
pip install -r requirements.txt
python server.py
[18/38] c++ -MMD -MF ext_bindings.o.d -DTORCH_EXTENSION_NAME=exllamav2_ext -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -I/root/miniconda3/envs/exui/lib/python3.10/site-packages/exllamav2/exllamav2_ext -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/TH -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/THC -isystem /root/miniconda3/envs/exui/include/python3.10 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++17 -O3 -c /root/miniconda3/envs/exui/lib/python3.10/site-packages/exllamav2/exllamav2_ext/ext_bindings.cpp -o ext_bindings.o ninja: build stopped: subcommand failed.
The compilation error happened before that message, and I would guess it's due to not having the CUDA toolkit installed? You can try installing one of the prebuilt ExLlamaV2 wheels if that's the case.
@turboderp Thank you for your reply. I've tried the way you told me many times, but it didn't work out if my computer environment was weird. But I had a docker image on Reddit that someone else created, so I used it and succeeded.