Failed to build PyTorch extension on Amazon Linux 2
Opened this issue · 1 comments
informatter commented
Hi guys,
I am trying to build the Pytorch extension on an Amazon Linux 2. Below are my current env details:
Conda version: 23.11.0
Python version: 3.11.5
torch version: 2.1.2+cu118
torchvision version: 0.16.2+cu118
CUDA version 11.8
GPU: Tesla T4
Driver Version: 470.182.03
Before running the below command I made sure to add my CUDA env variables to the .bashrc
file:
export PATH=/usr/local/cuda-11.8/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda-11.8/targets/x86_64-linux/lib:$LD_LIBRARY_PATH
pip install -v git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch
I get the following log ( + errors):
Cloning https://github.com/NVlabs/tiny-cuda-nn/ to /tmp/pip-req-build-xifev91j
Running command git version
git version 2.40.1
Running command git clone --filter=blob:none https://github.com/NVlabs/tiny-cuda-nn/ /tmp/pip-req-build-xifev91j
Cloning into '/tmp/pip-req-build-xifev91j'...
Running command git rev-parse HEAD
c12645dfbac707ccd82907a209edff9b258f1e3d
Resolved https://github.com/NVlabs/tiny-cuda-nn/ to commit c12645dfbac707ccd82907a209edff9b258f1e3d
Running command git submodule update --init --recursive -q
Running command git rev-parse HEAD
c12645dfbac707ccd82907a209edff9b258f1e3d
Running command python setup.py egg_info
/tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import parse_version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
Building PyTorch extension for tiny-cuda-nn version 1.7
Obtained compute capability 75 from PyTorch
Detected CUDA version 11.8
Targeting C++ standard 17
running egg_info
creating /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info
writing /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/dependency_links.txt
writing top-level names to /tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/top_level.txt
writing manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
writing manifest file '/tmp/pip-pip-egg-info-3u5s_mcl/tinycudann.egg-info/SOURCES.txt'
Preparing metadata (setup.py) ... done
Building wheels for collected packages: tinycudann
Running command python setup.py bdist_wheel
/tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import parse_version
Building PyTorch extension for tiny-cuda-nn version 1.7
Obtained compute capability 75 from PyTorch
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
Detected CUDA version 11.8
Targeting C++ standard 17
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-311
creating build/lib.linux-x86_64-cpython-311/tinycudann
copying tinycudann/__init__.py -> build/lib.linux-x86_64-cpython-311/tinycudann
copying tinycudann/modules.py -> build/lib.linux-x86_64-cpython-311/tinycudann
running egg_info
creating tinycudann.egg-info
writing tinycudann.egg-info/PKG-INFO
writing dependency_links to tinycudann.egg-info/dependency_links.txt
writing top-level names to tinycudann.egg-info/top_level.txt
writing manifest file 'tinycudann.egg-info/SOURCES.txt'
reading manifest file 'tinycudann.egg-info/SOURCES.txt'
writing manifest file 'tinycudann.egg-info/SOURCES.txt'
copying tinycudann/bindings.cpp -> build/lib.linux-x86_64-cpython-311/tinycudann
running build_ext
/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py:424: UserWarning: There are no g++ version bounds defined for CUDA version 11.8
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'tinycudann_bindings._75_C' extension
creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies
creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt
creating /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src
creating /tmp/pip-req-build-xifev91j/bindings/torch/src
creating /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311
creating /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311/tinycudann
Emitting ninja build file /tmp/pip-req-build-xifev91j/bindings/torch/build/temp.linux-x86_64-cpython-311/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cpp_api.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o
/home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cpp_api.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cpp_api.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
from /tmp/pip-req-build-xifev91j/src/cpp_api.cu:30:
/tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
#include <filesystem>
^~~~~~~~~~~~
compilation terminated.
[2/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/encoding.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o
/home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/encoding.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/encoding.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/object.h:32,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/encoding.h:33,
from /tmp/pip-req-build-xifev91j/src/encoding.cu:30:
/tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
#include <filesystem>
^~~~~~~~~~~~
compilation terminated.
[3/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/common_host.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o
/home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/common_host.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/common_host.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
from /tmp/pip-req-build-xifev91j/src/common_host.cu:31:
/tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
#include <filesystem>
^~~~~~~~~~~~
compilation terminated.
[4/10] /home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
FAILED: /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o
/home/ec2-user/miniconda3/envs/nerfstudio/bin/nvcc -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu -o /tmp/pip-req-build-xifev91j/bindings/torch/src/cutlass_mlp.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -std=c++17 --extended-lambda --expt-relaxed-constexpr -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -Xcompiler=-Wno-float-conversion -Xcompiler=-fno-strict-aliasing -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
In file included from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cpp_api.h:32:0,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/common_host.h:33,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/cuda_graph.h:32,
from /tmp/pip-req-build-xifev91j/include/tiny-cuda-nn/networks/cutlass_mlp.h:34,
from /tmp/pip-req-build-xifev91j/src/cutlass_mlp.cu:31:
/tmp/pip-req-build-xifev91j/dependencies/json/json.hpp:3954:14: fatal error: filesystem: No such file or directory
#include <filesystem>
^~~~~~~~~~~~
compilation terminated.
[5/10] c++ -MMD -MF /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/os.o.d -pthread -B /home/ec2-user/miniconda3/envs/nerfstudio/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/dependencies/fmt/src/os.cc -o /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/os.o -std=c++17 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
[6/10] c++ -MMD -MF /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/format.o.d -pthread -B /home/ec2-user/miniconda3/envs/nerfstudio/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -O2 -isystem /home/ec2-user/miniconda3/envs/nerfstudio/include -fPIC -I/tmp/pip-req-build-xifev91j/include -I/tmp/pip-req-build-xifev91j/dependencies -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/include -I/tmp/pip-req-build-xifev91j/dependencies/cutlass/tools/util/include -I/tmp/pip-req-build-xifev91j/dependencies/fmt/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/TH -I/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/include/THC -I/home/ec2-user/miniconda3/envs/nerfstudio/include -I/home/ec2-user/miniconda3/envs/nerfstudio/include/python3.11 -c -c /tmp/pip-req-build-xifev91j/dependencies/fmt/src/format.cc -o /tmp/pip-req-build-xifev91j/bindings/torch/dependencies/fmt/src/format.o -std=c++17 -DTCNN_PARAMS_UNALIGNED -DTCNN_MIN_GPU_ARCH=75 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_75_C -D_GLIBCXX_USE_CXX11_ABI=0
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2100, in _run_ninja_build
subprocess.run(
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/tmp/pip-req-build-xifev91j/bindings/torch/setup.py", line 189, in <module>
setup(
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/wheel/bdist_wheel.py", line 364, in run
self.run_command("build")
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 131, in run
self.run_command(cmd_name)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 88, in run
_build_ext.run(self)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
self.build_extensions()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 873, in build_extensions
build_ext.build_extensions(self)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
self._build_extensions_serial()
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
self.build_extension(ext)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 249, in build_extension
_build_ext.build_extension(self, ext)
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 686, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/home/ec2-user/miniconda3/envs/nerfstudio/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2116, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/ec2-user/miniconda3/envs/nerfstudio/bin/python3 -u -c '
exec(compile('"'"''"'"''"'"'
# This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
#
# - It imports setuptools before invoking setup.py, to enable projects that directly
# import from `distutils.core` to work with newer packaging standards.
# - It provides a clear error message when setuptools is not installed.
# - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
# setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
# manifest_maker: standard file '"'"'-c'"'"' not found".
# - It generates a shim setup.py, for handling setup.cfg-only projects.
import os, sys, tokenize
try:
import setuptools
except ImportError as error:
print(
"ERROR: Can not execute `setup.py` since setuptools is not available in "
"the build environment.",
file=sys.stderr,
)
sys.exit(1)
__file__ = %r
sys.argv[0] = __file__
if os.path.exists(__file__):
filename = __file__
with tokenize.open(__file__) as f:
setup_py_code = f.read()
else:
filename = "<auto-generated setuptools caller>"
setup_py_code = "from setuptools import setup; setup()"
exec(compile(setup_py_code, filename, "exec"))
'"'"''"'"''"'"' % ('"'"'/tmp/pip-req-build-xifev91j/bindings/torch/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-k6sekdbd
cwd: /tmp/pip-req-build-xifev91j/bindings/torch
Building wheel for tinycudann (setup.py) ... error
ERROR: Failed building wheel for tinycudann
Running setup.py clean for tinycudann
Running command python setup.py clean
/tmp/pip-req-build-xifev91j/bindings/torch/setup.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import parse_version
Building PyTorch extension for tiny-cuda-nn version 1.7
Obtained compute capability 75 from PyTorch
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
Detected CUDA version 11.8
Targeting C++ standard 17
running clean
'build/lib.linux-x86_64-cpython-311' does not exist -- can't clean it
'build/bdist.linux-x86_64' does not exist -- can't clean it
'build/scripts-3.11' does not exist -- can't clean it
Failed to build tinycudann
ERROR: Could not build wheels for tinycudann, which is required to install pyproject.toml-based projects
From the logs is quite hard for me to see what could be the error. Is it perhaps my python version causing problems?
Any help would be great
Thanks
Goulustis commented
From chatgpt, it seems like you need C++17 standard.