libnd4j compilation error

Question

libnd4j compilation error

gbalanyi opened this issue a year ago · 2 comments

gbalanyi commented a year ago

Issue Description

Build failed when compile libnd4j cudnn sources.

Version Information

Please indicate relevant versions, including, if relevant:

Deeplearning4j version: 1.0.0-SNAPSHOT
Platform information (OS, etc): Nvidia Jetson, JetPack 5.1.1(R35 (release), REVISION: 3.1)
CUDA version: 11.4

Additional Information

[ 79%] Building CUDA object blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/cudnnUtils.cu.o
cd /mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/blas && /usr/local/cuda-11.4/bin/nvcc -DSD_ALL_OPS=1 -DSD_CUDA=true -D__CUDABLAS=true -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/flatbuffers-src/include -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/include -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include -allow-unsupported-compiler -allow-unsupported-compiler -Xcompiler=-fPIC -DCUDA_VERSION_MAJOR=11 -w --cudart=static --expt-extended-lambda -Xfatbin -compress-all -gencode arch=compute_72,code=sm_72 -O3 -DNDEBUG -x cu -c /mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu -o CMakeFiles/samediff_obj.dir/__/include/ops/declarable/platform/cudnn/cudnnUtils.cu.o
/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool2d.cu(61): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool2d.cu(61): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool2d.cu(113): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const int, int, sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(60): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(61): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(70): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(124): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(125): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu(141): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu(297): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu(298): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu(470): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu(471): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu(472): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

[ 79%] Building CUDA object blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/depthwiseConv2d.cu.o
cd /mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/blas && /usr/local/cuda-11.4/bin/nvcc -DSD_ALL_OPS=1 -DSD_CUDA=true -D__CUDABLAS=true -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/flatbuffers-src/include -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/blasbuild/cuda/include -I/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include -allow-unsupported-compiler -allow-unsupported-compiler -Xcompiler=-fPIC -DCUDA_VERSION_MAJOR=11 -w --cudart=static --expt-extended-lambda -Xfatbin -compress-all -gencode arch=compute_72,code=sm_72 -O3 -DNDEBUG -x cu -c /mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu -o CMakeFiles/samediff_obj.dir/__/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu.o
/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(42): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, const int, const sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(137): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, const int, const sd::NDArray, const sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(289): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (__nv_bool, int, sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(292): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(316): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(406): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (int, int, sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(410): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(412): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(443): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu(463): error: no instance of overloaded function "sd::NDArray::permutei" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

3 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool2d.cu".
34 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/avgpool3d.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9917: blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/avgpool2d.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9930: blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/avgpool3d.cu.o] Error 1
5 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/batchnorm.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9943: blas/CMakeFiles/samediff_obj.dir/__/include/ops/declarable/platform/cudnn/batchnorm.cu.o] Error 1
/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(44): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(44): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(45): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(152): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(153): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(321): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(322): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(324): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(341): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(426): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(427): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(430): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(452): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(468): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu(488): error: no instance of overloaded function "sd::NDArray::permutei" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

13 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv2d.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9956: blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/conv2d.cu.o] Error 1
68 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/conv3d.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9969: blas/CMakeFiles/samediff_obj.dir//include/ops/declarable/platform/cudnn/conv3d.cu.o] Error 1
/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(106): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, int, const sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(160): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, int, const sd::NDArray, const sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(223): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(224): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(290): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu(291): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

30 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/cudnnUtils.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:9995: blas/CMakeFiles/samediff_obj.dir/__/include/ops/declarable/platform/cudnn/cudnnUtils.cu.o] Error 1
/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(47): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, int, const sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(150): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (const __nv_bool, int, const sd::NDArray, const sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(311): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (int, int, sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(315): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(342): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(423): error: no instance of overloaded function "sd::ops::ConvolutionUtils::getSizesAndIndexesConv2d" matches the argument list
argument types are: (int, int, sd::NDArray, sd::NDArray, int, int, int, int, int, int, int, int, int, int, int, int, int)

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(428): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(430): error: a reference of type "sd::LongType &" (not const-qualified) cannot be initialized with a value of type "int"

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(467): error: no instance of overloaded function "sd::NDArray::permute" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu(481): error: no instance of overloaded function "sd::NDArray::permutei" matches the argument list
argument types are: (std::vector<int, std::allocator>)
object type is: sd::NDArray

13 errors detected in the compilation of "/mnt/ssd/development/dl4j/deeplearning4j/libnd4j/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu".
make[2]: *** [blas/CMakeFiles/samediff_obj.dir/build.make:10008: blas/CMakeFiles/samediff_obj.dir/__/include/ops/declarable/platform/cudnn/depthwiseConv2d.cu.o] Error 1

Answer 1 · 2023-05-20T19:51:26.000Z

@gbalanyi thanks for flagging! That's because you enabled cudnn. I'll fix that up today. I just need to finish migrating our platform specific ops to use our new long indexing.

Answer 2 · 2023-06-23T08:53:57.000Z

This was fixed long ago.