facebookresearch/Aria_data_tools

Docker Build Errors Out - Could not find a package configuration file provided by "vrslib"

Closed this issue · 5 comments

Hey all,

I'm building the docker image from scratch on Mac OS X with Docker Desktop and it errors out on the cmake step 6/9.
I'm on the current latest commit: 1f86023.

(base) dkukreja@macbook-pro-4 Aria_data_tools % docker build . --network=host -t aria_data_tools
[+] Building 0.5s (10/13)                                                                                                 
 => [internal] load build definition from Dockerfile                                                                 0.0s
 => => transferring dockerfile: 37B                                                                                  0.0s
 => [internal] load .dockerignore                                                                                    0.0s
 => => transferring context: 2B                                                                                      0.0s
 => [internal] load metadata for docker.io/library/ubuntu:focal                                                      0.2s
 => [1/9] FROM docker.io/library/ubuntu:focal@sha256:af5efa9c28de78b754777af9b4d850112cad01899a5d37d2617bb94dc63a49  0.0s
 => [internal] load build context                                                                                    0.1s
 => => transferring context: 20.41kB                                                                                 0.0s
 => CACHED [2/9] RUN if type sudo 2>/dev/null; then      echo "The sudo command already exists... Skipping.";     e  0.0s
 => CACHED [3/9] RUN apt-get update --fix-missing && DEBIAN_FRONTEND="noninteractive" TZ="America/New_York" apt-get  0.0s
 => CACHED [4/9] ADD ./ /opt/aria_data_tools                                                                         0.0s
 => CACHED [5/9] RUN cd /opt/aria_data_tools/src/scripts/; sh ./install_deps_debian.sh                               0.0s
 => ERROR [6/9] RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEA  0.2s
------                                                                                                                    
 > [6/9] RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;:                                                                                                           
#10 0.083 -- The CXX compiler identification is GNU 9.4.0
#10 0.087 -- Check for working CXX compiler: /usr/bin/c++
#10 0.143 -- Check for working CXX compiler: /usr/bin/c++ -- works
#10 0.144 -- Detecting CXX compiler ABI info
#10 0.204 -- Detecting CXX compiler ABI info - done
#10 0.213 -- Detecting CXX compile features
#10 0.213 -- Detecting CXX compile features - done
#10 0.216 CMake Error at CMakeLists.txt:31 (find_package):
#10 0.216   By not providing "Findvrslib.cmake" in CMAKE_MODULE_PATH this project has
#10 0.216   asked CMake to find a package configuration file provided by "vrslib", but
#10 0.216   CMake did not find one.
#10 0.216 
#10 0.216   Could not find a package configuration file provided by "vrslib" with any
#10 0.216   of the following names:
#10 0.216 
#10 0.216     vrslibConfig.cmake
#10 0.216     vrslib-config.cmake
#10 0.216 
#10 0.216   Add the installation prefix of "vrslib" to CMAKE_PREFIX_PATH or set
#10 0.216   "vrslib_DIR" to a directory containing one of the above files.  If "vrslib"
#10 0.216   provides a separate development package or SDK, be sure it has been
#10 0.216   installed.
#10 0.216 
#10 0.216 
#10 0.217 -- Configuring incomplete, errors occurred!
#10 0.217 See also "/opt/aria_data_tools_Build/CMakeFiles/CMakeOutput.log".
------
executor failed running [/bin/sh -c mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;]: exit code: 1

To replicate:

git clone https://github.com/facebookresearch/Aria_data_tools/
cd Aria_data_tools
git checkout 1f86023b2c38eb6f5ce735062739bd08ffff9493
docker build . --network=host -t aria_data_tools

Is this a known issue, and is there a workaround?

@devanshk thank you for your feedback and reporting the error to us.
A fix is coming and it will ping this thread when it will land on Github.

Fix landed, please checkout and let us know the output ;-) (feel free to reopen if error is not fixed)

Hey @SeaOtocinclus, thanks for looking into this. Still hitting the same error on the latest commit with the same commands. Tried to docker build on an M1 Macbook pro and also on Linux 5.4.0-81-generic x86_64.

Looks like a build error on vrs in step [5/6]

Cloning into 'vrs'...
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_CXX_COMPILER: /usr/bin/c++
-- CMAKE_CXX_COMPILER_VERSION: 9.4.0
-- Found Boost: /usr/lib/aarch64-linux-gnu/cmake/Boost-1.71.0/BoostConfig.cmake (found version "1.71.0") found components: filesystem chrono date_time system thread 
-- Found Lz4: /usr/lib/aarch64-linux-gnu/liblz4.so  
-- Found Zstd: /usr/lib/aarch64-linux-gnu/libzstd.so  
-- Found xxHash: /usr/lib/aarch64-linux-gnu/libxxhash.so  
-- Found ZLIB: /usr/lib/aarch64-linux-gnu/libz.so (found version "1.2.11") 
-- Found PNG: /usr/lib/aarch64-linux-gnu/libpng.so (found version "1.6.37") 
-- Found JPEG: /usr/lib/aarch64-linux-gnu/libjpeg.so (found version "80") 
CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message):
  Could NOT find TurboJpeg (missing: TurboJpeg_LIBRARIES
  TurboJpeg_INCLUDE_DIRS)
Call Stack (most recent call first):
  /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:393 (_FPHSA_FAILURE_MESSAGE)
  cmake/FindTurboJpeg.cmake:27 (find_package_handle_standard_args)
  cmake/LibrariesSetup.cmake:30 (find_package)
  CMakeLists.txt:54 (include)

It should be noted that adding 'libturbojpeg-dev' to install_deps_debian hits another error:

Cloning into 'vrs'...
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_CXX_COMPILER: /usr/bin/c++
-- CMAKE_CXX_COMPILER_VERSION: 9.4.0
-- Found Boost: /usr/lib/aarch64-linux-gnu/cmake/Boost-1.71.0/BoostConfig.cmake (found version "1.71.0") found components: filesystem chrono date_time system thread 
-- Found Lz4: /usr/lib/aarch64-linux-gnu/liblz4.so  
-- Found Zstd: /usr/lib/aarch64-linux-gnu/libzstd.so  
-- Found xxHash: /usr/lib/aarch64-linux-gnu/libxxhash.so  
-- Found ZLIB: /usr/lib/aarch64-linux-gnu/libz.so (found version "1.2.11") 
-- Found PNG: /usr/lib/aarch64-linux-gnu/libpng.so (found version "1.6.37") 
-- Found JPEG: /usr/lib/aarch64-linux-gnu/libjpeg.so (found version "80") 
-- Found TurboJpeg: /usr/lib/aarch64-linux-gnu/libturbojpeg.so  
-- Found GTest: /usr/lib/aarch64-linux-gnu/libgtest.a  
CMake Warning at tools/vrsplayer/CMakeLists.txt:50 (message):
  Qt5 or Qt6 were not found, so vrsplayer will not be included.


-- Could NOT find QT (missing: QT_DIR)
-- /tmp/vrs/pyvrs/vrs_bindings/Pybind11.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.h;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/FactoryHelper.hpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.h;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.h
-- Found PythonInterp: /usr/bin/python3 (found suitable version "3.8.10", minimum required is "3.6") 
-- Found PythonLibs: /usr/lib/aarch64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Found pybind11: /usr/local/include (found version "2.10.0")
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/vrs_Build
Scanning dependencies of target testedtool
Scanning dependencies of target vrs_logging
[  1%] Building CXX object vrs/test/CMakeFiles/testedtool.dir/testedtool/testedtool.cpp.o
[  2%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Log.cpp.o
[  2%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Checks.cpp.o
[  3%] Linking CXX executable testedtool
[  3%] Built target testedtool
[  4%] Linking CXX static library libvrs_logging.a
[  4%] Built target vrs_logging
Scanning dependencies of target vrs_utils_xxhash
Scanning dependencies of target vrs_os
[  5%] Building CXX object vrs/utils/xxhash/CMakeFiles/vrs_utils_xxhash.dir/xxhash.cpp.o
[  5%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Event.cpp.o
[  7%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/System.cpp.o
[  7%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Semaphore.cpp.o
[  7%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Time.cpp.o
[  8%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Utils.cpp.o
[  8%] Linking CXX static library libvrs_utils_xxhash.a
[  8%] Built target vrs_utils_xxhash
Scanning dependencies of target test_vrs_utils_xxhash
[  9%] Building CXX object vrs/utils/xxhash/CMakeFiles/test_vrs_utils_xxhash.dir/test/xxhashTest.cpp.o
[ 10%] Linking CXX executable test_vrs_utils_xxhash
[ 10%] Built target test_vrs_utils_xxhash
[ 11%] Linking CXX static library libvrs_os.a
[ 11%] Built target vrs_os
Scanning dependencies of target vrs_oss_testdatadir
Scanning dependencies of target vrs_helpers
Scanning dependencies of target vrs_utils_converters
[ 11%] Building CXX object vrs/oss/TestDataDir/CMakeFiles/vrs_oss_testdatadir.dir/TestDataDir.cpp.o
[ 11%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/MemBuffer.cpp.o
[ 12%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/Strings.cpp.o
[ 12%] Building CXX object vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o
[ 13%] Linking CXX static library libvrs_oss_testdatadir.a
[ 13%] Built target vrs_oss_testdatadir
Scanning dependencies of target test_vrs_os
[ 13%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/TimeTest.cpp.o
[ 14%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/EventUnitTest.cpp.o
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp: In function 'void vrs::utils::{anonymous}::convertVectorized(uint16_t*, const uint8_t*, size_t, size_t, size_t, bool)':
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:53: note: use '-flax-vector-conversions' to permit conversions between vectors with differing element types or numbers of subparts
   68 |       const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                                     ^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   68 |       const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                       ^~~~~~~
      |                                       |
      |                                       const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:69:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   69 |       const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
      |                                         ^~~~~~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:70:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   70 |       const auto pixels = vshlq_n_u16(mIn, 2);
      |                                       ^~~
      |                                       |
      |                                       const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note:   initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
      |              ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:71:47: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   71 |       const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
      |                                               ^
      |                                               |
      |                                               const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note:   initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
 1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
      |            ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:86:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   86 |         const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                         ^~~~~~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:87:43: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   87 |         const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
      |                                           ^~~~~~~
      |                                           |
      |                                           const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:88:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   88 |         const auto pixels = vshlq_n_u16(mIn, 2);
      |                                         ^~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note:   initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
      |              ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:89:49: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   89 |         const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
      |                                                 ^
      |                                                 |
      |                                                 const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note:   initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
 1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
      |            ~~~~~~~~~~~^~~
/tmp/vrs/vrs/helpers/Strings.cpp: In function 'std::string vrs::helpers::humanReadableTimestamp(double, uint8_t)':
/tmp/vrs/vrs/helpers/Strings.cpp:177:1: warning: control reaches end of non-void function [-Wreturn-type]
  177 | }
      | ^
make[2]: *** [vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/build.make:63: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:762: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 15%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/UtilsTest.cpp.o
[ 16%] Linking CXX static library libvrs_helpers.a
[ 16%] Built target vrs_helpers
[ 16%] Linking CXX executable test_vrs_os
[ 16%] Built target test_vrs_os
make: *** [Makefile:141: all] Error 2
Removing intermediate container 2f96d38eeaca
 ---> 3752c39fe0d2
Step 6/9 : RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;
 ---> Running in dc1ad4c273d3
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at CMakeLists.txt:31 (find_package):
  By not providing "Findvrslib.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "vrslib", but
  CMake did not find one.

  Could not find a package configuration file provided by "vrslib" with any
  of the following names:

    vrslibConfig.cmake
    vrslib-config.cmake

  Add the installation prefix of "vrslib" to CMAKE_PREFIX_PATH or set
  "vrslib_DIR" to a directory containing one of the above files.  If "vrslib"
  provides a separate development package or SDK, be sure it has been
  installed.


-- Configuring incomplete, errors occurred!
See also "/opt/aria_data_tools_Build/CMakeFiles/CMakeOutput.log".
The command '/bin/sh -c mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;' returned a non-zero code: 1

This is failing with the same errors on Ubuntu 18.04 as well @SeaOtocinclus