Docker build still fails on vrslib error:
Closed this issue · 7 comments
jonathanzhang99 commented
Running docker build git@github.com:facebookresearch/Aria_data_tools.git#main
fails with
Step 6/9 : RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;
---> Running in d9f94542cd5d
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at CMakeLists.txt:31 (find_package):
By not providing "Findvrslib.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "vrslib", but
CMake did not find one.
Could not find a package configuration file provided by "vrslib" with any
of the following names:
vrslibConfig.cmake
vrslib-config.cmake
Add the installation prefix of "vrslib" to CMAKE_PREFIX_PATH or set
"vrslib_DIR" to a directory containing one of the above files. If "vrslib"
provides a separate development package or SDK, be sure it has been
installed.
This issue was first reported in #10 but did not get resolved completely. Reopening to track progress although I assume that this is more of an error with the vrs repository.
gomingchen commented
I have the same issue. I have a windows machine and run everything in a conda environment. I had to run line by line in the Dockerfile. I encountered the same error while running cmake -DCMAKE_BUILD_TYPE=RELEASE . under the directory aria_data_tools/src
It's very frustrating that the tools aren't well maintained while having a great dataset.
SeaOtocinclus commented
Docker build has been fixed. You can try again.
@gomingchen As any open source project, contributions are coming along the free time of the contributors. A fix coming 2/3 days after an issue as been posted is still a very good turn around.
jonathanzhang99 commented
@SeaOtocinclus thank you for all your guys hard work on this! Can confirm the build works for me now
gomingchen commented
It works for me, too. Thank you very much! Appreciate it! @SeaOtocinclus
evfinkn commented
Unfortunately, this is still failing for me on macOS 12.6 using Podman version 4.2.1:
Cloning into 'vrs'...
HEAD is now at afa85d1 Fix unit test memory leak
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_CXX_COMPILER: /usr/bin/c++
-- CMAKE_CXX_COMPILER_VERSION: 9.4.0
-- Found Boost: /usr/lib/aarch64-linux-gnu/cmake/Boost-1.71.0/BoostConfig.cmake (found version "1.71.0") found components: filesystem chrono date_time system thread
-- Found Lz4: /usr/lib/aarch64-linux-gnu/liblz4.so
-- Found Zstd: /usr/lib/aarch64-linux-gnu/libzstd.so
-- Found xxHash: /usr/lib/aarch64-linux-gnu/libxxhash.so
-- Found ZLIB: /usr/lib/aarch64-linux-gnu/libz.so (found version "1.2.11")
-- Found PNG: /usr/lib/aarch64-linux-gnu/libpng.so (found version "1.6.37")
-- Found JPEG: /usr/lib/aarch64-linux-gnu/libjpeg.so (found version "80")
-- Found TurboJpeg: /usr/lib/aarch64-linux-gnu/libturbojpeg.so
-- Found GTest: /usr/lib/aarch64-linux-gnu/libgtest.a
-- Could NOT find QT (missing: QT_DIR)
CMake Warning at tools/vrsplayer/CMakeLists.txt:50 (message):
Qt5 or Qt6 were not found, so vrsplayer will not be included.
-- /tmp/vrs/pyvrs/vrs_bindings/Pybind11.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.h;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/FactoryHelper.hpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.h;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.h
-- Found PythonInterp: /usr/bin/python3 (found suitable version "3.8.10", minimum required is "3.6")
-- Found PythonLibs: /usr/lib/aarch64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Found pybind11: /usr/local/include (found version "2.10.0")
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/vrs_Build
Scanning dependencies of target vrs_logging
[ 0%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Checks.cpp.o
[ 1%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Log.cpp.o
[ 2%] Linking CXX static library libvrs_logging.a
[ 2%] Built target vrs_logging
Scanning dependencies of target vrs_utils_xxhash
[ 3%] Building CXX object vrs/utils/xxhash/CMakeFiles/vrs_utils_xxhash.dir/xxhash.cpp.o
[ 3%] Linking CXX static library libvrs_utils_xxhash.a
[ 3%] Built target vrs_utils_xxhash
Scanning dependencies of target vrs_os
[ 3%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Event.cpp.o
[ 4%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Semaphore.cpp.o
[ 5%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/System.cpp.o
[ 5%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Time.cpp.o
[ 6%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Utils.cpp.o
[ 7%] Linking CXX static library libvrs_os.a
[ 7%] Built target vrs_os
Scanning dependencies of target vrs_helpers
[ 7%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/MemBuffer.cpp.o
[ 8%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/Strings.cpp.o
/tmp/vrs/vrs/helpers/Strings.cpp: In function 'std::string vrs::helpers::humanReadableTimestamp(double, uint8_t)':
/tmp/vrs/vrs/helpers/Strings.cpp:177:1: warning: control reaches end of non-void function [-Wreturn-type]
177 | }
| ^
[ 9%] Linking CXX static library libvrs_helpers.a
[ 9%] Built target vrs_helpers
Scanning dependencies of target vrslib
[ 10%] Building CXX object vrs/CMakeFiles/vrslib.dir/Compressor.cpp.o
[ 10%] Building CXX object vrs/CMakeFiles/vrslib.dir/ContentBlockReader.cpp.o
[ 11%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataLayout.cpp.o
[ 12%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataLayoutConventions.cpp.o
[ 12%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataReference.cpp.o
[ 13%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataSource.cpp.o
[ 14%] Building CXX object vrs/CMakeFiles/vrslib.dir/Decompressor.cpp.o
[ 14%] Building CXX object vrs/CMakeFiles/vrslib.dir/DescriptionRecord.cpp.o
[ 15%] Building CXX object vrs/CMakeFiles/vrslib.dir/DiskFile.cpp.o
[ 16%] Building CXX object vrs/CMakeFiles/vrslib.dir/ErrorCode.cpp.o
[ 16%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileCache.cpp.o
[ 17%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileDetailsCache.cpp.o
[ 18%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileFormat.cpp.o
[ 18%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileHandler.cpp.o
[ 19%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileHandlerFactory.cpp.o
[ 20%] Building CXX object vrs/CMakeFiles/vrslib.dir/IndexRecord.cpp.o
[ 20%] Building CXX object vrs/CMakeFiles/vrslib.dir/LegacyFormatsProvider.cpp.o
[ 21%] Building CXX object vrs/CMakeFiles/vrslib.dir/MultiRecordFileReader.cpp.o
[ 22%] Building CXX object vrs/CMakeFiles/vrslib.dir/ProgressLogger.cpp.o
[ 22%] Building CXX object vrs/CMakeFiles/vrslib.dir/Record.cpp.o
[ 23%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFileReader.cpp.o
[ 24%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFileWriter.cpp.o
[ 24%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFormat.cpp.o
[ 25%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFormatStreamPlayer.cpp.o
[ 26%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordManager.cpp.o
[ 26%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordReaders.cpp.o
[ 27%] Building CXX object vrs/CMakeFiles/vrslib.dir/Recordable.cpp.o
[ 28%] Building CXX object vrs/CMakeFiles/vrslib.dir/StreamId.cpp.o
[ 28%] Building CXX object vrs/CMakeFiles/vrslib.dir/TagConventions.cpp.o
[ 29%] Building CXX object vrs/CMakeFiles/vrslib.dir/TagsRecord.cpp.o
[ 30%] Building CXX object vrs/CMakeFiles/vrslib.dir/TelemetryLogger.cpp.o
[ 31%] Linking CXX static library libvrslib.a
[ 31%] Built target vrslib
Scanning dependencies of target test_vrs_helpers
[ 32%] Building CXX object vrs/helpers/CMakeFiles/test_vrs_helpers.dir/test/StringsTest.cpp.o
[ 33%] Linking CXX executable test_vrs_helpers
[ 33%] Built target test_vrs_helpers
Scanning dependencies of target vrs_oss_testdatadir
[ 33%] Building CXX object vrs/oss/TestDataDir/CMakeFiles/vrs_oss_testdatadir.dir/TestDataDir.cpp.o
[ 34%] Linking CXX static library libvrs_oss_testdatadir.a
[ 34%] Built target vrs_oss_testdatadir
Scanning dependencies of target test_vrs_os
[ 34%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/TimeTest.cpp.o
[ 35%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/EventUnitTest.cpp.o
[ 36%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/UtilsTest.cpp.o
[ 36%] Linking CXX executable test_vrs_os
[ 36%] Built target test_vrs_os
Scanning dependencies of target vrs_utils_converters
[ 36%] Building CXX object vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp: In function 'void vrs::utils::{anonymous}::convertVectorized(uint16_t*, const uint8_t*, size_t, size_t, size_t, bool)':
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:53: note: use '-flax-vector-conversions' to permit conversions between vectors with differing element types or numbers of subparts
68 | const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
| ^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
68 | const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
| ^~~~~~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note: initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
| ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:69:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
69 | const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
| ^~~~~~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note: initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
| ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:70:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
70 | const auto pixels = vshlq_n_u16(mIn, 2);
| ^~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note: initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
| ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:71:47: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
71 | const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
| ^
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note: initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
| ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:86:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
86 | const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
| ^~~~~~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note: initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
| ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:87:43: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
87 | const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
| ^~~~~~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note: initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
| ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:88:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
88 | const auto pixels = vshlq_n_u16(mIn, 2);
| ^~~
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note: initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
| ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:89:49: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
89 | const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
| ^
| |
| const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note: initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
| ~~~~~~~~~~~^~~
make[2]: *** [vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/build.make:63: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:762: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
--> 3bc7963150d
STEP 6/9: RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at CMakeLists.txt:31 (find_package):
By not providing "Findvrslib.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "vrslib", but
CMake did not find one.
Could not find a package configuration file provided by "vrslib" with any
of the following names:
vrslibConfig.cmake
vrslib-config.cmake
Add the installation prefix of "vrslib" to CMAKE_PREFIX_PATH or set
"vrslib_DIR" to a directory containing one of the above files. If "vrslib"
provides a separate development package or SDK, be sure it has been
installed.
-- Configuring incomplete, errors occurred!
See also "/opt/aria_data_tools_Build/CMakeFiles/CMakeOutput.log".
Error: error building at STEP "RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;": error while running runtime: exit status 1
gustavomart commented
This is different error than what was originally reported. We will take a look.
gustavomart commented
Moving the new issue to #18