facebookresearch/Aria_data_tools

Build issues on macOS 12.6 using Podman version 4.2.1

gustavomart opened this issue · 6 comments

    Unfortunately, this is still failing for me on macOS 12.6 using Podman version 4.2.1:
Cloning into 'vrs'...
HEAD is now at afa85d1 Fix unit test memory leak
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_CXX_COMPILER: /usr/bin/c++
-- CMAKE_CXX_COMPILER_VERSION: 9.4.0
-- Found Boost: /usr/lib/aarch64-linux-gnu/cmake/Boost-1.71.0/BoostConfig.cmake (found version "1.71.0") found components: filesystem chrono date_time system thread 
-- Found Lz4: /usr/lib/aarch64-linux-gnu/liblz4.so  
-- Found Zstd: /usr/lib/aarch64-linux-gnu/libzstd.so  
-- Found xxHash: /usr/lib/aarch64-linux-gnu/libxxhash.so  
-- Found ZLIB: /usr/lib/aarch64-linux-gnu/libz.so (found version "1.2.11") 
-- Found PNG: /usr/lib/aarch64-linux-gnu/libpng.so (found version "1.6.37") 
-- Found JPEG: /usr/lib/aarch64-linux-gnu/libjpeg.so (found version "80") 
-- Found TurboJpeg: /usr/lib/aarch64-linux-gnu/libturbojpeg.so  
-- Found GTest: /usr/lib/aarch64-linux-gnu/libgtest.a  
-- Could NOT find QT (missing: QT_DIR)
CMake Warning at tools/vrsplayer/CMakeLists.txt:50 (message):
  Qt5 or Qt6 were not found, so vrsplayer will not be included.


-- /tmp/vrs/pyvrs/vrs_bindings/Pybind11.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.cpp;/tmp/vrs/pyvrs/vrs_bindings/VrsBindings.h;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/AsyncVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/FactoryHelper.hpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/FilteredFileReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/MultiVRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/Reader.h;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.cpp;/tmp/vrs/pyvrs/vrs_bindings/reader/VRSReader.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyBuffer.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyExceptions.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyRecord.h;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/PyUtils.h;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.cpp;/tmp/vrs/pyvrs/vrs_bindings/utils/Utils.h
-- Found PythonInterp: /usr/bin/python3 (found suitable version "3.8.10", minimum required is "3.6") 
-- Found PythonLibs: /usr/lib/aarch64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Found pybind11: /usr/local/include (found version "2.10.0")
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/vrs_Build
Scanning dependencies of target vrs_logging
[  0%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Checks.cpp.o
[  1%] Building CXX object vrs/oss/logging/CMakeFiles/vrs_logging.dir/Log.cpp.o
[  2%] Linking CXX static library libvrs_logging.a
[  2%] Built target vrs_logging
Scanning dependencies of target vrs_utils_xxhash
[  3%] Building CXX object vrs/utils/xxhash/CMakeFiles/vrs_utils_xxhash.dir/xxhash.cpp.o
[  3%] Linking CXX static library libvrs_utils_xxhash.a
[  3%] Built target vrs_utils_xxhash
Scanning dependencies of target vrs_os
[  3%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Event.cpp.o
[  4%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Semaphore.cpp.o
[  5%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/System.cpp.o
[  5%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Time.cpp.o
[  6%] Building CXX object vrs/os/CMakeFiles/vrs_os.dir/Utils.cpp.o
[  7%] Linking CXX static library libvrs_os.a
[  7%] Built target vrs_os
Scanning dependencies of target vrs_helpers
[  7%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/MemBuffer.cpp.o
[  8%] Building CXX object vrs/helpers/CMakeFiles/vrs_helpers.dir/Strings.cpp.o
/tmp/vrs/vrs/helpers/Strings.cpp: In function 'std::string vrs::helpers::humanReadableTimestamp(double, uint8_t)':
/tmp/vrs/vrs/helpers/Strings.cpp:177:1: warning: control reaches end of non-void function [-Wreturn-type]
  177 | }
      | ^
[  9%] Linking CXX static library libvrs_helpers.a
[  9%] Built target vrs_helpers
Scanning dependencies of target vrslib
[ 10%] Building CXX object vrs/CMakeFiles/vrslib.dir/Compressor.cpp.o
[ 10%] Building CXX object vrs/CMakeFiles/vrslib.dir/ContentBlockReader.cpp.o
[ 11%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataLayout.cpp.o
[ 12%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataLayoutConventions.cpp.o
[ 12%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataReference.cpp.o
[ 13%] Building CXX object vrs/CMakeFiles/vrslib.dir/DataSource.cpp.o
[ 14%] Building CXX object vrs/CMakeFiles/vrslib.dir/Decompressor.cpp.o
[ 14%] Building CXX object vrs/CMakeFiles/vrslib.dir/DescriptionRecord.cpp.o
[ 15%] Building CXX object vrs/CMakeFiles/vrslib.dir/DiskFile.cpp.o
[ 16%] Building CXX object vrs/CMakeFiles/vrslib.dir/ErrorCode.cpp.o
[ 16%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileCache.cpp.o
[ 17%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileDetailsCache.cpp.o
[ 18%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileFormat.cpp.o
[ 18%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileHandler.cpp.o
[ 19%] Building CXX object vrs/CMakeFiles/vrslib.dir/FileHandlerFactory.cpp.o
[ 20%] Building CXX object vrs/CMakeFiles/vrslib.dir/IndexRecord.cpp.o
[ 20%] Building CXX object vrs/CMakeFiles/vrslib.dir/LegacyFormatsProvider.cpp.o
[ 21%] Building CXX object vrs/CMakeFiles/vrslib.dir/MultiRecordFileReader.cpp.o
[ 22%] Building CXX object vrs/CMakeFiles/vrslib.dir/ProgressLogger.cpp.o
[ 22%] Building CXX object vrs/CMakeFiles/vrslib.dir/Record.cpp.o
[ 23%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFileReader.cpp.o
[ 24%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFileWriter.cpp.o
[ 24%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFormat.cpp.o
[ 25%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordFormatStreamPlayer.cpp.o
[ 26%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordManager.cpp.o
[ 26%] Building CXX object vrs/CMakeFiles/vrslib.dir/RecordReaders.cpp.o
[ 27%] Building CXX object vrs/CMakeFiles/vrslib.dir/Recordable.cpp.o
[ 28%] Building CXX object vrs/CMakeFiles/vrslib.dir/StreamId.cpp.o
[ 28%] Building CXX object vrs/CMakeFiles/vrslib.dir/TagConventions.cpp.o
[ 29%] Building CXX object vrs/CMakeFiles/vrslib.dir/TagsRecord.cpp.o
[ 30%] Building CXX object vrs/CMakeFiles/vrslib.dir/TelemetryLogger.cpp.o
[ 31%] Linking CXX static library libvrslib.a
[ 31%] Built target vrslib
Scanning dependencies of target test_vrs_helpers
[ 32%] Building CXX object vrs/helpers/CMakeFiles/test_vrs_helpers.dir/test/StringsTest.cpp.o
[ 33%] Linking CXX executable test_vrs_helpers
[ 33%] Built target test_vrs_helpers
Scanning dependencies of target vrs_oss_testdatadir
[ 33%] Building CXX object vrs/oss/TestDataDir/CMakeFiles/vrs_oss_testdatadir.dir/TestDataDir.cpp.o
[ 34%] Linking CXX static library libvrs_oss_testdatadir.a
[ 34%] Built target vrs_oss_testdatadir
Scanning dependencies of target test_vrs_os
[ 34%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/TimeTest.cpp.o
[ 35%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/EventUnitTest.cpp.o
[ 36%] Building CXX object vrs/os/CMakeFiles/test_vrs_os.dir/test/UtilsTest.cpp.o
[ 36%] Linking CXX executable test_vrs_os
[ 36%] Built target test_vrs_os
Scanning dependencies of target vrs_utils_converters
[ 36%] Building CXX object vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp: In function 'void vrs::utils::{anonymous}::convertVectorized(uint16_t*, const uint8_t*, size_t, size_t, size_t, bool)':
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:53: note: use '-flax-vector-conversions' to permit conversions between vectors with differing element types or numbers of subparts
   68 |       const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                                     ^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:68:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   68 |       const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                       ^~~~~~~
      |                                       |
      |                                       const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:69:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   69 |       const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
      |                                         ^~~~~~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:70:39: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   70 |       const auto pixels = vshlq_n_u16(mIn, 2);
      |                                       ^~~
      |                                       |
      |                                       const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note:   initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
      |              ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:71:47: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   71 |       const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
      |                                               ^
      |                                               |
      |                                               const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note:   initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
 1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
      |            ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:86:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   86 |         const uint8x16_t r = vqtbl1q_s8(encoded, rshuf);
      |                                         ^~~~~~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:87:43: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'int8x16_t' {aka '__vector(16) signed char'}
   87 |         const uint8x16_t mIn = vqtbl1q_s8(encoded, pshuf);
      |                                           ^~~~~~~
      |                                           |
      |                                           const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:11389:23: note:   initializing argument 1 of 'int8x16_t vqtbl1q_s8(int8x16_t, uint8x16_t)'
11389 | vqtbl1q_s8 (int8x16_t a, uint8x16_t b)
      |             ~~~~~~~~~~^
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:88:41: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   88 |         const auto pixels = vshlq_n_u16(mIn, 2);
      |                                         ^~~
      |                                         |
      |                                         const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:26976:25: note:   initializing argument 1 of 'uint16x8_t vshlq_n_u16(uint16x8_t, int)'
26976 | vshlq_n_u16 (uint16x8_t __a, const int __b)
      |              ~~~~~~~~~~~^~~
/tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:89:49: error: cannot convert 'const uint8x16_t' {aka 'const __vector(16) unsigned char'} to 'uint16x8_t' {aka '__vector(8) short unsigned int'}
   89 |         const auto fracts = vshlq_u16(vandq_u16(r, mask), rsh);
      |                                                 ^
      |                                                 |
      |                                                 const uint8x16_t {aka const __vector(16) unsigned char}
In file included from /tmp/vrs/vrs/utils/converters/Raw10ToGrey10Converter.cpp:20:
/usr/lib/gcc/aarch64-linux-gnu/9/include/arm_neon.h:1586:23: note:   initializing argument 1 of 'uint16x8_t vandq_u16(uint16x8_t, uint16x8_t)'
 1586 | vandq_u16 (uint16x8_t __a, uint16x8_t __b)
      |            ~~~~~~~~~~~^~~
make[2]: *** [vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/build.make:63: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/Raw10ToGrey10Converter.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:762: vrs/utils/converters/CMakeFiles/vrs_utils_converters.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
--> 3bc7963150d
STEP 6/9: RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at CMakeLists.txt:31 (find_package):
  By not providing "Findvrslib.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "vrslib", but
  CMake did not find one.

  Could not find a package configuration file provided by "vrslib" with any
  of the following names:

    vrslibConfig.cmake
    vrslib-config.cmake

  Add the installation prefix of "vrslib" to CMAKE_PREFIX_PATH or set
  "vrslib_DIR" to a directory containing one of the above files.  If "vrslib"
  provides a separate development package or SDK, be sure it has been
  installed.


-- Configuring incomplete, errors occurred!
See also "/opt/aria_data_tools_Build/CMakeFiles/CMakeOutput.log".
Error: error building at STEP "RUN mkdir /opt/aria_data_tools_Build; cd /opt/aria_data_tools_Build; cmake -DCMAKE_BUILD_TYPE=RELEASE /opt/aria_data_tools/src;": error while running runtime: exit status 1

Originally posted by @evfinkn in #16 (comment)

To be clear this is a VRS build issue, can you forward this to the VRS project.

Created a new issue in the VRS repository 👍

This commit on the VRS repository fixed the issue, but I'm still encountering the error when building Aria Data Tools (because it doesn't use the latest VRS commit).

@evfinkn to get unblocked you can make this change locally:

--- a/src/scripts/install_compile_3rd_party.sh
+++ b/src/scripts/install_compile_3rd_party.sh
@@ -19,7 +19,7 @@
     thread=$(nproc)
 fi
 
-vrs_commit_sha=afa85d113410a3678a02bc8eb0798dc948cae5c5
+vrs_commit_sha=0c9144952560048e78c61af872385e4d7464960f
 
 # Build Fmt
 cd /tmp; git clone https://github.com/fmtlib/fmt.git -b 8.1.1 \

I will be pushing this change to the repo soon.

@evfinkn I pushed an update to fix this. Please try it on your side :)

That fixed this issue, but I'm encountering another one now. I'll open another issue.