Can't build on M1 chip
Vincen-Jo opened this issue · 56 comments
Hi,
I am a beginner in programming.
My question may be absurd, but I need your help.
I proceed one by one by following the procedure here.
However, when I run cmake, an error like the picture above appears.
I want to know why the error occurs and how to fix it.
MacOS 11.2.2
Apple M1 chip
I am always grateful for your information.
Thanks.
I think Apple changed a few things in 11.x with regards to code things. This seems to happen every time they make a major release. Currently I don't have access to a MacOS 11 computer, so I have no idea how to get started debugging this remotely. Can you see if you can find a libquadmath.a file on your computer somewhere?
Thanks for your fast response.
Let's find out where the file is.
Not that this is likely to be the problem, but your python 2.7 version is obsolete.
What happens if you comment out (or delete) the line that tries to do the libquadmath.a copy? Should be lines 168-169 I think.
I think it has been resolved.
Thanks!^_^
Hmm. Does the generated shared library work?
Here is Korea.
It's too late so check it out tomorrow.
Ugh. Seems like a lot has changed in MacOS 11.
How are you ultimately going to call the shared library? Python?
I am trying to do this to link refprop to Excel on macOS.
Ah. Excel+MacOS is a whole additional level of complexity.
Can you install Python 3.x via homebrew and then install numpy into that version? Your numpy version is unhappy.
Ok. let’s try again tomorrow.
I have to sleep to go to work tomorrow. ^_^
Thanks again for the help.
Sounds good. We'll get it working, somehow.
I think the library file has been created normally, but when I try to run it in Excel, an error occurs and Excel quits. :(
Well, that's not good, but it seems you did everything properly.
Looks like maybe some sort of MacOS 11 incompatability. As I said, I don't have access to MacOS 11 yet, so don't have means to debug. Can you use Python? We could see if it is an Excel issue or what.
Thank you for answer.
Let's try it in Python.
It will take time again because I need to get additional information to do it with Python. :)
I think ibrefprop.dylib was created incorrectly.
What do you think about this?
Did you build the shared library on the machine you ran it on? It seems like not since the arch doesn't match.
Are there any related tutorials?
I think you are doing things properly. Did you build on the machine you are testing on?
As you mentioned, I built on the machine under test.
Let's study more and find a solution.
Thank you. :)
Hmm. I haven't seen this sort of thing before. I wonder if it is actually a problem in the dependent libraries. Can you show me the output of
otool -L librefprop.dylib
here is screenshot.
Good in one sense - no additional runtime dependencies (that's the point of static linking). Bad that it doesn't work in this case.
Really to find a workaround I'm going to need to get access to an M1 mac and fiddle.
ok.
I don't know when that is, but I'll wait. :)
Thanks for the help.
Sorry I don't have more useful feedback to share at this point.
This problem seems to be happening on the M1 Mac.
Today, I confirmed that REFPROP and Excel work normally with my colleague Intel Mac.
Perhaps it is caused by GCC not being 100% compatible with the M1 chipset.
Yes, it seems to be some sort of incompatibility, though it is not clear what the origin is. Debugging these sorts of things on MacOS can be surprisingly tricky.
By any chance do you have access to MacOS 11 on a non-M1 chip?
I have already tried the test with an intel chipset mac(MacOS11 Big Sur).
In the above environment, Refprop work normally in Excel.
Thanks, that's a very useful datapoint. So it appears the problem is really with M1 chipset compatibility.
I agree with you.
Thank you for your continued interest.
Hi Ian,
I'm also working with an M1 MacBook and can confirm that I have gone through the exact same issues, with the architecture of the built library ultimately being wrong.
Matlab output:
no suitable image found. Did find:
/xxxxx/MatLab/REFPROP/librefprop.dylib:
mach-o, but wrong architecture
I've also tried the gcc build for m1 Big Sur found here: http://hpc.sourceforge.net to no avail. Is there no way to force a 64 bit build in the same way that I can be done for a 32 bit build?
No worries if there's no update on this, I understand apple silicon is still relatively niche stuff at this point. Thanks!
I still don't have a M1 chip, so I sadly have no idea where to start with debugging help.
I've been trying to get REFPROP working in Excel for M1. The CMAKE process worked fine on my M1 MacBook Pro and produced a libreprop.dylib that works just fine in python, but it does not work with Excel. I believe the issue is that Microsoft started compiling Excel for Apple Silicon rather than Intel which is why it does not work. Python is still using an Intel compilation which is why it still works. I believe a potential solution for Excel is to compile a version of librefprop.dylib for apple silicon specifically. I don't know how to make this compilation, but I'm still looking.
I'm not sure how Microsoft could compile Excel for Intel, but run on M1, but maybe that is true. Without an M1, I have no idea where to start looking.
The macOS activity monitor tells whether an app is Apple or Intel. Microsoft compiles Office apps as universal meaning the app contains both the Intel & M1 version in the same executable. I'm pretty sure this is why REFPROP is not working on M1 Macs. You can see in my Activity Monitor (Kind column) screen shot that Excel is a native Apple app. You can also see that OneDrive is an Intel app.
GFORTAN compiles for Intel. I see a version is in development for M1, but its experimental at this point in time and I have not tried using it. Intel has no plans to build native M1 compilers.
I think once GNU has a native M1 compiler that the librefprop.dylib will likely start working on M1's.
I also have a iMac with an Intel Processor and REFROP works in EXCEL using the latest macOS Monterey. From my testing, it matches exactly the Windows version.
I got REFPROP to work using EXCEL on a M1 Mac Pro. You need to make sure you tell Mac to use Rosetta which provides backward compatibility. See this https://www.howtogeek.com/702982/how-to-launch-the-intel-version-of-a-universal-mac-app-on-apple-silicon/ for more info on how to Force macOS to use the compatible version of EXCEL.
Care to update the docs with a pull request?
I can do that. I am relatively new to GitHub. How do I make a pull request to update the documentation?
Should be as simple as click the edit button, the pencil thing here: https://github.com/usnistgov/REFPROP-wrappers/blob/master/wrappers/Excel/README.md:
Done
Hi Ian I tried the same thing as Vincen and recieved same error as him.
Please help so that I can use REFPROP in M1 Mac Air.
`vipinvenugopal@Vipins-Air ~ % cmake .. -DCMAKE_BUILD_TYPE=Release
zsh: command not found: cmake
vipinvenugopal@Vipins-Air ~ % cd /Users/vipinvenugopal/REFPROP-cmake/build
vipinvenugopal@Vipins-Air build % cmake .. -DCMAKE_BUILD_TYPE=Release
zsh: command not found: cmake
vipinvenugopal@Vipins-Air build % export PATH=/usr/local/opt/brew/bin:$PATH
vipinvenugopal@Vipins-Air build % cmake .. -DCMAKE_BUILD_TYPE=Release
-- The C compiler identification is AppleClang 13.1.6.13160021
-- The CXX compiler identification is AppleClang 13.1.6.13160021
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Library/Developer/CommandLineTools/usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The Fortran compiler identification is GNU 11.2.0
-- Checking whether Fortran compiler has -isysroot
-- Checking whether Fortran compiler has -isysroot - yes
-- Checking whether Fortran compiler supports OSX deployment target flag
-- Checking whether Fortran compiler supports OSX deployment target flag - yes
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Check for working Fortran compiler: /opt/homebrew/bin/gfortran - skipped
DONE!
-- Found PythonInterp: /Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8 (found version "3.8.5")
-- DEFSYM_FLAG:
-- darwin
Missing from PASS_CMN_tokens: ['ABFLASHdll', 'VIRBCD12dll', 'VIRTAUdll']
Missing from REFPROP_lib.h: []
-- Path to libquadmath.a:libquadmath.a
-- Copied libquadmath.a here.
-- Configuring done
-- Generating done
-- Build files have been written to: /Users/vipinvenugopal/REFPROP-cmake/build
vipinvenugopal@Vipins-Air build % cmake --build .
Scanning dependencies of target refprop
[ 6%] Building Fortran object CMakeFiles/refprop.dir/fortran/CORE_ANC.FOR.o
[ 12%] Building Fortran object CMakeFiles/refprop.dir/fortran/CORE_FEQ.FOR.o
[ 18%] Building Fortran object CMakeFiles/refprop.dir/fortran/CORE_PR.FOR.o
[ 25%] Building Fortran object CMakeFiles/refprop.dir/fortran/FLSH_SUB.FOR.o
[ 31%] Building Fortran object CMakeFiles/refprop.dir/fortran/MIX_HMX.FOR.o
[ 37%] Building Fortran object CMakeFiles/refprop.dir/fortran/PROP_SUB.FOR.o
[ 43%] Building Fortran object CMakeFiles/refprop.dir/fortran/REFPROP.FOR.o
/Users/vipinvenugopal/REFPROP-cmake/fortran/REFPROP.FOR:5589:72:
5589 | if (ABS(iErrPrnt).eq.3) pause !If your compiler complains about this line, just delete it.
|
Warning: Deleted feature: PAUSE statement at (1)
[ 50%] Building Fortran object CMakeFiles/refprop.dir/fortran/SAT_SUB.FOR.o
[ 56%] Building Fortran object CMakeFiles/refprop.dir/fortran/SETUP.FOR.o
[ 62%] Building Fortran object CMakeFiles/refprop.dir/fortran/TRNSP.FOR.o
[ 68%] Building Fortran object CMakeFiles/refprop.dir/fortran/TRNS_TCX.FOR.o
[ 75%] Building Fortran object CMakeFiles/refprop.dir/fortran/TRNS_VIS.FOR.o
[ 81%] Building Fortran object CMakeFiles/refprop.dir/fortran/UTILITY.FOR.o
[ 87%] Building Fortran object CMakeFiles/refprop.dir/fortran/DLLFILES/PASS_FTN.FOR.o
[ 93%] Linking Fortran shared library librefprop.dylib
[ 93%] Built target refprop
[100%] About to build the REFPROP.h header file w/ /Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8;-u;/Users/vipinvenugopal/REFPROP-cmake/externals/REFPROP-headers/generate_header.py;--FORTRAN-path;/Users/vipinvenugopal/REFPROP-cmake/fortran/DLLFILES;--python-exe;/Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8
Writing the .pyf file with numpy.f2py, please be patient...
About to run: /Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8 -m numpy.f2py --quiet --no-lower -h REFPROP.pyf /Users/vipinvenugopal/REFPROP-cmake/fortran/DLLFILES/PASS_FTN.FOR
numpy version: 1.22.3
Deleting REFPROP.pyf
[100%] Built target REFPROP_H
vipinvenugopal@Vipins-Air build % python3
Python 3.8.5 (v3.8.5:580fbb018f, Jul 20 2020, 12:11:27)
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
home = '/usr/local/REFPROP/'
from ctREFPROP.ctREFPROP import REFPROPFunctionLibrary
RP = REFPROPFunctionLibrary(home)
Traceback (most recent call last):
File "", line 1, in
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/ctREFPROP/ctREFPROP.py", line 164, in REFPROPFunctionLibrary
dll = loader_fcn(full_path)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/ctypes/init.py", line 373, in init
self._handle = _dlopen(self._name, mode)
OSError: dlopen(/usr/local/REFPROP/librefprop.dylib, 0x0006): tried: '/usr/local/REFPROP/librefprop.dylib' (mach-o file, but is an incompatible architecture (have 'arm64', need 'x86_64'))
`
The problem is that the generated shared library has arm64 architecture (native for M1), but somehow your python is looking for x86_64. Are you running all this on the same machine? Otherwise you might want to make a universal build with both, though I'm not quite sure how one would manage that. I don't have access to an M1 currently.
I have REFPROP working in both EXCEL & Python on my M1 Mac. I updated the readme with instructions but the readme was never published.
I got REFPROP to work using EXCEL on a M1 Mac Pro. You need to make sure you tell Mac to use Rosetta which provides backward compatibility. See this https://www.howtogeek.com/702982/how-to-launch-the-intel-version-of-a-universal-mac-app-on-apple-silicon/ for more info on how to Force macOS to use the compatible version of EXCEL.
I have installed python using brew and then did the further commands.
Do i need to run the cmake build command as this?
cmake .. -DCMAKE_BUILD_TYPE=Release -DPYTHON_EXECUTABLE:FILEPATH=/usr/local/bin/python3
Does this mean that the build command is running with python GUI version installed locally from python.org in local folder seperately?
@trirex
I don't know where the updated procedure for the REFPROP installation is.
Can u please send it to me so that I can resolve this issue
Somehow you have to convince python to use rosetta to load the x86_64 version. I don't know how to to do that.
I am using the arm64 conda-forge python on my M1 mac, and that combination allows me to build native arm64 binaries that work fine.