fatal error: 'ggml-common.h' file not found
guod opened this issue · 3 comments
guod commented
System:
Apple M2 Max, Sonoma v14.1.1
What I did:
CMAKE_ARGS="-DLLAMA_METAL=on" pip install "sqlcoder[llama-cpp]"
sqlcoder launch
Error:
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
}
llama_new_context_with_model: failed to initialize Metal backend
rishsriv commented
Thanks for reporting this! Looking into this and will fix soon. llama.cpp
recently had a new release, so I suspect we'll have to update our install instructions