defog-ai/sqlcoder

fatal error: 'ggml-common.h' file not found

guod opened this issue · 3 comments

guod commented

System:
Apple M2 Max, Sonoma v14.1.1

What I did:
CMAKE_ARGS="-DLLAMA_METAL=on" pip install "sqlcoder[llama-cpp]"
sqlcoder launch

Error:
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found
#include "ggml-common.h"
^~~~~~~~~~~~~~~
}
llama_new_context_with_model: failed to initialize Metal backend

Screenshot 2024-03-27 at 08 17 33

Thanks for reporting this! Looking into this and will fix soon. llama.cpp recently had a new release, so I suspect we'll have to update our install instructions