alexrozanski/LlamaChat

Support ggmlv3

jingsam opened this issue ยท 2 comments

I download llama-7b.ggmlv3.q4_0.bin from https://huggingface.co/TheBloke/LLaMa-7B-GGML/tree/main, LlamaChat says not a valid model. It seems not support ggmlv3 format.

image

LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon ๐Ÿ‘Œ๐Ÿผ

ymcui commented

LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon ๐Ÿ‘Œ๐Ÿผ

@alexrozanski Looking forward to new version.
BTW, as a kind reminder, llama.cpp will have breaking changes on its model format (ggjt-v3 to gguf).
Maybe it is good to keep an eye on this: ggerganov/llama.cpp#2398