Support ggmlv3
jingsam opened this issue ยท 2 comments
jingsam commented
I download llama-7b.ggmlv3.q4_0.bin
from https://huggingface.co/TheBloke/LLaMa-7B-GGML/tree/main, LlamaChat says not a valid model. It seems not support ggmlv3 format.
alexrozanski commented
LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon ๐๐ผ
ymcui commented
LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon ๐๐ผ
@alexrozanski Looking forward to new version.
BTW, as a kind reminder, llama.cpp will have breaking changes on its model format (ggjt-v3 to gguf).
Maybe it is good to keep an eye on this: ggerganov/llama.cpp#2398