MiuLab/Taiwan-LLM

Problem of quantisation

yihong1120 opened this issue · 1 comments

yihong1120 commented

Hello all,
Shall you integrate Taiwan-LLM into llama.cpp project and provide a much more effective lightweight model~

您好，
想詢問可否將Taiwan-LLM整合到llama.cpp專案中，提供更有效的輕量級模型~

adamlin120 commented

我不太熟悉 llama.cpp ，請問目前為何無法在 llama.cpp 直接用我們的模型呢？