MiuLab/Taiwan-LLM

GGUF

DavidWang67 opened this issue · 2 comments

DavidWang67 commented

I'm trying to run local llm with this model, where can I find the gguf file of this model on huggingface?

g2david commented

same question.

dianyo commented

@adamlin120 If no one is currently dealing with this task, I would like to pick it up and convert the current model to GGUF format. What do you think?

Ok, i just found that there're already some of GGUF models on HF from @audreyt https://huggingface.co/audreyt

  • 👍1