Bip-Rep/sherpa

Does this support GGUF models?

Opened this issue · 2 comments

Does this support GGUF models?

The original devs have abandoned this project. Ive forked it can continued the work here:

https://github.com/Mobile-Artificial-Intelligence/maid

Yes, GGUF V1 and V2 models are supported