flairNLP/fabricator

Supporting other open-source LLMs

Closed this issue · 2 comments

mzeidhassan commented

Hi team,
Thanks for such great library. It looks very promising.
I am wondering if it's possible to use an open-source model, instead of gpt-3.5-turbo. Is this possible?
Thanks

HallerPatrick commented

Hello!

Yes, fabricator supports the HuggingFace Hub, we therefore support open-source models. Our Tutorial has a short example on how to load a model locally.

Hope this helps!

  • 👍1
mzeidhassan commented

Thanks @HallerPatrick! This is great news. Closing the issue.

  • 🎉1