Support for Groq
sorcerer2073 opened this issue · 1 comments
sorcerer2073 commented
I was just wondering if anyone has been able to make it work with groq?
zhudotexe commented
I haven't used Groq personally, but as a cloud-based provider it shouldn't be too difficult to implement an engine for it. You'll want to look at the docs for Implementing an Engine and an existing engine implementation (e.g. LlamaCppEngine as a less-complex example of using a Python library as an engine provider).
If you do implement a Groq engine it would make for a great extension package or PR!