[Feature]: Add support for Groq (LLM)
Opened this issue · 3 comments
spikecodes commented
Brief Description
Add support for using Groq as an LLM
Rationale
Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.
Suggested Implementation
Create a new LLM
XIII-IIIX commented
This would be epic!
djjrock commented
+1
Arunprakaash commented
i have added support for groq #526