vocodedev/vocode-core

[Feature]: Add support for Groq (LLM)

Opened this issue · 3 comments

Brief Description

Add support for using Groq as an LLM

Rationale

Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.

Suggested Implementation

Create a new LLM

This would be epic!

+1

i have added support for groq #526