grok api
Opened this issue · 3 comments
kaly9 commented
can you use grok api instead of open ai ?
dot-Justin commented
Do you mean Groq? Groq is pretty compatible with the openai API, but one major thing is that it doesn't support any vision queries. https://console.groq.com/docs/openai
kaly9 commented
yes that what i mean, Groq is very fast and free if we found a free vision api or local vision that well be great
dot-Justin commented
Potentially Groq running llama3 with Ollama running Llava locally