feat: add support for OpenAI proxy apis
tranhoangnguyen03 opened this issue · 0 comments
tranhoangnguyen03 commented
LiteLLM, Llama.cpp, Vllm, OpenRouter, TogetherAI,....
Everyone has an OpenAI-like api nowadays. It would be really great to be able to use them in place of OpenAI api.
Thanks!