[Feature Request] Azure OpenAI Support
Opened this issue · 1 comments
jgbradley1 commented
Does ART currently support making connections to Azure OpenAI models? I see support for OpenAI models here.
It seems like it would only require a couple of updates in a few places to allow AsyncAzureOpenAI in addition to AsyncOpenAI.
Kovbo commented
Hi @jgbradley1,
How are you planning to use it? For most use cases, like LLM-as-a-judge, you can use any clients directly, without relying on the Model abstraction.
I imagine the only time you might actually need it is to compare Azure OpenAI model performance with your own trained models. But isn’t it possible to call Azure models directly through the OpenAI client?