Azure OpenAI API

Question

Azure OpenAI API

jamie93201 opened this issue 8 months ago · 2 comments

jamie93201 commented 8 months ago

How to config with Azure OpenAI?

Answer 1 · 2024-02-06T02:42:55.000Z

OK,I fixed it

llm_api_key:
llm_base_url: https://test.openai.azure.com/
llm_custom_provider: azure
llm_model: TESTmodel

and go to "llm_client.py"

response = completion(
base_url=self.base_url,
api_key=self.api_key,
model=self.model,
messages=messages,
api_version='2023-07-01-preview', <---add this one
temperature=1.0,
custom_llm_provider=self.custom_provider,

Answer 2 · 2024-02-06T21:07:09.000Z

Thanks for reporting. I updated the readme. It doesn't say exactly what to do but it points to litellm which has good docs for azure.