apocas/restai

Alternative way to import OPENAI?

Closed this issue · 1 comments

rjtormis commented

I have a deployed openai service in azure and I want to utilize it, is there anyway to import besides using OPENAI_API_KEY ?

AZURE_OPENAI_API_ENDPOINT=
AZURE_OPENAI_API_KEY=
AZURE_OPENAI_API_VERSION=
AZURE_OPENAI_API_INSTANCE_NAME=
AZURE_OPENAI_API_DEPLOYMENT_NAME=
AZURE_OPENAI_API_EMBEDDINGS_DEPLOYMENT_NAME=

their format looks like this. Thanks!

apocas commented

Yes you can pass any constructor parameters, just edit a LLM in the frontend and change the options field with a json with all the options accepted by the class you selected.

Example:
{model="gpt-35-turbo-16k", deployment_name="my-custom-llm", api_key="xxxxxxxxx", azure_endpoint="https://<your-resource-name>.openai.azure.com/", api_version="2023-07-01-preview"}

Additionally I added llamaindex's AzureOpenAI class to the supported LLMs, it allows a better integration with Azure:
e853a34#diff-08524b3ea22905074b8c7494a1dfc7d8f430f76f38b14d443d3eb0ae99093348R40

  • ❤️1