Serve: Provide OpenAI SDK compatible API

Question

Serve: Provide OpenAI SDK compatible API

HavenDV opened this issue 7 months ago · 5 comments

HavenDV commented 7 months ago

What would you like to be added:

Why is this needed:

Anything else we need to know?

Answer 1 · 2024-05-18T11:45:23.000Z

It should allow https://github.com/open-webui/open-webui usage

Answer 2 · 2024-05-21T09:31:12.000Z

Could you please add non-ssl url (for example, LM Studio's open ai using url for local server is http://localhost:1234 by default) supported in OpenAIProvider?

Answer 3 · 2024-05-21T09:35:05.000Z

.

you can use this constructor and https = false in OpenAIClientSettings to bypass it

Answer 4 · 2024-05-21T09:48:28.000Z

I will soon change the OpenAI sdk (it will be completely generated from their official OpenAPI and will contain all the features at the time of their release) so there is no point in changing anything yet

Answer 5 · 2024-05-22T23:19:55.000Z

Thank you so much. I'll try it soon.