How do I change the OpenAI base url?

Question

How do I change the OpenAI base url?

Closed this issue 8 months ago · 2 comments

Answer 1 · 2024-06-26T21:02:54.000Z

I have had some success by modifying the line 43 of "src/backend/llm/base.py" to: self.llm = LiteLLM(model=model, api_base="http://192.168.73.78:5000/v1") where "http://192.168.73.78:5000/v1" is the IP of your server.

Doing this, it will generate a response and then error saying that the API key is invalid.

I inform you if I manage to fix this.

Answer 2 · 2024-06-26T21:33:18.000Z

Thank you it worked!