Is it possible to add custom proxy?
OmiiiDev opened this issue · 2 comments
Can I use this with a custom OpenAI api proxy URL?
It would be good. It would allow for more llm's from HF or openrouter to be used with this bot, making it a lot more versatile.
I know you can modify the urls in, /models/opennai_model.py, into f-string values and have them pull 'https://api.openai.com/v1' from .env.
The langchain requests also need to be updated.
I know how to do that much but there are other functions that generally break.
@Kav-K im happy to do a PR request for the changes i know how to do.
Its basically the same request as my ticket below.
@AndrewsPanda Yeah sounds great! If you want to get started on a PR with what you can do, I will build on top of it and finish/polish it up!
This is definitely something that I've wanted to implement, added this to the roadmap and prioritized it.