feature request: connect to vLLM.
Opened this issue · 1 comments
PaulConyngham commented
It would be great to be able to connect your fork of chatbot-UI to vLLM which supports an openai api like interface
PaulConyngham commented
any updates with this? It would be super cool to be able to connect to a local hosted model via a chatcompletions interface