[Feature]: Support openai responses API interface
guunergooner opened this issue · 0 comments
guunergooner commented
🚀 The feature, motivation and pitch
OpenAI has released a new Responses API, but vLLM does not currently support it.
We request that vLLM adds compatibility with this API to stay in sync with OpenAI's updates.
Supporting the Responses API will enhance vLLM's utility and competitiveness.
For more details, see the OpenAI documentation
-
OpenAI Responses api reference
https://platform.openai.com/docs/api-reference/responses -
OpenAI Responses vs. Chat Completions
https://platform.openai.com/docs/guides/responses-vs-chat-completions
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.