epam/ai-dial-adapter-openai

Support o1-mini and o1-preview models

Closed this issue · 0 comments

The main limitation of the models is the missing streaming feature.
Thus in the adapter we need to emulate the streaming otherwise the DIAL Chat won't work:

NON_STREAMING_DEPLOYMENTS=o1-mini-debug,o1-preview-debug