Predicted Outputs support
hrez opened this issue · 0 comments
hrez commented
Hi,
I wonder if https://platform.openai.com/docs/guides/predicted-outputs can be (optionally) enabled for gpt-4o model?
"Predicted Outputs enable you to speed up API responses from Chat Completions when many of the output tokens are known ahead of time. This is most common when you are regenerating a text or code file with minor modifications"