Add Streaming Response support
Closed this issue · 1 comments
markokraemer commented
Make_llm_api_call should return streaming response if stream=True, and so should the run_thread RESPONSE then so it can be streamed as its received, while add_message then adds it finally to the thread.
markokraemer commented
Closed – can now stream with tool calls.