Stream Response not working

Question

Stream Response not working

NereaCassian opened this issue a year ago · 3 comments

The responses of the AI are not being streamed

i have the ui deployed o a linux VPS with 11gigs and 8vcores

Answer 1 · 2023-08-31T21:27:29.000Z

I noticed streaming stopped working for me, so went back and set everything up again. It all worked fine until I enabled HTTPS (using certbot for nginx). Once I was using HTTPS streaming stopped working.

Answer 2 · 2023-09-01T22:14:08.000Z

This appears to be an issue when using nginx as a reverse proxy. Adding proxy_buffering off; in the location block fixed it.

Answer 3 · 2023-09-02T16:55:07.000Z

Yep doing that solved it.