Lightning-Universe/stable-diffusion-deploy

model doesn't work properly with concurrent requests

aniketmaurya opened this issue · 1 comments

aniketmaurya commented

model doesn't work properly with concurrent requests. And Gradio is not respected enable_queue=True when we directly access the REST API.

lantiga commented

We should definitely add our own queue in the app, just a Python queue, nothing fancy.