Running under 20 seconds on AWS

Question

Running under 20 seconds on AWS

mm3509 opened this issue 2 years ago · 4 comments

I tried this code and it is much faster than the original Stable Diffusion, so thank you for that. I can generate images in 1m30s using a g4dn.2xlarge machine on AWS with Tesla T4 GPU with 16 GB. What would be the cloud equivalent of your setup with RTX2060 to generate images under 20 seconds?

Answer 1 · 2022-09-23T08:03:28.000Z

hi，how many images are generated in 1m30s? I performed the original stable diffusion to generate 6 images in 2m20s on Tesla P40 GPU with 24 GB. I wonder if there is a better way to improve inference speed and reduce inference time?

Answer 2 · 2022-09-24T22:26:51.000Z

I might be wrong, but I believe this is not the right version of SD to use in such setup, this one is optimized mostly for low VRAM video cards and not for speed. It takes like 2 and a half minutes to generate 4 images, and I have an old 4 GB VRAM video card, a toy when compared to those you just mentioned.

Answer 3 · 2022-09-29T09:41:19.000Z

I generated 4 images in 1m30s with this code. If you find a way to optimize the speed with different code or setup, could you please post it here? Thank you!

Answer 4 · 2022-09-30T20:41:21.000Z

fyi on my RTX3090 this fork is 30% slower to inference (with the turbo flag activated), than the original repo, for similar job. But the ram usage is considerably smaller with the fork. reallygood fork giving an interesting flexibility w.r.t ram usage.