Please provide GPU requirements!

Question

Please provide GPU requirements!

Opened this issue a month ago · 8 comments

Amazing work guys, but why most projects totally skip the hardware requirements needed to run? Isn't it the most important information for a project that can be run locally?

Answer 1 · 2024-11-16T06:24:11.000Z

Thank you for your advice! In my tests on an A100 GPU, the VRAM usage is approximately 26.38GB. However, you can reduce it to around 17GB by using the offloading method with the following code after loading the pipeline:

pipe.enable_model_cpu_offload()

Answer 2 · 2024-11-16T06:26:59.000Z

Thanks a lot for posting it! Will wait to test till it can run on poor GPU (12GB) ... Best wishes guys!

Answer 3 · 2024-11-16T06:32:00.000Z

You can also test it using the Hugging Face online demo, available here.

Answer 4 · 2024-11-16T06:32:41.000Z

Sadly too much traffic; wait time it over 2 hours :(

Answer 5 · 2024-11-16T16:17:48.000Z

Then use my template on Runpod.io.
https://runpod.io/console/deploy?template=8pqb3dg7lq&ref=2pdhmpu1
1 video generate time: 8 min

Answer 6 · 2024-11-19T03:59:37.000Z

Testing on RTx4080s, half an hour has passed and progress has only reached 10%. I have given up

Answer 7 · 2024-11-19T08:15:52.000Z

Testing on RTx4080s, half an hour has passed and progress has only reached 10%. I have given up

Use A40 . 1 video 8 min

Answer 8 · 2024-11-23T00:32:06.000Z

I'm able to run it on a 3090 and get about 8-10 minutes per video