too slow to generate an image

Question

too slow to generate an image

Closed this issue 3 years ago · 2 comments

Thanks for your nice work and code! But I found it is too slow. When inference, how long does it take to generate an image? On my V100, it takes 40+ seconds to generate an image, is this reasonable? I found that most of the time is consumed in the transformer forward.

Answer 1 · 2022-02-17T08:00:01.000Z

Hi hjq133,

Yes, it will take 30-60s per image for inference, as the autoregressive model predicts each token one by one (up to 32x32). Thanks.

Regards,
Yingchen

Answer 2 · 2022-02-21T05:47:18.000Z

Thanks for your reply, I just see it.

Nice work!

I will close this issue.