kuprel/min-dalle

Average creation time has more than doubled for non-mega on torch

w4ffl35 opened this issue · 3 comments

w4ffl35 commented

Latest branch (using torch, not mega rtx 2080s 8g)

It took 0:01:14.897944 to generate F10 images

Average time to generate an image: 0:00:07.489794

Rolled back to 3837710

It took 0:00:33.533277 to generate F10 images

Average time to generate an image: 0:00:03.353328

Something between 3837710 and HEAD has more than doubled average creation time @kuprel

Originally posted by @w4ffl35 in #39 (comment)

kuprel commented

Thanks for catching that. Is the commit I just made faster?

w4ffl35 commented

Yes back down to 3.485653 generation on average without mega, thanks!

Would you like me to commit a script that will allow you to run quick speed tests?

  • 👍1
kuprel commented

I've been running this command: time python3 image_from_text.py --torch --token_count=4

It only generates 4 tokens instead of all 256, and times it

  • 👍1