sail-sg/MDT

Training Settings

Opened this issue · 3 comments

Yeez-lee commented

Hi, I am curious about your MDTv2_s2 settings. What is your lr_anneal_steps? Should I set it to 0? And how can I control the training steps? For example, how can I set the overall training steps to 400k? Thank you!

gasvn commented

We keep the same learning rate in our setting. And we just kill the running program when it reaches the required training step.

  • 😄1
Yeez-lee commented

We keep the same learning rate in our setting. And we just kill the running program when it reaches the required training step.

Thank you! One more question is about cfg_scale. Do you always keep 3.8 for S, B, and XL models during inference?

gasvn commented

Yes, the value is obtained with MDTv1, and I keep using 3.8 for all models of MDTv2