Number of sampling steps

Question

Number of sampling steps

Closed this issue 7 months ago · 2 comments

Hi,

If I want to train a model which can achieve good result in only 4 steps, should I set args.distill_learning_steps into 4? Because the default args.distill_learning_steps is 50. Thanks for your attention.

Answer 1 · 2024-03-10T00:12:21.000Z

You should leave the distill_learning_steps as 50 or 20. distill_learning_steps is the hyper-paramter for determining the sampling length of the teacher model.

Answer 2 · 2024-03-10T08:13:34.000Z

Thanks for your reply!