Relationship between total number of steps and epochs

[NagarajDesai1]

Hi @tyunist ,

Thanks for your code.

I have a question regarding the synthetic training script.

you have set num_total_steps = 150000 here

And I see that batch size is 128

Could you please explain why did you select these values and how can i determine the total number of epochs using num_total_steps?

Best regards,
Nagaraj

[tynguyen]

Sorry for this late rep. These numbers are mainly found empirically.