Model initialization in SSL training rounds

[wangkaihong]

Hi,

During the second and the third round of SSL training, are the models still be trained from scratch or restored from the end of the previous round? According to the instruction, it seems like it will be initialized from scratch again?

Thanks