It seems the mean teacher does not contribute to the loss.
jonkoi opened this issue · 2 comments
jonkoi commented
The teacher model ema_model is updated every step, but it is never use for forward prop. Thus, I am not sure if mean teacher does anything.
sanyouwu commented
The ema_model only used in valuation and test step. Actually, I think it does not work to improve the model's efficiency. @jonkoi
jonkoi commented
I see. Thanks for clearing this up for me. Closing this issue.