Choice of consistency loss

[syorami]

Thanks for sharing of your work. I've noticed that the consistency loss CE is used in your implementation, while in many other SSL works MSE is used instead. Is there any difference between these two loss choices?

[syorami]

I've found the answer in ablation study. It seems like MSE impairs the performance a little bit compared with CE.