Why not use the Online Distilling?
CuddleSabe opened this issue · 1 comments
CuddleSabe commented
The teacher's input include the gt.
and the student's input only the lr
no stage one , online distilling
Zj-BinXia commented
The performance of this scheme is not good. You can try these new scheme experiments by yourself without asking me.