question about disabling gradient bp
XiaoyuShi97 opened this issue · 1 comments
XiaoyuShi97 commented
https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/ema_module.py#L41
Hi. It seems you forget this line, which may also disable gradient bp of the student encoder? Thx!
arxyzan commented
Hello Xiaoyu, thanks for your suggestion. I fixed the issue!