Opened this issue 2 years ago · 1 comments
Hi,
We do not recommend optimizing this since the module is part of the teacher's supervision, if we optimize with this, may lead to trivial solutions or similar situations as the 1x1 conv results. But, sure, you could try it.