itayhubara/BinaryNet

Why are we multiplying (instead of dividing) by the std here?

AndyShih12 opened this issue 6 years ago · 1 comments

AndyShih12 commented 6 years ago

BinaryNet/Models/BatchNormalizationShiftPow2.lua

Line 74 in d4cc803

self.output:cmul(self.buffer)

itayhubara commented 6 years ago

Because we save the running_std reciprocal - look at line 90