A problem found in the code

Question

A problem found in the code

Closed this issue 6 years ago · 1 comments

Should nn.init.constant(self.W[1].weight, 0) be changed to nn.init.constant(self.W[0].weight, 0)?

Answer 1 · 2018-09-18T05:35:36.000Z

I want to set the parameters γ and β in Batch Normalization to 0, so that the output of it will be zero. Then the output of the Non-local block is equal to the input. In this way, this block can be inserted to any models without change the behavior at the first iteration.