wenxinxu/resnet-in-tensorflow

about weight initialization

pranshushah opened this issue · 1 comments

why are you using tf.contrib.layers.xavier initializer instead of tf.contrib.layers.variance_scaling_initializer() ??

There were no documentations for the tf.contrib.layers.variance_scaling_initializer() when I wrote the code. Basically the variance scaling initializer is a more customizable version of Xavier. They are based on the same idea that adjusts the initialization with the input channels. They should perform similarly in resnet. (You may change the code and play with it.)