about weight initialization
pranshushah opened this issue · 1 comments
pranshushah commented
why are you using tf.contrib.layers.xavier initializer instead of tf.contrib.layers.variance_scaling_initializer() ??
wenxinxu commented
There were no documentations for the tf.contrib.layers.variance_scaling_initializer() when I wrote the code. Basically the variance scaling initializer is a more customizable version of Xavier. They are based on the same idea that adjusts the initialization with the input channels. They should perform similarly in resnet. (You may change the code and play with it.)