Implement Warmup
gwaybio opened this issue · 1 comments
gwaybio commented
As discussed in Sonderby et al. 2016 a warm up period from deterministic to stochastic autoencoder model as training epochs proceed may enhance parameter usage.
This stackoverflow post may be useful to review.