/natural-gradient-nn

Simple pytorch implementation of natural gradient.

Primary LanguagePythonMIT LicenseMIT

natural-gradient-nn

Simple pytorch implementation of natural gradient.

References:

  • Ollivier, Y. (2015). Riemannian metrics for neural networks I: feedforward networks. Information and Inference: A Journal of the IMA, 4(2), 108-153.