erlensy/automatic_differentiation

Optimization AD

Current state:

Automatic differentiation library: https://enzyme.mit.edu/

Current optimizer: https://arxiv.org/pdf/1412.6980.pdf

Other links:

Other optimizers: https://johnchenresearch.github.io/demon/

YellowFin optimizer: https://arxiv.org/pdf/1706.03471.pdf