dkohlsdorf/AutoDiff

A simple auto differenciation program for neural networks

A simple auto differenciation program for neural networks

• Implements autodifferentiation for matrix computations.
• Implements matrix add and gradient
• Implements matrix inner product and gradient
• Implements element wise sigmoid in gradient
• Implements small neural network
• Cant be used for weight sharing though

Installation:

• install scala
• install sbt

Usage:

• In the project directory
• ./sbt
• run experiments.MNISMultiLayer
• run experiments.SpiralMultiLayer

In order to get MNIST as a csv file do

• Getting mnist: http://yann.lecun.com/exdb/mnist/
• Convert mnist to csv: http://pjreddie.com/projects/mnist-in-csv/