/deep-learning-theano

Theano

Primary LanguagePython

Deep Learning Implementation with Theano

About

This repository is simple implementation of some deep learning algorithms.

MNIST Examples

Usage

e.g.

cd example
python mlp.py

Files

  • Multi-Layer Perceptron (example/mlp.py)
  • Denoising Autoencoder (example/da.py)
  • Sparse Autoencoder (example/sa.py)
  • Convolutional Neural Network (example/cnn.py)

Layers

in dnn/layer.py

  • Fully-Connected Layer
  • 2-Dimensional Convolutional Layer
  • 2-Dimensional Max Pooling Layer
  • Batch Normalization Layer

Optimizers

in dnn/optimizers.py

  • Stochastic Gradient Descent (SGD)
  • Momentum Stochastic Gradient Descent (Momentum SGD)
  • AdaGrad
  • RMSprop
  • AdaDelta
  • Adam

Requirements