/Learning-RNN

Toy code for RNN and LSTM

Primary LanguagePython

Toy code for learning RNN and LSTM

1. Vanilla RNN: implementation of Vanilla RNN (Python 2.7)

Major reference

  1. Rohan & Lenny #3: Recurrent Neural Networks & LSTMs
  2. Minimal character-level language model with a Vanilla Recurrent Neural Network

2. RNN with LSTM (Python 2.7)

Major reference

  1. Rohan & Lenny #3: Recurrent Neural Networks & LSTMs
  2. Simple LSTM
  3. A Critical Review of Recurrent Neural Networks for Sequence Learning

3. RNN and LSTM with TensorFlow (Python 3.6)

Major reference

  1. How to build a Recurrent Neural Network in TensorFlow
  2. Sequence Modelling: Recurrent and Recursive Nets
  3. TensorFlow Mechanics 101
  4. Recurrent Neural Networks