/rnn_language_models

rnn language model implementation using numpy/pytorch

Primary LanguagePython

RNN Language Models

Recurrent language model implementations using numpy

Models

  • Vanilla RNN LM
  • LSTM LM
  • Original Seq2Seq
  • Seq2Seq with Dot Product Attention

References

  • Long Short-Term Memory, Sepp Hochreiter and Jürgen Schmidhuber.
  • Effective Approaches to Attention-based Neural Machine Translation, Luong et al.
  • Neural Machine Translation by Jointly Learning to Align and Translate, Bahdanau et al.
  • Sequence to Sequence Learning with Neural Networks, Sutskever et al.

Author