/NTM-tensorflow

"Neural Turing Machine" in Tensorflow

Primary LanguageJupyter NotebookMIT LicenseMIT

Neural Turing Machine in Tensorflow

Tensorflow implementation of Neural Turing Machine. This implementation uses an LSTM controller. NTM models with multiple read/write heads are supported.

alt_tag

The referenced torch code can be found here.

** 1. Loss sometimes goes to nan even with the gradient clipping (#2).** ** 2. The code is very poorly design to support NTM inputs with variable lengths. Just use this code as a reference.**

Prerequisites

Usage

To train a copy task:

$ python main.py --task copy --is_train True

To test a quick copy task:

$ python main.py --task copy --test_max_length 10

Results

More detailed results can be found [here](ipynb/NTM\ Test.ipynb).

Copy task:

alt_tag alt_tag

Recall task:

(in progress)

Author

Taehoon Kim / @carpedm20