Collection of unfinished tutorials. May be good for educational purposes.
Deliberately slow-moving, explicit tutorial. I tried to thoroughly explain everything that I found in any way confusing.
Implements simple seq2seq model described in Sutskever at al., 2014 and tests it against toy memorization task.
Picture from Sutskever at al., 2014
Encoder is bidirectional now. Decoder is implemented using
tf.nn.raw_rnn. It feeds previously generated tokens during training as inputs, instead of target sequence.
Picture from Deep Learning for Chatbots
New dynamic seq2seq appeared in r1.0. Let's try it.