koosha-t/NLP_with_DeepLearning

NLP Using PyTorch

Must-Read Resources

RNN / LSTMs

• Understanding LSTM Networks by Chris Olah
• The Unreasonable Effectiveness of Recurrent Neural Networks by Andrej Karpathy
• Exploring LSTMs by Edwin Chen

Word Embedding (word2vec)

• A really good conceptual overview of Word2Vec from Chris McCormick
• First Word2Vec paper from Mikolov et al.
• Neural Information Processing Systems, paper with improvements for Word2Vec also from Mikolov et al.

Seq2Seq Models With Attention

• Awesome blog with amazing illustrations explaning RNN Seq2Seq models and Attention networks.

Notebooks

Datasets

• Anna Karenina novel by Leo Tolstoy
• Cleaned up Wikipedia article text from Matt Mahoney