ATTENTION: Please, do not share your task solutions on GitHub or anywhere else!
Also, please do not add your name to your homework, since we try to keep review process anonymous.
Seminars plan:
- Intro to NLP, intro to word embeddings
- Word embeddings: Word2Vec, GloVe, fastText
- Language modeling, softmax crossentropy loss, one layer neural networks
- Neural networks and backpropagation, optimization
- Practical tips, gradient checking, overfitting, regularization, activation functions
- Reccurent neural networks
- GRU and LSTM, intro to machine translation
- CNN for text classification
- Machine translation, attention mechanism
- Dynamic memory networks, Deep Contextualized Word Representations, future of NLP