Repository for a one-week NLP class given In January 2022 for the Data Science Specialty @ Emines, Mohammed VI University, Ben Guerir, Morocco.
- Day 1: Introduction, Text Processing, word embeddings models
- Day 2: Recurrent Neural Networks, Application to Text Classification
- Day 3: Language Models, Natural Language Generation, Evaluation Metrics
- Day 4: Sequence to Sequence Models with Attention, Transformers - Application to Machine Translation
- Day 5: Pretrained Language Systems, Transfer Learning in NLP
- Day 1: Exploring Text preprocessing techniques and word embeddings models
- Day 2: Building a sentiment analysis classifier with a RNN on the Stanford Sentiment Treebank dataset
- Day 3: Training a RNN Language Model on the ROC Stories dataset
- Day 4: Build an end-to-end French-English Machine Translation System
- Day 5: Generating Text with pretrained Language Models
- Evaluated Exercises
-
Day 1:
- GloVe embedding model
- Overview of word embeddings models: 1 + 2
-
Day 2:
-
Day 3:
-
Day 4:
-
Day 5:
- The Transformer XL - Learning Cross-Lingual embeddings
- Using BERT for topic modelling: 1 + 2