/intro_to_NLP

Slides and tutorials for a lecture on Natural Language Processing, CentraleSupélec

Primary LanguageJupyter Notebook

Introduction to NLP

Slides and tutorials for a lecture on Natural Language Processing, CentraleSupélec (3 March 2021)

Before starting

Run the Installation notebook for installing packages. Send me an email if anything goes wrong!

Lecture and Tutorial's objectives

  1. Knowing what Natural Language Processing (NLP) is and why it’s important
  2. Identify the main algorithms in text representation learning
  3. Spot common challenges in NLP and ethical concerns
  4. Gain intuition on what kind of information gets encoded in word representations and how it gets shown in the embedding space
  5. Get familiarised with the use of pre-trained language models, how to interpret them and implement them in a simple NLP pipeline

Outline

8:30 - 9:00 - Lecture

Word Embeddings: challenges and techniques

9:00 - 9:30 - Practical Work

Visualisation of semantic relations

9:30 - 9:45 - Break

9:45 - 10:30 - Lecture

Language Modelling: deep learning methods for NLP

10:30 - 11:00 - Practical Work

Transformer LM: Exploring a pre-trained model for Sentiment Analysis

11:00 - 11:15 - Break

11:15 - 11:45 - Practical Work

Transformer LM: Exploring a pre-trained model for Sentiment Analysis