This repository provides course materials of the Natural Language Processing course at NTHU (instructor: Prof. Hung-Yu Kao).
| Week | Topics | Slide | Video | Slido |
|---|---|---|---|---|
| W1 | 課程簡介 Syllabus / Introduction to NLP | Slide |
Video1 Video2 |
Slido |
| W2 | 自然語言處理簡介 (1/2) Introduction to NLP (vector space, indexing, parts of speech, phrase structure) | Slide1 Slide2 |
Video1 Video2 |
Slido |
| W3 | 自然語言處理簡介 (2/2) Introduction to NLP (Language model) | Slide2 |
Video |
Slido |
| W4 | 基礎文字資料機器學習 (1/2) Basic machine learning for text (Text Classification, NB, NN) | Slide3-1 Slide3-2 Slide3-3 |
Video1 Video2 |
Slido |
| W5 | 基礎文字資料機器學習 (2/2) Basic machine learning for text (word embedding, text representation) | Slide4 |
Video |
Slido |
| W6 | 文字生成式AI簡介(1/3) Introduction to GAI (text): Word Embeddings, Language Modeling (RNN), Sequence-to-sequence Models, and Attention Mechanisms, Sub-word Tokenization; Transformers | Video |
Slido |
|
| W7 | Python for text tutorial (1/2) | SlideTA |
VideoTA |
Slido |
| W8 | Python for text tutorial (2/2) | |||
| W9 | 文字生成式AI簡介(2/3) Introduction to GAI (text): ELMo, BERT, GPT, and T5 (BERT and its Family) | |||
| W10 | 文字生成式AI簡介(3/3) Introduction to GAI (text): Decoding Strategies and Evaluations for Natural Language Generation | |||
| W11 | 大語言模型簡介與訓練 (1/3): Large language model concept and training (GPT-3, InstructGPT, RLHF) | |||
| W12 | 大語言模型簡介與訓練 (2/3): Parameter Efficient Fine-Tuning (PEFT) | |||
| W13 | 大語言模型簡介與訓練 (2/3): Introduction and Review technique of Retrieval Augmented Generation (RAG) | |||
| W14 | Term project presentation (1/3) | |||
| W15 | Term project presentation (1/3) | |||
| W16 | Term project presentation (1/3) | |||
| W17 | Term Project (demo) (optional) | |||
| W18 | Term Project (demo) (optional) |
- Italics: Tutorial; Bold: Reporting