/CS224n

CS224N: Natural Language Processing with Deep Learning Stanford / Winter 2024 homework

Primary LanguageJupyter Notebook

CS224N: Natural Language Processing with Deep Learning Stanford / Winter 2024 homework

課程連結: https://web.stanford.edu/class/cs224n/

Description:

This repository contains solutions to programming assignments for CS224N: Natural Language Processing with Deep Learning course offered by Stanford University in Winter 2024. The assignments cover a range of topics in natural language processing (NLP) and deep learning.

Assignment Details:

  • Assignment 1: Word Vectors
    • Introduction to word vectors and various models.
  • Assignment 2: Backpropagation, Neural Networks, Dependency Parsing
    • Implementation of backpropagation, neural networks, and dependency parsing.
  • Assignment 3: RNNs, Language Models, Vanishing/Exploding Gradients
    • Utilization of recurrent neural networks (RNNs), language modeling, and handling vanishing/exploding gradients.
  • Assignment 4: Machine Translation, Attention Mechanism, Subword Models
    • Development of machine translation models incorporating attention mechanisms and subword modeling.
  • Assignment 5: Transformers
    • Exploration and implementation of transformer models for various NLP tasks.

Repository Structure:

  • /a1: Contains code and relevant files for Assignment 1 (Word Vectors).
  • /a2: Contains code and relevant files for Assignment 2 (Backpropagation, Neural Networks, Dependency Parsing).
  • /a3: Contains code and relevant files for Assignment 3 (RNNs, Language Models, Vanishing/Exploding Gradients).
  • /a4: Placeholder for Assignment 4 (Machine Translation, Attention Mechanism, Subword Models).
  • /a5: Placeholder for Assignment 5 (Transformers).

Usage:

To explore the solutions and code for completed assignments, navigate to the respective folders (a1, a2, a3). For incomplete assignments (a4, a5), stay tuned for updates.

Dependencies:

  • Python 3.x
  • PyTorch
  • NumPy
  • Matplotlib
  • NLTK