/build-llm-from-scratch

Primary LanguagePython

Build a Large Language Model From Scratch

Setup

  • Python 3.12

After checkout initialize virtual environment:

py -3.12 -m venv .\.venv\
.\.venv\Scripts\activate.ps1
pip install -r requirements-pytorch.txt
pip install -r requirements.txt

Edit notebooks with Marimo:

marimo edit .\llm_from_scratch\appx_a\listing_A_part_2.py