cloneofsimo/min-max-gpt

Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training

Python

Issues

Taking wandb settings from env vars?
#8 opened 7 months ago by yaroslavvb
2
flash_attention2
#2 opened 7 months ago by ScottishFold007
2