KellerJordan/modded-nanogpt

Issues

• Add optimizer and training steps

  #5 opened a month ago by Navanit-git
  0

• Add requirements needed to run scripts

  #4 opened 3 months ago by thomasahle
  0

• did you forget to call torch.distributed.all_reduce function in train_gpt2.py

  #2 opened 3 months ago by zhangfaen
  3

• `rmsnorm` not trainable

  #1 opened 3 months ago by ChenLi2049
  1