LLM360/amber-train

Where did you train the model?

Closed this issue a year ago · 1 comments

filopedraz commented a year ago

Did you use Deepspeed to train the model?

hunterhector commented a year ago

The backend is simply FSDP, https://github.com/LLM360/amber-train/blob/main/main.py#L129