RLHFlow/Online-RLHF

How train sft on rtx4090?

Closed this issue · 1 comments

utrobinmv commented

How train sft model on rtx4090?

WeiXiongUST commented

Can you try to run with the zero3 ?

accelerate launch --config_file ./configs/zero3.yaml ./sft/sft.py