OptimalScale/LMFlow

Hello，Where is the script run_finetune_with_lora_save_aggregated_weights.sh？Why I can't find it in LMFlow/scripts ?

13416157913 opened this issue · 2 comments

research4pan commented

Thanks for the valuable suggestion! You may find this script in https://github.com/OptimalScale/LMFlow/blob/4459b46cf55cebeb59dd44fc4c87768dfdf99518/scripts/run_finetune_with_lora_save_aggregated_weights.sh. We removed it since we found that OOM may occur at the end of training, so we decide to decouple the lora training logics and the aggregation logics, which are currently integrating into the repo.

We will remove this section of README temporarily and add the comment again once the feature is ready. Thanks for pointing that out 😄

  • 👍1
13416157913 commented

We will remove this section of README temporarily and add the comment again once the feature is ready. Thanks for pointing that out

Thanks for your answer.