Is it ok to write the target_modules in full?
Closed this issue · 2 comments
jackswl commented
The configs gave
target_modules: all-linear
Is this equivalent to the code below?
target_modules: "q_proj,v_proj,o_proj,k_proj,gate_proj,down_proj,up_proj"
Will there be any differences between the either option? Is that the correct format for the second code? This is for SFT LLM. Thanks. @abhishekkrthakur
github-actions commented
This issue is stale because it has been open for 30 days with no activity.
github-actions commented
This issue was closed because it has been inactive for 20 days since being marked as stale.