huggingface/autotrain-advanced

Is it ok to write the target_modules in full?

Closed this issue · 2 comments

The configs gave

target_modules: all-linear

Is this equivalent to the code below?

target_modules: "q_proj,v_proj,o_proj,k_proj,gate_proj,down_proj,up_proj"

Will there be any differences between the either option? Is that the correct format for the second code? This is for SFT LLM. Thanks. @abhishekkrthakur

This issue is stale because it has been open for 30 days with no activity.

This issue was closed because it has been inactive for 20 days since being marked as stale.