finetune
nikeaddidaslining opened this issue · 1 comments
nikeaddidaslining commented
Hello！ i want to ask about how to finetuning with lora？
Cuiunbo commented
If you need to quickly and cost-effectively fine-tune VisCPM, you can refer to the finetune code in the CPMbee repository. In it, opendelta is used for LoRA-related operations. Below is a link you might want to check out:
https://github.com/OpenBMB/CPM-Bee/blob/main/src/finetune_cpm_bee.py