Finetuning already trained model
Closed this issue · 2 comments
Aniketto16 commented
can I finetune this model ?
https://huggingface.co/sshh12/Mistral-7B-LoRA-Multi-VisionCLIPPool-LLAVA
If so how to do it, I am in a hurry so please reply as soon as possible!
Thank you!
sshh12 commented
Sure, you can just follow the instructions for https://github.com/sshh12/multi_token?tab=readme-ov-file#finetuning but use the the pre-existing projector from https://huggingface.co/sshh12/Mistral-7B-LoRA-Multi-VisionCLIPPool-LLAVA/blob/main/non_lora_trainables.bin
Aniketto16 commented
Thank you so much, I understand!