Strongly recommend https://github.com/ssbuild/chatglm_finetuning
Simple implementation of using lora form the peft library to fine-tune the chatglm-6b
This project is just a demo for sharing ideas about using lora from peft to fine-tune chatglm-6b.
Any seggestions are welcomed！
datasets
peft
transformers
tqdm
torch
deepspeed stage3 config
validation