Baichuan-Qwen-Llama-tuning-Explained
说明:从Llama-Efficient-Tuning项目Fork而来,同时可以训练Baichuan、千问等,本项目是对其逐行代码的解析,更新中...
Llama-Efficient-Tuning-相关代码,逐行详解版。
- src/
- src/
- /src/llmtuner/tuner/tune.py 主要微调模块
- /src/llmtuner/tuner/sft/trainer.py
- const logger
- class CustomSeq2SeqTrainer
- func prediction_step
- func _pad_tensors_to_target_len
- func save_predictions
Llama Efficient Tuning源码解析train_sft.py https://zengxiaojian.blog.csdn.net/article/details/131458667