Lao-yy

Lao-yy's Stars

• AnswerDotAI/fsdp_qlora

  Training LLMs with QLoRA + FSDP

  Language:Jupyter Notebook1.4k188

• OptimalScale/LMFlow

  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

  Language:Python8.3k827

• DLLXW/baby-llama2-chinese

  用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.

  Language:Python2.6k312

• git-cloner/llama2-lora-fine-tuning

  llama2 finetuning with deepspeed and lora

  Language:Python16914

• catid/dora

  Implementation of DoRA

  Language:Python28318