qlora
There are 241 repositories under qlora topic.
hiyouga/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
yangjianxin1/Firefly
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
lyogavin/airllm
AirLLM 70B inference with single 4GB GPU
hiyouga/ChatGLM-Efficient-Tuning
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
iusztinpaul/hands-on-llms
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
ssbuild/chatglm_finetuning
chatglm 6b finetuning and alpaca finetuning
georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
X-D-Lab/MindChat
🐋MindChat（漫谈）——心理大模型：漫谈人生路, 笑对风霜途
jianzhnie/LLamaTuner
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
X-D-Lab/Sunsimiao
🌿孙思邈中文医疗大模型(Sunsimiao)：提供安全、可靠、普惠的中文医疗大模型
yangjianxin1/Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
ddzipp/AutoAudit
AutoAudit—— the LLM for Cyber Security 网络安全大语言模型
WangRongsheng/Aurora
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
iamarunbrahma/finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
taishan1994/Llama3.1-Finetuning
对llama3进行全参微调、lora微调以及qlora微调。
yangjianxin1/LongQLoRA
LongQLoRA: Extent Context Length of LLMs Efficiently
codelion/ellora
Enhancing LLMs with LoRA
kuutsav/llm-toys
Small finetuned LLMs for a diverse set of useful tasks
ssbuild/qwen_finetuning
qwen models finetuning
ssbuild/llm_finetuning
Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
taishan1994/qlora-chinese-LLM
使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE
NisaarAgharia/Indian-LawyerGPT
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
nikolamilosevic86/verifAI
VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
zjohn77/lightning-mlflow-hf
Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
kyegomez/Finetuning-Suite
Finetune any model on HF in less than 30 seconds
michaelnny/InstructLLaMA
Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the LLaMA2 model to follow human instructions, similar to InstructGPT or ChatGPT, but on a much smaller scale.
ssbuild/moss_finetuning
moss chat finetuning
sayedmohamedscu/Vision-language-models-VLM
vision language models finetuning notebooks & use cases (Medgemma - paligemma - florence .....)
AviSoori1x/Tuning-the-Finetuning
Tuning the Finetuning: An exploration of achieving success with QLoRA
brossign/dadAI
LLM-powered assistant for first-time dads, fine-tuned on real parenting discussions using Mistral 7B
ssbuild/rwkv_finetuning
rwkv finetuning
wangermeng2021/llm-webui
A Gradio web UI for Large Language Models. Supports LoRA/QLoRA finetuning,RAG(Retrieval-augmented generation) and Chat
ssbuild/baichuan_finetuning
baichuan and baichuan2 finetuning and alpaca finetuning
ssbuild/chatglm_rlhf
chatglm_rlhf_finetuning