supervised-finetuning

There are 45 repositories under supervised-finetuning topic.

  • InternLM/xtuner

    A Next-Generation Training Engine Built for Ultra-Large MoE Models

    Language:Python4.8k38577366

  • InternLM/InternLM-XComposer

    InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

    Language:Python2.9k43436177

  • Tebmer/Awesome-Knowledge-Distillation-of-LLMs

    This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

    1.2k15656

  • magpie-align/magpie

    [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!

    Language:Python76853569

  • GaryYufei/AlignLLMHumanSurvey

    Aligning Large Language Models with Human: A Survey

    73130131

  • chaoswork/sft_datasets

    开源SFT数据集整理,随时补充

    5422343

  • KodCode-AI/kodcode

    ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork

    Language:Python2671510

  • LIN-SHANG/InstructERC

    The offical realization of InstructERC

    Language:Python1422209

  • NVlabs/catk

    Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models. CVPR Oral 2025.

    Language:Python1415125

  • codelion/ellora

    Enhancing LLMs with LoRA

    Language:Jupyter Notebook13510

  • sail-sg/sdft

    [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".

    Language:Shell1296167

  • guanwei49/LogLLM

    LogLLM: Log-based Anomaly Detection Using Large Language Models (system log anomaly detection)

    Language:Python10820

  • yyDing1/ScaleQuest

    [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.

    Language:Python67227

  • BUAADreamer/MLLM-Finetuning-Demo

    使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory

    Language:Python50122

  • liziniu/GEM

    Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)

    Language:Python40100

  • ShiZhengyan/InstructionModelling

    [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"

    Language:Python36

  • inst-it/inst-it

    Official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning"

    Language:Python29340

  • AstraZeneca/vlm

    Official implementation for "Diffusion Instruction Tuning"

    Language:Python28223

  • fanqiwan/KCA

    EMNLP'2024: Knowledge Verification to Nip Hallucination in the Bud

    Language:Python22000

  • quanshr/AugCon

    [AAAI 2025]Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularity

    Language:Python20122

  • BUAADreamer/Qwen2-VL-History

    Qwen2-VL在文旅领域的LLaMA-Factory微调案例 The case for fine-tuning Qwen2-VL in the field of historical literature and museums

    12202

  • bhattbhavesh91/google-gemma-finetuning-n2sql

    Finetuning Google's Gemma Model for Translating Natural Language into SQL

    Language:Jupyter Notebook11204

  • KwokHing/AI-Planet-LLM-Bootcamp-Challenge

    An LLM challenge to (i) fine-tune pre-trained HuggingFace transformer model to build a Code Generation language model, and (ii) build a retrieval-augmented generation (RAG) application using LangChain

    Language:Jupyter Notebook5200

  • mirabdullahyaser/LLaMA3-Financial-Analyst

    LLM-powered financial analyst using LoRA-tuned Llama-3 and RAG pipeline to answer complex queries over SEC 10-K filings with contextual accuracy.

    Language:Jupyter Notebook40

  • ranzeet013/RLHF-CustomData

    Building an LLM with RLHF involves fine-tuning using human-labeled preferences. Based on Learning to Summarize from Human Feedback, it uses supervised learning, reward modeling, and PPO to improve response quality and alignment.

    Language:Jupyter Notebook4

  • sovit-123/lm_sft

    Various LMs/LLMs below 3B parameters (for now) trained using SFT (Supervised Fine Tuning) for several downstream tasks

    Language:Jupyter Notebook4101

  • asifhaider/LLM-Finetuning-Prompting-Project

    Python Project Sample for Demonstration

    Language:Jupyter Notebook3200

  • ChryssaNab/ECG-Heartbeat-Classification

    Binary classification of pathological heartbeats from ECG signals using 1D CNNs in PyTorch

    Language:Python3101

  • nsrinidhibhat/fine-tune-llama-2

    This project streamlines the fine-tuning process, enabling you to leverage Llama-2's capabilities for your own projects.

    Language:Python3110

  • tien02/llm-math

    Fine tune Large Language Model on Mathematic dataset

    Language:Python3100

  • rasyosef/phi-2-sft-and-dpo

    Notebooks to create an instruction following version of Microsoft's Phi 2 LLM with Supervised Fine Tuning and Direct Preference Optimization (DPO)

    Language:Jupyter Notebook2100

  • renaldiangsar/Medical-LLM-Fine-Tuning

    Fine-tuning Large Language Models (LLMs) for medical reasoning to enhances LLMs ability to understand, analyze, and generate accurate medical information.

    Language:Jupyter Notebook2

  • artaasd95/rap-music-generator

    The Rap Music Generator project is an innovative LLM-based tool designed to create rap lyrics. It offers multiple fine-tuning approaches to accommodate diverse rap generation techniques, providing users with a versatile platform for generating unique and stylistically varied content.

    Language:Jupyter Notebook1100

  • KindYAK/kaggle_20q

    Solution for Kaggle 20 Questions competetion

    Language:Jupyter Notebook1100

  • rasyosef/phi-1_5-instruct

    Notebooks to create an instruction following version of Microsoft's Phi 1.5 LLM with Supervised Fine Tuning and Direct Preference Optimization (DPO)

    1100

  • sunnynevarekar/LLM_Mistral_7b_SFT

    Finetune Mistral 7b v1.0 on custom dataset

    Language:Jupyter Notebook1100