finetuning

There are 335 repositories under finetuning topic.

  • unsloth

    unslothai/unsloth

    Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory

    Language:Python20.5k1351.2k1.5k

  • meta-llama/llama-recipes

    Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

    Language:Jupyter Notebook15.9k1934052.3k

  • linkedin/Liger-Kernel

    Efficient Triton Kernels for LLM Training

    Language:Python4.2k43147240

  • h2oai/h2o-llmstudio

    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

    Language:Python4.1k80403423

  • microsoft/FLAML

    A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

    Language:Jupyter Notebook4k59522517

  • Dataherald/dataherald

    Interact with your SQL database, Natural Language to SQL using LLMs

    Language:Python3.4k2543240
  • learn2learn

    learnables/learn2learn

    A PyTorch Library for Meta-learning Research

    Language:Python2.7k32259356

  • stochasticai/xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

    Language:Python2.6k33102208

  • eosphoros-ai/Awesome-Text2SQL

    Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.

    2.1k235155
  • finetuner

    jina-ai/finetuner

    :dart: Task-oriented embedding tuning for BERT, CLIP, etc.

    Language:Python1.5k2825267

  • LazyAGI/LazyLLM

    Easiest and laziest way for building multi-agent LLMs applications.

    Language:Python1.1k94168

  • SocialAI-tianji/Tianji

    制作懂人情世故的大语言模型 | 涵盖提示词工程、RAG、Agent、LLM微调教程

    Language:Python1.1k6974

  • adithya-s-k/AI-Engineering.academy

    Mastering Applied AI, One Concept at a Time

    Language:Jupyter Notebook8169298

  • georgian-io/LLM-Finetuning-Toolkit

    Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

    Language:Python802165195

  • daswer123/xtts-webui

    Webui for using XTTS and for finetuning it

    Language:Python70521107138

  • xing61/zzz-api

    优质稳定的OpenAI的API接口-For企业和开发者。OpenAI的api proxy，支持ChatGPT的API调用，支持openai的API接口，支持：gpt-4，gpt-3.5。不需要openai Key, 不需要买openai的账号，不需要美元的银行卡，通通不用的，直接调用就行，稳定好用！！智增增

    Language:PHP69272858

  • minosvasilias/godot-dodo

    Finetuning large language models for GDScript generation.

    Language:Python5338926

  • junxia97/awesome-pretrain-on-molecules

    [IJCAI 2023 survey track]A curated list of resources for chemical pre-trained models

    50619153

  • Xirider/finetune-gpt2xl

    Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

    Language:Python43652274
  • aikit

    sozercan/aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

    Language:Go40684132

  • IBM/data-prep-kit

    Open source project for data preparation of LLM application builders

    Language:HTML40018333150

  • microsoft/AzureML-BERT

    End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

    Language:Jupyter Notebook3972234125

  • helixml/helix

    🧬 Helix is a production-ready GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

    Language:Go376720537

  • baidubce/bce-qianfan-sdk

    Provide best practices for LMOps, as well as elegant and convenient access to the features of the Qianfan MaaS Platform. (提供大模型工具链最佳实践，以及优雅且便捷地访问千帆大模型平台）

    Language:Jupyter Notebook3463221853

  • HKUSTDial/NL2SQL_Handbook

    This is a continuously updated handbook for readers to easily track the latest NL2SQL (Text-to-SQL) techniques in the literature and provide practical guidance for researchers and practitioners. If we missed any interesting work, feel free to contact us.

    Language:Python3119117

  • LHRLAB/ChatKBQA

    [ACL 2024] Official resources of "ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models".

    Language:Python27822123

  • JosefAlbers/Phi-3-Vision-MLX

    Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon

    Language:Jupyter Notebook2557816

  • kingTLE/literary-alpaca2

    从词表到微调这就是你所需的一切

    Language:Python25031024

  • promptslab/LLMtuner

    FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)

    Language:Python2354415

  • gyunggyung/KoGPT2-FineTuning

    🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥

    Language:Python2295955

  • zjysteven/lmms-finetune

    A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.

    Language:Python22365026

  • rasbt/dora-from-scratch

    LoRA and DoRA from Scratch Implementations

    Language:Jupyter Notebook1933114

  • ServiceNow/TapeAgents

    TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle

    Language:Python17818

  • git-cloner/llama2-lora-fine-tuning

    llama2 finetuning with deepspeed and lora

    Language:Python17131814

  • ssbuild/chatglm2_finetuning

    chatglm2 6b finetuning and alpaca finetuning

    Language:Python14533017

  • woctezuma/finetune-detr

    Fine-tune Facebook's DETR (DEtection TRansformer) on Colaboratory.

    Language:Jupyter Notebook14241024