peft-fine-tuning-llm

liuqidong07/MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

nbasyl/DoRA

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

UCDvision/NOLA

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

TUDB-Labs/MoE-PEFT

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

ROIM1998/APT

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

brown-palm/AntGPT

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

misonsky/HiFT

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

SkyuForever/CRE-LLM

CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model

PRITHIVSAKTHIUR/GALLO-3XL

High Quality Image Generation Model - Powered with NVIDIA A100

DongmingShenDS/Mistral_From_Scratch

Mistral and Mixtral (MoE) from scratch

sayan112207/Text2SQL

Fine-tune StarCoder2-3b for SQL tasks on limited resources with LORA. LORA reduces model size for faster training on smaller datasets. StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues.

swastikmaiti/Llama-2-7B-Chat-PEFT

PEFT is a wonderful tool that enables training a very large model in a low resource environment. Quantization and PEFT will enable widespread adoption of LLM.

erdemormann/kanarya-and-trendyol-classification-tests

Test results of Kanarya and Trendyol models with and without fine-tuning techniques on the Turkish tweet hate speech detection dataset.

yuki-2025/llama3-8b-fine-tuning-math

Fine-tuning Llama3 8b to generate JSON formats for arithmetic questions and process the output to perform calculations.

zeyadusf/Finetuning-LLMs

Finetuning Large Language Models

zeyadusf/topics-in-nlp-llm

In this repo I will share different topics on anything I want to know in nlp and llms

AnishJoshi13/Bash-Scripting-Assistant

A bash scripting assistant that helps you automate tasks. Powered by a streamlit chat interface, A finetuned nl2bash model generates bash code from natural language descriptions provided by the user

Arya920/Natural_Language_To_SQL_Queries

The task of this project is to Convert Natural Language to SQL Queries

eshan1347/GPT-NEO-LORA

A GPT-Neo model is fine tuned on a custom dataset using huggingface transformers package

himanshuvnm/Foundation-Model-Large-Language-Model-FM-LLM

This repository was commited under the action of executing important tasks on which modern Generative AI concepts are laid on. In particular, we focussed on three coding actions of Large Language Models. Extra and necessary details are given in the README.md file.

jvoliveirag/Woodie.ai

The transformation of education starts here! Where AI and educational robotics come together to provide the best learning experience.

pankajrawat9075/Dialog-Summarization-with-Generative-AI

Using Open-Source LLMs like FLAN-T5, built a Dialog Summarization model and did fine-tuning with DialogSum HF Dataset

shoryasethia/ConversationSummarizerLLM

Fine Tuning pegasus and flan-t5 pre-trained language model on dialogsum datasets for conversation summarization to to optimize context window in RAG-LLMs

silvererudite/generative-ai

practical projects using LLM, VLM and Diffusion models

wuweilun/NTU-DLCV-2023

NTU Deep Learning for Computer Vision 2023 course

zeyadusf/Summarization-by-Finetuning-FlanT5-LoRA

qiqinyi/GenAI-with-LLMs

My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.

thekaranacharya/llm-fine-tuning

Comparing popular Parameter Efficient Fine-Tuning (PEFT) techniques for Large Language Models

akthammomani/Casual_Conversation_Chatbot

Build a Multi-turn Conversations Chit-Chat Bot

AminaMOUDJAR/Exploring-different-optimization-techniques-for-LLM

Practical work of my master's thesis

CZboop/Micro-Genre-Generator

Fine-tuning an LLM to generate musical micro-genres

doguilmak/FineTune-DiaSum-PEFT-LoRA

PEFT and LoRA to fine-tune large language models for dialogue summarization, reducing computational resources for broader application.

etechoptimist/generative_ai

This repository contains a collection of generative AI models and applications designed for various tasks such as text generation, image synthesis, and style transfer. The models leverage cutting-edge architectures like GPT, GANs, and VAEs, enabling users to explore different generative tasks.

SahilBarbade1203/Generative_AI_and_Large_Language_Models

Institute Technical Summer Project -23/24

satyampurwar/large-language-models

Unlocking the Power of Generative AI: In-Context Learning, Instruction Fine-Tuning and Reinforcement Learning Fine-Tuning.