kkteru's Stars
karpathy/nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
run-llama/llama_index
LlamaIndex is a data framework for your LLM applications
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
google-research/tuning_playbook
A playbook for systematically maximizing the performance of deep learning models.
karpathy/llm.c
LLM training in simple, raw C/CUDA
guidance-ai/guidance
A guidance language for controlling large language models.
BlinkDL/RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
karpathy/nn-zero-to-hero
Neural Networks: Zero to Hero
NielsRogge/Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
FMInference/FlexGen
Running large language models on a single GPU for throughput-oriented scenarios.
karpathy/minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
outlines-dev/outlines
Structured Text Generation
jzhang38/TinyLlama
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
pytorch-labs/gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
mosaicml/composer
Supercharge Your Model Training
huggingface/alignment-handbook
Robust recipes to align language models with human and AI preferences
turboderp/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
srush/Tensor-Puzzles
Solve puzzles. Improve your pytorch.
seungeunrho/minimalRL
Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)
cohere-ai/cohere-toolkit
Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
predibase/lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
cfortuner/promptable
Build LLM apps in Typescript/Javascript. 🧑💻 🧑💻 🧑💻 🚀 🚀 🚀
S-LoRA/S-LoRA
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
JonasGeiping/cramming
Cramming the training of a (BERT-type) language model into limited compute.
winkjs/wink-nlp
Developer friendly Natural Language Processing ✨
hao-ai-lab/LookaheadDecoding
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
jondurbin/airoboros
Customizable implementation of the self-instruct paper.
georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
stanford-crfm/BioMedLM
sabetAI/BLoRA
batched loras