Pinned Repositories
OpenHands
🙌 OpenHands: Code Less, Make More
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
llmtune
4-Bit Finetuning of Large Language Models on One Consumer GPU
LocalAI
:robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade GPU. LocalAI is a RESTful API to run GPTQ compatible models
OpenDevin
🐚 OpenDevin: Code Less, Make More
qlora
QLoRA: Efficient Finetuning of Quantized LLMs
text-generation-webui
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
evalplus
Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
argh-steroids
Asteroids-like game using pygame
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
dred0n's Repositories
dred0n/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.
dred0n/llmtune
4-Bit Finetuning of Large Language Models on One Consumer GPU
dred0n/LocalAI
:robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade GPU. LocalAI is a RESTful API to run GPTQ compatible models
dred0n/OpenDevin
🐚 OpenDevin: Code Less, Make More
dred0n/qlora
QLoRA: Efficient Finetuning of Quantized LLMs
dred0n/text-generation-webui
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.