linstreamer

Pinned Repositories

FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Language:Python00
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Language:Svelte00
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:Python00
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Language:Python37.4k 351 1.8k4.6k
mscclpp
MSCCL++: A GPU-driven communication stack for scalable AI applications
Language:C++273 19 10543

linstreamer's Repositories

linstreamer/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
linstreamer/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Language:Python
linstreamer/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs