AIApprentice101

AIApprentice101's Stars

• meta-llama/llama

  Inference code for Llama models

  Language:Python57.2k5281.1k9.7k

• rasbt/LLMs-from-scratch

  Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

  Language:Jupyter Notebook38.1k4061155k

• lm-sys/FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  Language:Python37.5k3521.9k4.6k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python33.9k2806k5.2k

• FasterDecoding/Medusa

  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

  Language:Jupyter Notebook2.4k3192166

• ray-project/ray-llm

  RayLLM - LLMs on Ray

  Language:Python1.2k198993

• persimmon-ai-labs/adept-inference

  Inference code for Persimmon-8B

  Language:Python41617724