avidwriter

Pinned Repositories

• llama.cpp

  LLM inference in C/C++

  Language:C++69.9k5584.2k10.1k

• exllamav2

  A fast inference library for running LLMs locally on modern consumer-class GPUs

  Language:Python3.8k35489290

avidwriter's Repositories