GHBigD

Pinned Repositories

• DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.1k4.2k

• exllamav2

  A fast inference library for running LLMs locally on modern consumer-class GPUs

  Language:Python3.8k290

• aphrodite-engine

  Large-scale LLM inference engine

  Language:Python1.2k135

• SillyTavern-CacheChunker

  Extension for improving cache utilization in Silly Tavern

  Language:JavaScript83

GHBigD's Repositories