malzag

malzag's Stars

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++74.3k5714.5k10.7k

• distantmagic/paddler

  Stateful load balancer custom-tailored for llama.cpp 🏓🦙

  Language:Rust72082029

• distantmagic/resonance

  PHP Framework designed to build IO-intensive web applications.

  Language:PHP2149211

• distantmagic/llmops-handbook

  Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

  Language:CSS60644

• distantmagic/structured

  Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

  Language:Go43101

• phpgoodness/phpgoodness.com

  Language:PHP820

• distantmagic/aloni

  Async Python framework optimized for IO-heavy applications.

  Language:Python3000