exllamav2

There are 4 repositories under exllamav2 topic.

  • av/harbor

    Effortlessly run LLM backends, APIs, frontends, and services with one command.

    Language:Shell20031412

  • nickpotafiy/illama

    A fast, lightweight, parallel inference server for Llama LLMs.

    Language:Python220

  • sammcj/tabload

    TabLoad is a GUI application for interacting with TabbyAPI the Exllamav2 Server

    Language:Go110

  • mushinbush/tabbyUI

    A Streamlit web UI for exllamav2's API (tabbyAPI).

    Language:Python