/llama-swap

transparent proxy server for llama.cpp's server to provide automatic model swapping

Primary LanguageGoMIT LicenseMIT

Stargazers

No one’s star this repository yet.