/llama-swap

On-demand model switching with llama.cpp (or other OpenAI compatible backends)

Primary LanguageGoMIT LicenseMIT

Stargazers