gpustack/llama-box

LLM inference server implementation based on llama.cpp.

C++MIT