bm777/candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
RustMIT
Watchers
No one’s watching this repository yet.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
RustMIT
No one’s watching this repository yet.