huggingface/llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters

PythonMIT