Serve LLMs on a docker container for scaling horizontally.
Primary LanguagePython
No one’s star this repository yet.