/EricLLM

A fast batching API to serve LLM models

Primary LanguagePythonMIT LicenseMIT

Watchers