/llm-serving

Basic APIs for serving LLMs locally.

Primary LanguagePythonMIT LicenseMIT

Watchers