/LitServe

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers