/LitServe

Lightning-fast serving engine for any AI model of any size. Flexible. Easy. Enterprise-scale.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers