/kv.run

A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.

Primary LanguageC++Apache License 2.0Apache-2.0

Stargazers