/mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers