/torch_batcher

Serve pytorch inference requests using batching with redis for faster performance.

Primary LanguagePython

No issues in this repository yet.