/TorchServe-Lab

🚀 TorchServe playground includes step by step Kubernetes installation and inference stress tests using JMeter (most models from HuggingFace)

Primary LanguagePython

Watchers