/model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers