dzier

Pinned Repositories

• PyProf

  A GPU performance profiling tool for PyTorch models

  Language:Python49219046

• client

  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

  Language:C++5481633225

• core

  The core library and APIs implementing the Triton Inference Server.

  Language:C++10115096

• hugectr_backend

  Language:Jupyter Notebook509159

• model_analyzer

  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

  Language:Python4191415874

• onnxruntime_backend

  The Triton backend for the ONNX Runtime.

  Language:C++1221610554

• python_backend

  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

  Language:C++523120143

• pytorch_backend

  The Triton backend for the PyTorch TorchScript models.

  Language:C++11712043

• server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  Language:Python8k1393.7k1.4k

• tensorflow_backend

  The Triton backend for TensorFlow.

  Language:C++4410019

dzier's Repositories