teith

Pinned Repositories

• flymyai-python

  Language:Python40

• TensorRT

  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

  Language:C++10.6k1573.7k2.1k

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++8.3k891.8k935

• onnxruntime_backend

  The Triton backend for the ONNX Runtime.

  Language:C++1241610654

• server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  Language:Python8.1k1393.7k1.5k

teith's Repositories