zkf331

Pinned Repositories

• model_zoo

  11422

• object_detection

  Language:Python2420

• QUIK

  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024

  Language:C++1756714

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++9.2k982.2k1.1k

• OmniQuant

  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  Language:Python755178859

zkf331's Repositories