tlogn

Pinned Repositories

• accelerate

  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

  Language:Python7.4k981.5k879

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++7.5k881.6k816

• pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python80.5k1.7k43.3k21.6k

tlogn's Repositories