chenpei2

Pinned Repositories

• llama.cpp

  LLM inference in C/C++

  Language:C++70.1k10.1k

• minio

  MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.

  Language:Go49.2k5.6k

• vcpkg

  C++ Library Manager for Windows, Linux, and MacOS

  Language:CMake23.6k6.5k

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++9.1k1k

• tokenizers-cpp

  Universal cross-platform tokenizers binding to HF and sentencepiece

  Language:C++28966

chenpei2's Repositories