lu-ym's Stars
xiaoweiChen/Clang-Compiler-Frontend
《Clang Compiler Frontend》的非专业个人翻译
ggerganov/llama.cpp
LLM inference in C/C++
xai-org/grok-1
Grok open release
eyalroz/cuda-api-wrappers
Thin, unified, C++-flavored wrappers for the CUDA APIs
gabime/spdlog
Fast C++ logging library.
conan-io/conan
Conan - The open-source C and C++ package manager
ofirpress/attention_with_linear_biases
Code for the ALiBi method for transformer language models (ICLR 2022)
triton-inference-server/tensorrtllm_backend
The Triton TensorRT-LLM Backend
RUCAIBox/LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
NVIDIA/NVTX
The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resources in your applications.
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
vosen/ZLUDA
CUDA on ??? GPUs
alibaba/Pai-Megatron-Patch
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
DeepRec-AI/HybridBackend
A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
alibaba/TePDist
TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
amix/vimrc
The ultimate Vim configuration (vimrc)
llvm/torch-mlir
The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
Dao-AILab/flash-attention
Fast and memory-efficient exact attention
ArchaeaSoftware/cudahandbook
Source code that accompanies The CUDA Handbook.
NVIDIA/NeMo
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
mlc-ai/mlc-en
mlc-ai/mlc-zh
microsoft/vcpkg
C++ Library Manager for Windows, Linux, and MacOS
huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
ROCm/rocSPARSE
Next generation SPARSE implementation for ROCm platform
pyecharts/pyecharts
🎨 Python Echarts Plotting Library
it-ebooks-0/zhihu-ai-qa
cloudcores/CuAssembler
An unofficial cuda assembler, for all generations of SASS, hopefully :)
NVIDIA/Fuser
A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")