lu-ym

lu-ym's Stars

• xiaoweiChen/Clang-Compiler-Frontend

  《Clang Compiler Frontend》的非专业个人翻译

  Language:TeX27

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++64.1k9.2k

• xai-org/grok-1

  Grok open release

  Language:Python49.4k8.3k

• eyalroz/cuda-api-wrappers

  Thin, unified, C++-flavored wrappers for the CUDA APIs

  Language:C++76779

• gabime/spdlog

  Fast C++ logging library.

  Language:C++23.6k4.4k

• conan-io/conan

  Conan - The open-source C and C++ package manager

  Language:Python8.1k959

• ofirpress/attention_with_linear_biases

  Code for the ALiBi method for transformer language models (ICLR 2022)

  Language:Python49638

• triton-inference-server/tensorrtllm_backend

  The Triton TensorRT-LLM Backend

  Language:Python63893

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python9.9k777

• NVIDIA/NVTX

  The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resources in your applications.

  Language:C27447

• NVIDIA/TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++8k880

• NVIDIA/TensorRT

  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

  Language:C++10.5k2.1k

• vosen/ZLUDA

  CUDA on ??? GPUs

  Language:Rust8.8k576

• alibaba/Pai-Megatron-Patch

  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

  Language:Python61585

• DeepRec-AI/HybridBackend

  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster

  Language:C++15230

• alibaba/TePDist

  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.

  Language:C++8610

• amix/vimrc

  The ultimate Vim configuration (vimrc)

  Language:Vim Script30.5k7.3k

• llvm/torch-mlir

  The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

  Language:C++1.3k467

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python13.1k1.2k

• ArchaeaSoftware/cudahandbook

  Source code that accompanies The CUDA Handbook.

  Language:Cuda491187

• NVIDIA/NeMo

  A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

  Language:Python11.4k2.4k

• mlc-ai/mlc-en

  Language:Python37537

• mlc-ai/mlc-zh

  Language:Python58363

• microsoft/vcpkg

  C++ Library Manager for Windows, Linux, and MacOS

  Language:CMake22.7k6.3k

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python131k26.1k

• ROCm/rocSPARSE

  Next generation SPARSE implementation for ROCm platform

  Language:C++11553

• pyecharts/pyecharts

  🎨 Python Echarts Plotting Library

  Language:Python14.7k2.8k

• it-ebooks-0/zhihu-ai-qa

  2

• cloudcores/CuAssembler

  An unofficial cuda assembler, for all generations of SASS, hopefully ：）

  Language:Python38469

• NVIDIA/Fuser

  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

  Language:C++24547