wzhao18

wzhao18's Stars

• SimplifyJobs/New-Grad-Positions

  A collection of full time roles in SWE, Quant, and PM for new grads.

  11.3k1k

• HazyResearch/aisys-building-blocks

  Building blocks for foundation models.

  36513

• CentML/flexible-inference-bench

  A modular, extensible LLM inference benchmarking framework that supports multiple benchmarking frameworks and paradigms.

  Language:Python5

• NVIDIA/TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++8.3k932

• dottxt-ai/outlines

  Structured Text Generation

  Language:Python8.4k426

• NVIDIA/Megatron-LM

  Ongoing research training transformer models at scale

  Language:Python10.2k2.3k

• tensor-compiler/taco

  The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs

  Language:C++1.2k186

• SimplifyJobs/Summer2025-Internships

  Collection of Summer 2025 tech internships!

  34.3k2.7k

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++12.9k1.6k

• nchong/cudahook

  Intercepting CUDA runtime calls with LD_PRELOAD

  Language:C++368

• ampersand-projects/tilt

  Language:C++104

• meta-llama/llama

  Inference code for Llama models

  Language:Python55.8k9.5k

• yalue/cuda_scheduling_examiner_mirror

  A tool for examining GPU scheduling behavior.

  Language:Cuda6718

• UofT-EcoSystem/gpgpu-sim_distribution

  GPGPU-Sim provides a detailed simulation model of a contemporary GPU running CUDA and/or OpenCL workloads and now includes an integrated (and validated) energy model, GPUWattch.

  Language:C++2

• UofT-EcoSystem/GPU-Virtualization-Benchmarks

  Language:HTML41

• S-Lab-System-Group/HeliosData

  Helios Traces from SenseTime

  4811

• CompVis/stable-diffusion

  A latent text-to-image diffusion model

  Language:Jupyter Notebook67.7k10.1k

• apache/tvm

  Open deep learning compiler stack for cpu, gpu and specialized accelerators

  Language:Python11.7k3.5k

• apple/ml-cvnets

  CVNets: A library for training computer vision networks

  Language:Python1.8k227

• hidet-org/hidet

  An open-source efficient deep learning framework/compiler, written in python.

  Language:Python64852

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python133k26.5k

• wangz585/whoami

  1

• facebook/rocksdb

  A library that provides an embeddable, persistent key-value store for fast storage.

  Language:C++28.4k6.3k

• NVIDIA/cuda-samples

  Samples for CUDA Developers which demonstrates features in CUDA Toolkit

  Language:C6.2k1.8k

• NVIDIA/open-gpu-kernel-modules

  NVIDIA Linux open GPU kernel module source

  Language:C15.1k1.3k

• SymbioticLab/Salus

  Fine-grained GPU sharing primitives

  Language:Jupyter Notebook13919

• tensorflow/tensorboard

  TensorFlow's Visualization Toolkit

  Language:TypeScript6.7k1.7k

• ultralytics/yolov5

  YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

  Language:Python50k16.2k

• alibaba/clusterdata

  cluster data collected from production clusters in Alibaba for cluster management research

  Language:Jupyter Notebook1.6k405

• mlcommons/training

  Reference implementations of MLPerf™ training benchmarks

  Language:Python1.6k553