ColdPorridge

ColdPorridge's Stars

• pytorch/pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python85.6k1.8k47.9k23k

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda24.9k2521412.8k

• ggerganov/ggml

  Tensor library for machine learning

  Language:C++11.5k1344311.1k

• WooooDyy/LLM-Agent-Paper-List

  The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

  7k13814418

• Oneflow-Inc/oneflow

  OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

  Language:C++6.5k1541k728

• open-compass/opencompass

  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

  Language:Python4.4k26581468

• TheNetAdmin/zjuthesis

  Zhejiang University Graduation Thesis LaTeX Template

  Language:TeX2.8k15322641

• predibase/lorax

  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  Language:Python2.3k33254149

• DefTruth/CUDA-Learn-Notes

  📚150+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).

  Language:Cuda1.9k149195

• flexflow/FlexFlow

  FlexFlow Serve: Low-Latency, High-Performance LLM Serving

  Language:C++1.7k30664234

• NUS-HPC-AI-Lab/OpenDiT

  OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

  Language:Python1.4k236093

• HuangOwen/Awesome-LLM-Compression

  Awesome LLM compression research papers and tools.

  1.3k42686

• mini-sora/minisora

  MiniSora: A community aims to explore the implementation path and future development direction of Sora.

  Language:Python1.2k1965151

• emmericp/ixy

  A simple yet fast user space network driver for Intel 10 Gbit/s NICs written from scratch

  Language:C1.2k4515126

• kakaobrain/torchgpipe

  A GPipe implementation in PyTorch

  Language:Python8193333100

• AmberLJC/LLMSys-PaperList

  Large Language Model (LLM) Systems Paper List

  71729126

• volcengine/veScale

  A PyTorch Native LLM Training Framework

  Language:Python688331836

• BobMcDear/attorch

  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

  Language:Python50211826

• Eddie-Wang1120/HPC-Learning-Notes

  高性能计算相关知识学习笔记，包含学习笔记和相关知识的代码demo，在持续完善中。 如果有帮助的话请Star一下，对作者帮助很大，谢谢！

  Language:Jupyter Notebook3926135

• intelligent-machine-learning/glake

  GLake: optimizing GPU memory management and IO transmission.

  Language:Python38172233

• hahnyuan/LLM-Viewer

  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

  Language:Python35921444

• facebookresearch/HolisticTraceAnalysis

  A library to analyze PyTorch traces.

  Language:Python317185845

• alibaba-edu/High-Precision-Congestion-Control

  Language:Python3031051156

• sail-sg/zero-bubble-pipeline-parallelism

  Zero Bubble Pipeline Parallelism

  Language:Python30372916

• ljgibbslf/Chinese-Translation-of-PCI-Express-Technology-

  Chinese Translation on <PCI Express Technology Comprehensive Guide to Generations 1.x, 2.x and 3.0> by Mindshare Mindshare

  2778494

• S-Lab-System-Group/Awesome-DL-Scheduling-Papers

  26712833

• eniac/paella

  Paella: Low-latency Model Serving with Virtualized GPU Scheduling

  Language:C++58416

• lastweek/lastweek.github.io

  Yizhou' Homepage

  Language:HTML46305

• firechecking/CleanParallel

  an implementation of parallel skills like amp, ddp, pp, tp for learning purposes

  Language:Python12100

• microsoft/inspector-topo

  An interconnect topology detection tool for Azure VMs

  Language:C++8511