Muqi1029

Muqi1029's Stars

• donnemartin/system-design-primer

  Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

  Language:Python277k46.4k

• yihedeng9/rlhf-summary-notes

  A brief and partial summary of RLHF algorithms.

  661

• zhaochenyang20/Awesome-ML-SYS-Tutorial

  My learning notes/codes for ML SYS.

  Language:Python1363

• guanyingc/latex_paper_writing_tips

  Tips for Writing a Research Paper using LaTeX

  Language:TeX3.1k372

• OpenRLHF/OpenRLHF

  An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention)

  Language:Python2.7k250

• Zeyi-Lin/HivisionIDPhotos

  ⚡️HivisionIDPhotos: a lightweight and efficient AI ID photos tools. 一个轻量级的AI证件照制作算法。

  Language:Python12.7k1.3k

• genmoai/models

  The best OSS video generation models

  Language:Python2k207

• mlc-ai/mlc-llm

  Universal LLM Deployment Engine with ML Compilation

  Language:Python19.2k1.6k

• HuaizhengZhang/AI-System-School

  🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

  2.7k310

• NVIDIA/NeMo

  A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

  Language:Python12.2k2.5k

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++68.1k9.8k

• hpcaitech/ColossalAI

  Making large AI models cheaper, faster and more accessible

  Language:Python38.8k4.3k

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.5k140

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python6.1k517

• SuperBruceJia/Awesome-LLM-Self-Consistency

  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models

  763

• yaoching0/GaC

  Language:Python538

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python30.5k4.6k

• punica-ai/punica

  Serving multiple LoRA finetuned LLM as one

  Language:Python98546

• hao-ai-lab/Consistency_LLM

  [ICML 2024] CLLMs: Consistency Large Language Models

  Language:Python35318

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python6.1k1k

• microsoft/ParrotServe

  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable

  Language:Python1147

• tatsu-lab/stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  Language:Python29.6k4.1k

• mit-han-lab/llm-awq

  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

  Language:Python2.5k201

• test-time-training/ttt-lm-jax

  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

  Language:Python36629

• DAMO-DI-ML/KDD2023-DCdetector

  Language:Python18521

• 66RING/tiny-flash-attention

  flash attention tutorial written in python, triton, cuda, cutlass

  Language:Cuda20316

• ssbuild/chatglm_finetuning

  chatglm 6b finetuning and alpaca finetuning

  Language:Python1.5k176

• chaoyanghe/Awesome-Federated-Learning

  FedML - The Research and Production Integrated Federated Learning Library: https://fedml.ai

  1.9k333

• colinmarc/hdfs

  A native go client for HDFS

  Language:Go1.4k341

• karpathy/nanoGPT

  The simplest, fastest repository for training/finetuning medium-sized GPTs.

  Language:Python37.4k6k