Dinghow

Dinghow's Stars

• meta-llama/llama3

  The official Meta Llama 3 GitHub site

  Language:Python27.6k2302733.2k

• mozilla/sccache

  Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.

  Language:Rust5.9k56876552

• XuehaiPan/nvitop

  An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

  Language:Python4.9k2590157

• deepseek-ai/DeepSeek-V2

  DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

  3.8k3291173

• Tencent/HunyuanDiT

  Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

  Language:Jupyter Notebook3.7k42182319

• mit-han-lab/llm-awq

  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

  Language:Python2.6k25189215

• xusenlinzy/api-for-open-llm

  Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

  Language:Python2.4k24287273

• kvcache-ai/Mooncake

  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

  Language:C++2.3k2728128

• casper-hansen/AutoAWQ

  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

  Language:Python1.8k15423222

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.8k303182

• Xmader/aria-ng-gui

  一个 Aria2 图形界面客户端 | An Aria2 GUI for Windows & Linux & MacOS

  Language:JavaScript1.8k3559157

• Thinklab-SJTU/Bench2Drive

  [NeurIPS 2024 Datasets and Benchmarks Track] Closed-Loop E2E-AD Benchmark Enhanced by World Model RL Expert

  Language:Python1.3k1812685

• szymanowiczs/splatter-image

  Official implementation of `Splatter Image: Ultra-Fast Single-View 3D Reconstruction' CVPR 2024

  Language:Python892256069

• microsoft/MInference

  [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

  Language:Python85067039

• hemingkx/SpeculativeDecodingPapers

  📰 Must-read papers and blogs on Speculative Decoding ⚡️

  52922426

• xingyaoww/code-act

  Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

  Language:Python52261040

• mit-han-lab/qserve

  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

  Language:Python46783628

• FloridSleeves/LLMDebugger

  LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step

  Language:Python45661445

• LLMServe/DistServe

  Disaggregated serving system for Large Language Models (LLMs).

  Language:Jupyter Notebook39754550

• HKUNLP/ChunkLlama

  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"

  Language:Python37172119

• OpenDriveLab/ELM

  [ECCV 2024] Embodied Understanding of Driving Scenarios

  Language:Python161121913

• zyc00/Point-SAM

  Point-SAM: This is the official repository of "Point-SAM: Promptable 3D Segmentation Model for Point Clouds". We provide codes for running our demo and links to download checkpoints.

  Language:Python1506129

• Glaciohound/LM-Infinite

  Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"

  Language:Python13241313

• zhihao-lin/3dgcn

  Convolution in the Cloud: Learning Deformable Kernels in 3D Graph Convolution Networks for Point Cloud Analysis

  Language:Python12341116

• OpenRobotLab/Grounded_3D-LLM

  Code&Data for Grounded 3D-LLM with Referent Tokens

  Language:Python94692

• linhaojia13/PointMetaBase

  This is a PyTorch implementation of PointMetaBase proposed by our paper "Meta Architecure for Point Cloud Analysis"

  Language:Python894209

• AlibabaPAI/FLASHNN

  Language:Python791028

• alibaba/llm-scheduling-artifact

  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“

  Language:Python57422

• xmed-lab/DIF-Gaussian

  MICCAI 2024: Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction

  Language:Python44133

• PanZaifeng/RecFlex

  A recommendation model kernel optimizing system

  Language:Python80