Dinghow

Dinghow's Stars

• ollama/ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  Language:Go72.6k4413.1k5.4k

• xai-org/grok-1

  Grok open release

  Language:Python49k5551978.3k

• state-spaces/mamba

  Mamba SSM architecture

  Language:Python10.9k101343875

• PKU-YuanGroup/Open-Sora-Plan

  This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

  Language:Python10.7k160177963

• vosen/ZLUDA

  CUDA on AMD GPUs

  Language:Rust8.1k113147478

• facebookresearch/DiT

  Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

  Language:Python5.4k4673485

• google/gemma_pytorch

  The official PyTorch implementation of Google's Gemma models

  Language:Python5.1k3934481

• QwenLM/Qwen1.5

  Qwen1.5 is the improved version of Qwen, the large language model series developed by Qwen team, Alibaba Cloud.

  Language:Shell3.4k29422193

• project-baize/baize-chatbot

  Let ChatGPT teach your own chatbot in hours with a single GPU!

  Language:Python3.2k5152275

• open-compass/opencompass

  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

  Language:Python3k21373315

• dvmazur/mixtral-offloading

  Run Mixtral-8x7B models in Colab or consumer desktops

  Language:Python2.3k3026223

• QwenLM/Qwen-Agent

  Agent framework and applications built upon Qwen2, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.

  Language:Python2k28175215

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  1.7k644122

• Vchitect/Latte

  Latte: Latent Diffusion Transformer for Video Generation.

  Language:Python1.4k2678144

• databricks/megablocks

  Language:Python1.1k1748153

• NVIDIA/cuda-python

  CUDA Python Low-level Bindings

  Language:Python790305960

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda718136158

• SafeAILab/EAGLE

  [ICML'24] EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

  Language:Python544126952

• mit-han-lab/distrifuser

  [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

  Language:Python45981212

• bytedance/ByteTransformer

  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

  Language:C++430101033

• SkunkworksAI/hydra-moe

  Language:Python404221115

• chujiezheng/chat_templates

  Chat Templates for 🤗 HuggingFace Large Language Models

  Language:Jinja2855727

• InternLM/Agent-FLAN

  [ACL2024 Findings] Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

  2854108

• Q-Future/Q-Bench

  ①[ICLR2024 Spotlight] (GPT-4V/Gemini-Pro/Qwen-VL-Plus+16 OS MLLMs) A benchmark for multi-modality LLMs (MLLMs) on low-level vision and visual quality assessment.

  Language:Jupyter Notebook19611112

• efeslab/Atom

  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

  Language:Cuda195111115

• hemingkx/Spec-Bench

  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)

  Language:Python92168

• thunlp/MoEfication

  Language:Python92878

• stanford-futuredata/stk

  Language:Python693315

• xmed-lab/C2RV-CBCT

  CVPR 2024, "C^2RV: Cross-Regional and Cross-View Learning for Sparse-View CBCT Reconstruction"

  Language:Python15401

• ruyue0001/Backdoor_DPR

  Code for "Backdoor Attacks on Dense Passage Retrievers for Disseminating Misinformation"

  Language:Python4210