hanbingmew

hanbingmew's Stars

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5.1k356

• deepseek-ai/DeepSeek-Coder

  DeepSeek Coder: Let the Code Write Itself

  Language:Python6.5k460

• LLMServe/DistServe

  Disaggregated serving system for Large Language Models (LLMs).

  Language:Jupyter Notebook27726

• microsoft/DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python1.8k173

• BradyFU/Awesome-Multimodal-Large-Language-Models

  :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  11.7k758

• OpenBMB/MiniCPM-V

  MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

  Language:Python11.8k834

• haotian-liu/LLaVA

  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

  Language:Python19.3k2.1k

• itrewub/jh-notes

  1.1k323

• hiyouga/LLaMA-Factory

  Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

  Language:Python30.8k3.8k

• tensorchord/inference-benchmark

  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)

  Language:Python273

• ray-project/llmperf

  LLMPerf is a library for validating and benchmarking LLMs

  Language:Python57392

• CoLearn-Dev/fleece-benchmark

  A benchmark framework for LLM serving performance, based on API call

  Language:Python123

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda23.3k2.6k

• federico-busato/Modern-CPP-Programming

  Modern C++ Programming Course (C++03/11/14/17/20/23/26)

  Language:HTML11.8k785

• Unstructured-IO/unstructured

  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

  Language:HTML8.4k692

• parallel101/course

  高性能并行编程与优化 - 课件

  Language:C++3.6k535

• FasterDecoding/Medusa

  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

  Language:Jupyter Notebook2.2k150

• fffaraz/awesome-cpp

  A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.

  58.7k7.8k

• SJTU-IPADS/PowerInfer

  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  Language:C++7.9k403

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python8.8k1k

• TsinghuaC3I/SoRA

  The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.

  Language:Python618

• mit-han-lab/llm-awq

  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

  Language:Python2.3k177

• liguodongiot/llm-action

  本项目旨在分享大模型相关技术原理以及实战经验。

  Language:HTML9.1k889

• chenzomi12/AISystem

  AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

  Language:Jupyter Notebook10.4k1.5k

• ModelTC/lightllm

  LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

  Language:Python2.3k190

• S-LoRA/S-LoRA

  S-LoRA: Serving Thousands of Concurrent LoRA Adapters

  Language:Python1.7k87

• cpacker/MemGPT

  Create LLM agents with long-term memory and custom tools 📚🦙

  Language:Python11.4k1.2k

• THUDM/ChatGLM3

  ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

  Language:Python13.3k1.5k

• The-Run-Philosophy-Organization/run

  润学全球官方指定GITHUB，整理润学宗旨、纲领、理论和各类润之实例；解决为什么润，润去哪里，怎么润三大问题； 并成为新**人的核心宗教，核心信念。

  31.5k2.6k

• thismlguy/analytics_vidhya

  Codes related to activities on AV including articles, hackathons and discussions.

  Language:Jupyter Notebook1.2k1.7k