llx-08

llx-08's Stars

• LLMServe/DistServe

  Disaggregated serving system for Large Language Models (LLMs).

  Language:Jupyter Notebook33435

• phidatahq/phidata

  Build AI Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.

  Language:Python14.2k2k

• owenliang/qwen-vllm

  通义千问VLLM推理部署DEMO

  Language:Python43263

• infiniflow/ragflow

  RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

  Language:Python21.2k2.1k

• xdit-project/xDiT

  xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters

  Language:Python63752

• microsoft/mscclpp

  MSCCL++: A GPU-driven communication stack for scalable AI applications

  Language:C++24536

• tyler-griggs/melange-release

  Language:Python364

• Paitesanshi/LLM-Agent-Survey

  2.5k152

• protocolbuffers/protobuf

  Protocol Buffers - Google's data interchange format

  Language:C++65.6k15.5k

• alibaba/llm-scheduling-artifact

  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“

  Language:Python562

• dutsc/speculative-decoding

  Explorations into some recent techniques surrounding speculative decoding

  1

• X-LANCE/SLAM-LLM

  Speech, Language, Audio, Music Processing with Large Language Model

  Language:Python55751

• Azure/AzurePublicDataset

  Microsoft Azure Traces

  Language:Jupyter Notebook796143

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++13.2k1.6k

• dvmazur/mixtral-offloading

  Run Mixtral-8x7B models in Colab or consumer desktops

  Language:Python2.3k226

• InternLM/lmdeploy

  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

  Language:Python4.5k407

• FasterDecoding/REST

  REST: Retrieval-Based Speculative Decoding, NAACL 2024

  Language:C16910

• yuweihao/MambaOut

  MambaOut: Do We Really Need Mamba for Vision?

  Language:Python2k34

• coder/code-server

  VS Code in the browser

  Language:TypeScript68.3k5.6k

• rany2/edge-tts

  Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge or Windows or an API key

  Language:Python6.1k605

• deepseek-ai/DeepSeek-V2

  DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

  3.5k148

• zeroQiaoba/MERTools

  Toolkits for Multimodal Emotion Recognition

  Language:Python15814

• OpenMOSS/AnyGPT

  Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

  Language:Python76861

• wangshusen/RecommenderSystem

  2.4k358

• wangshusen/SearchEngine

  搜索引擎原理

  1.4k119

• KnowingNothing/MatmulTutorial

  A Easy-to-understand TensorOp Matmul Tutorial

  Language:C++28330

• adam-maj/tiny-gpu

  A minimal GPU design in Verilog to learn how GPUs work from the ground up

  Language:SystemVerilog7k530

• NVIDIA/cuda-samples

  Samples for CUDA Developers which demonstrates features in CUDA Toolkit

  Language:C6.3k1.8k

• brucefan1983/CUDA-Programming

  Sample codes for my CUDA programming book

  Language:Cuda1.6k321

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python6.1k1k