soryxie

soryxie's Stars

• opencv/opencv

  Open Source Computer Vision Library

  Language:C++80k2.7k10.9k55.9k

• pyecharts/pyecharts

  🎨 Python Echarts Plotting Library

  Language:Python15k3801.9k2.9k

• continue-revolution/sd-webui-segment-anything

  Segment Anything for Stable Diffusion WebUI

  Language:Python3.4k33165208

• desireevl/awesome-quantum-computing

  A curated list of awesome quantum computing learning and developing resources.

  2.6k1374409

• nkaz001/hftbacktest

  A high-frequency trading and market-making backtesting and trading bot in Python and Rust, which accounts for limit orders, queue positions, and latencies, utilizing full tick data for trades and order books, with real-world crypto market-making examples for Binance Futures

  Language:Rust2.1k60101421

• pytorch/ao

  PyTorch native quantization and sparsity for training and inference

  Language:Python1.7k42350197

• sustcsonglin/flash-linear-attention

  Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

  Language:Python1.5k286771

• ray-project/kuberay

  A toolkit to run Ray applications on Kubernetes

  Language:Go1.4k241.1k432

• AIoT-MLSys-Lab/Efficient-LLMs-Survey

  [TMLR 2024] Efficient Large Language Models: A Survey

  1.1k271188

• NousResearch/DisTrO

  Distributed Training Over-The-Internet

  84688231

• kvcache-ai/ktransformers

  A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

  Language:Python828176746

• efeslab/Nanoflow

  A throughput-oriented high-performance serving framework for LLMs

  Language:Cuda69182629

• FloridSleeves/LLMDebugger

  LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step

  Language:Python47261546

• antgroup/glake

  GLake: optimizing GPU memory management and IO transmission.

  Language:Python40872235

• microsoft/sarathi-serve

  A low-latency & high-throughput serving engine for LLMs

  Language:Python29271935

• microsoft/vattention

  Dynamic Memory Management for Serving LLMs without PagedAttention

  Language:C26851120

• AlibabaPAI/llumnix

  Efficient and easy multi-instance LLM serving

  Language:Python267101017

• Hobr/transition-ticket

  Transition Ticket

  Language:Python21641038

• kiri-art/docker-diffusers-api

  Diffusers / Stable Diffusion in docker with a REST API, supporting various models, pipelines & schedulers.

  Language:Python20373094

• Just-Prog/Bilibili_show_ticket_auto_order

  Language:Python19933538

• gpu-mode/triton-index

  Cataloging released Triton kernels.

  147707

• microsoft/ParrotServe

  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable

  Language:Python130549

• thu-nics/DiTFastAttn

  Language:Jupyter Notebook1173108

• AlibabaPAI/FLASHNN

  Language:Python791028

• fanlai0990/CS598

  Systems for GenAI

  77215

• cchan/tccl

  extensible collectives library in triton

  Language:Python76204

• Gumpest/SparseVLMs

  Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference" proposed by Peking University and UC Berkeley.

  Language:Python662153

• siyan-zhao/prepacking

  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"

  Language:Jupyter Notebook57212

• prathebaselva/FORA

  FORA introduces simple yet effective caching mechanism in Diffusion Transformer Architecture for faster inference sampling.

  Language:Python32132

• mlsys-io/kv.run

  A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.

  Language:C++21202