GindaChen

GindaChen's Stars

• Stirling-Tools/Stirling-PDF

  #1 Locally hosted web application that allows you to perform various operations on PDF files

  Language:Java47.6k1579953.9k

• astral-sh/uv

  An extremely fast Python package and project manager, written in Rust.

  Language:Rust33.3k714.5k900

• mem0ai/mem0

  The Memory layer for your AI apps

  Language:Python23.5k1306962.2k

• microsoft/graphrag

  A modular graph-based Retrieval-Augmented Generation (RAG) system

  Language:Python20.9k1465652k

• meta-llama/llama-stack

  Composable building blocks to build Llama Apps

  Language:Python5.6k142206750

• pytorch/torchchat

  Run PyTorch LLMs locally on servers, desktop and mobile

  Language:Python3.4k38347226

• lululxvi/deepxde

  A library for scientific machine learning and physics-informed learning

  Language:Python2.8k55791763

• yhzhang0128/egos-2000

  Envision a future where every student can read all the code of a teaching operating system.

  Language:C2.2k3213156

• zou-group/textgrad

  TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

  Language:Python1.9k1983167

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.8k303182

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.6k21148160

• microsoft/MInference

  [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

  Language:Python85067039

• lucidrains/transfusion-pytorch

  Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

  Language:Python831352634

• parrt/tensor-sensor

  The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflow, keras, fastai.

  Language:Jupyter Notebook798122440

• lucidrains/ring-attention-pytorch

  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

  Language:Python484111629

• FloridSleeves/LLMDebugger

  LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step

  Language:Python45461445

• nyu-systems/Grendel-GS

  Ongoing research training gaussian splatting at scale by distributed system

  Language:Python405183322

• spcl/QuaRot

  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.

  Language:Python301115325

• jy-yuan/KIVI

  [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

  Language:Python25552523

• AlibabaPAI/llumnix

  Efficient and easy multi-instance LLM serving

  Language:Python252101014

• Saibo-creator/Awesome-LLM-Constrained-Decoding

  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.

  1145124

• QingruZhang/PASTA

  PASTA: Post-hoc Attention Steering for LLMs

  Language:Python1082108

• snu-comparch/InfiniGen

  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)

  Language:Python903218

• Mutinifni/splitwise-sim

  LLM serving cluster simulator

  Language:Jupyter Notebook86238

• microsoft/llguidance

  Low-level Guidance Parser

  Language:Rust405247

• barabanshek/sabre

  Language:Python16190

• yunjiazhang/ReAcTable

  The code base for paper: "ReAcTable: Enhancing ReAct for Table Question Answering"

  Language:HTML16242

• dpaleka/stealing-part-lm-supplementary

  Some code for "Stealing Part of a Production Language Model"

  Language:Python11122

• TuftsNATLab/PCS

  Language:Python4

• sramshetty/stealing-part-of-an-LM

  An unofficial implementation of "Stealing Part of a Production Language Model"

  Language:Python3101