inkinworld

inkinworld's Stars

• All-Hands-AI/OpenHands

  🙌 OpenHands: Code Less, Make More

  Language:Python31.3k2851.3k3.6k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python26.8k2234.4k3.9k

• iovisor/bcc

  BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

  Language:C20.3k5571.9k3.8k

• samber/lo

  💥 A Lodash-style Go library based on Go 1.18+ Generics (map, filter, contains, find...)

  Language:Go17.4k77208799

• karpathy/minbpe

  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

  Language:Python9k8336830

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python8.8k991.3k1k

• THUDM/CodeGeeX2

  CodeGeeX2: A More Powerful Multilingual Code Generation Model

  Language:Python7.6k65248532

• harvardnlp/annotated-transformer

  An annotated implementation of the Transformer paper.

  Language:Jupyter Notebook5.6k65881.2k

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5.1k52511359

• kf-liu/The-Art-of-Linear-Algebra-zh-CN

  Graphic notes on Gilbert Strang's "Linear Algebra for Everyone", 线性代数的艺术中文版, 欢迎PR.

  Language:PostScript4.4k400445

• InternLM/lmdeploy

  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

  Language:Python4.2k351.3k376

• bbycroft/llm-viz

  3D Visualization of an GPT-style LLM

  Language:TypeScript3.8k3214419

• Tencent/cherry-markdown

  ✨ A Markdown Editor

  Language:JavaScript3.5k46495412

• huggingface/text-embeddings-inference

  A blazing fast inference solution for text embeddings models

  Language:Rust2.6k33240161

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  2.5k816162

• mengjian-github/copilot-analysis

  Language:JavaScript2k217239

• ZiyaoGeng/RecLearn

  Recommender Learning with Tensorflow2.x

  Language:Python1.8k3582492

• BBuf/how-to-optim-algorithm-in-cuda

  how to optimize some algorithm in cuda.

  Language:Cuda1.4k219118

• HeKun-NVIDIA/CUDA-Programming-Guide-in-Chinese

  This is a Chinese translation of the CUDA programming guide

  1.2k371185

• mingrammer/flog

  :tophat: A fake log generator for common log formats

  Language:Go1.1k843133

• triton-inference-server/pytriton

  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.

  Language:Python715187348

• IST-DASLab/marlin

  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

  Language:Python560152745

• zhaozhiyong19890102/Recommender-System

  推荐系统综述

  43714059

• zc911/MatrixSlow

  A simple deep learning framework in pure python for purpose of learning in DL

  Language:TypeScript42111786

• hellotransformers/Natural_Language_Processing_with_Transformers

  Natural Language Processing with Transformers 中译本，最权威Transformers教程

  3634289

• charlotteLive/pybind11-Chinese-docs

  pybind11中文文档（个人翻译）

  2462258

• jy-yuan/KIVI

  KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

  Language:Python21352419

• Nanbeige/Nanbeige

  Language:Python84239

• KyleBing/map

  路书，路线规划，高德地图 api 示例，地图信息 vue3 ts vite

  Language:Vue813718

• run-ai/llmperf

  Language:C++42318