iteratorlee

iteratorlee's Stars

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++68.3k5484.1k9.8k

• binary-husky/gpt_academic

  为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

  Language:Python65.9k2781.6k8.1k

• XingangPan/DragGAN

  Official Code for DragGAN (SIGGRAPH 2023)

  Language:Python35.7k9941893.5k

• typst/typst

  A new markup-based typesetting system that is powerful and easy to learn.

  Language:Rust35.4k962.7k942

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python30.8k2495.3k4.7k

• waydabber/BetterDisplay

  Unlock your displays on your Mac! Flexible HiDPI scaling, XDR/HDR extra brightness, virtual screens, DDC control, extra dimming, PIP/streaming, EDID override and lots more!

  20.7k692.2k359

• Hannibal046/Awesome-LLM

  Awesome-LLM: a curated list of Large Language Model

  19k378271.6k

• LazyVim/LazyVim

  Neovim config for the lazy

  Language:Lua17.6k621.3k1.2k

• Caldis/Mos

  一个用于在 macOS 上平滑你的鼠标滚动效果或单独设置滚动方向的小工具, 让你的滚轮爽如触控板 | A lightweight tool used to smooth scrolling and set scroll direction independently for your mouse on macOS

  Language:Swift14.8k98590520

• stas00/ml-engineering

  Machine Learning Engineering Open Book

  Language:Python11.8k11730715

• OptimalScale/LMFlow

  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

  Language:Python8.3k71413827

• mit-han-lab/streaming-llm

  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

  Language:Python6.7k6583367

• MLNLP-World/Paper-Writing-Tips

  MLNLP社区用来帮助大家避免论文投稿小错误的整理仓库。 Paper Writing Tips

  3.6k445470

• alpa-projects/alpa

  Training and serving large-scale neural networks with auto parallelization.

  Language:Python3.1k44297357

• FasterDecoding/Medusa

  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

  Language:Jupyter Notebook2.3k3191162

• tensorchord/envd

  🏕️ Reproducible development environment

  Language:Go2k22529160

• laekov/fastmoe

  A fast MoE impl for PyTorch

  Language:Python1.6k13121189

• XueFuzhao/OpenMoE

  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

  Language:Python1.4k14871

• horseee/Awesome-Efficient-LLM

  A curated list for Efficient Large Language Models

  Language:Python1.3k42391

• punica-ai/punica

  Serving multiple LoRA finetuned LLM as one

  Language:Python989123946

• XueFuzhao/awesome-mixture-of-experts

  A collection of AWESOME things about mixture-of-experts

  97426274

• hpcaitech/EnergonAI

  Large-scale model inference.

  Language:Python630235090

• epfml/landmark-attention

  Landmark Attention: Random-Access Infinite Context Length for Transformers

  Language:Python416401536

• FMInference/H2O

  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

  Language:Python39553843

• FMInference/DejaVu

  Language:Python28963536

• symisc/tiny-dream

  Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation

  Language:C25416713

• FlagOpen/FlagAttention

  A collection of memory efficient attention operators implemented in the Triton language.

  Language:Python2197315

• alpa-projects/mms

  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)

  Language:Python7961012

• UofT-EcoSystem/hotline

  Language:Python31632

• pingzhili/light-fairseq

  Conversions of Fairseq models in HuggingFace-style

  Language:Python4100