iteratorlee

iteratorlee's Stars

• public-apis/public-apis

  A collective list of free APIs

  Language:Python318k4.2k63833.9k

• Genymobile/scrcpy

  Display and control your Android device

  Language:C113k1.3k4.9k10.8k

• xai-org/grok-1

  Grok open release

  Language:Python49.6k5752108.3k

• mlabonne/llm-course

  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  Language:Jupyter Notebook39.4k409684.2k

• lizongying/my-tv

  我的电视 电视直播软件，安装即可使用

  Language:C30.2k2129003.4k

• cumulo-autumn/StreamDiffusion

  StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation

  Language:Python9.8k79119697

• Mooler0410/LLMsPracticalGuide

  A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

  9.5k18817728

• mistralai/mistral-src

  Reference implementation of Mistral AI 7B v0.1 model.

  Language:Jupyter Notebook8.8k116115761

• SJTU-IPADS/PowerInfer

  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  Language:C++8k77168415

• WooooDyy/LLM-Agent-Paper-List

  The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

  6.9k13814408

• microsoft/LLMLingua

  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  Language:Python4.7k33131261

• Alpha-VLLM/LLaMA2-Accessory

  An Open-source Toolkit for LLM Development

  Language:Python2.7k37137176

• Paitesanshi/LLM-Agent-Survey

  2.6k7321152

• stanford-crfm/helm

  Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).

  Language:Python2k361.1k253

• Eanya-Tonic/CCTV_Viewer

  电视浏览器，一款简易电视视频收看软件，用于方便的在机顶盒上收看网页视频

  Language:Java1.8k1296180

• Toyhom/Chinese-medical-dialogue-data

  Chinese medical dialogue data 中文医疗对话数据集

  Language:Python1.2k209248

• deepseek-ai/DeepSeek-MoE

  DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

  Language:Python1k163851

• pjlab-sys4nlp/llama-moe

  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

  Language:Python88582246

• AmberLJC/LLMSys-PaperList

  Large Language Model (LLM) Systems Paper List

  65228024

• ray-project/llmperf-leaderboard

  431141113

• pratyushasharma/laser

  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

  Language:Python371222228

• cli99/llm-analysis

  Latency and Memory Analysis of Transformer Models for Training and Inference

  Language:Python35681042

• llm-random/llm-random

  Language:Python17691514

• efeslab/fiddler

  Fast Inference of MoE Models with CPU-GPU Orchestration

  Language:Python1737216

• MARD1NO/CUDA-PPT

  792012

• UNITES-Lab/MC-SMoE

  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"

  Language:Python64429

• hahnyuan/ASVD4LLM

  Activation-aware Singular Value Decomposition for Compressing Large Language Models

  Language:Python49436

• yxli2123/LoSparse

  Language:Python47145

• Raphael-Hao/brainstorm

  Compiler for Dynamic Neural Networks

  Language:Python43672

• YJHMITWEB/ExFlow

  Explore Inter-layer Expert Affinity in MoE Model Inference

  Language:Python5100