lokinko's Stars
ggerganov/llama.cpp
LLM inference in C/C++
weishengying/tiny-flash-attention
使用 cutlass 实现 flash-attention 精简版,具有教学意义
LLMServe/DistServe
Disaggregated serving system for Large Language Models (LLMs).
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
NVlabs/DoRA
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
microsoft/ToRA
ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].
OpenBMB/MiniCPM-V
MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone
BBuf/how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
FasterDecoding/Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
openai/CLIP
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
facebookresearch/DiT
Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"
NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
hyp1231/awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
galeselee/Awesome_LLM_System-PaperList
Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on accelerating LLMs, currently focusing mainly on inference acceleration, and related works will be gradually added in the future. Welcome contributions!
datawhalechina/tiny-universe
《大模型白盒子构建指南》:一个全手搓的Tiny-Universe
HqWu-HITCS/Awesome-Chinese-LLM
整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
TemporaryLoRA/Temp-LoRA
deepseek-ai/DeepSeek-V2
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
ModelTC/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
liguodongiot/llm-resource
LLM全栈优质资源汇总
DefTruth/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
wuhobin/blog-home
一个干净简洁的个人作品集合主页
systemdesign42/system-design
A resource to help you pass system design interview and become good at work 👇
rasbt/LLMs-from-scratch
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
aishwaryanr/awesome-generative-ai-guide
A one stop repository for generative AI research updates, interview resources, notebooks and much more!
apple/pfl-research
Simulation framework for accelerating research in Private Federated Learning
comfyanonymous/ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
Eladlev/AutoPrompt
A framework for prompt tuning using Intent-based Prompt Calibration
google/gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.