llx-08's Stars
google/googletest
GoogleTest - Google Testing and Mocking Framework
Tencent/ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
aio-libs/aiohttp
Asynchronous HTTP client/server framework for asyncio and Python
ShiArthur03/ShiArthur03
kska32/ebooks
收藏的一些经典的历史、政治、心理、哲学、数学、计算机方面电子书(约10万本)
microsoft/AI-System
System for AI Education Resource.
cuda-mode/lectures
Material for cuda-mode lectures
BBuf/how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
udacity/cs344
Introduction to Parallel Programming class code
DefTruth/CUDA-Learn-Notes
🎉CUDA/C++ 笔记 / 大模型手撕CUDA / 技术博客,更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
srush/Triton-Puzzles
Puzzles for learning Triton
microsoft/MInference
To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
deezertidal/freevpn
免费公益机场节点分享
zhuzilin/ring-flash-attention
Ring attention implementation with flash attention
WarrenWen666/AI-Software-Startups
A Survey of AI startups
intel/xFasterTransformer
Cjkkkk/CUDA_gemm
A simple high performance CUDA GEMM implementation.
microsoft/vidur
A large-scale simulation framework for LLM inference
microsoft/vattention
Dynamic Memory Management for Serving LLMs without PagedAttention
ServerlessLLM/ServerlessLLM
Cost-efficient and fast multi-LLM serving.
zjhellofss/KuiperLLama
校招、秋招、春招、实习好项目,带你从零动手实现支持LLama的大模型推理框架。
wx-chevalier/Awesome-RoadMaps-and-Interviews
Awesome Interviews for Coder, Programming Language, Software Engineering, Web, Backend, Distributed Infrastructure, DataScience & AI | 面试必备
AlibabaPAI/llumnix
Efficient and easy multi-instance LLM serving
shreyansh26/FlashAttention-PyTorch
Implementation of FlashAttention in PyTorch
microsoft/ParrotServe
[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
AlibabaPAI/FLASHNN
Mutinifni/splitwise-sim
LLM serving cluster simulator
snu-comparch/InfiniGen
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
leimao/Nsight-Compute-Docker-Image
Nsight Compute in Docker