zeutrap's Stars
run-llama/llama_index
LlamaIndex is a data framework for your LLM applications
slidevjs/slidev
Presentation Slides for Developers
rasbt/LLMs-from-scratch
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
dapr/dapr
Dapr is a portable, event-driven, runtime for building distributed applications across cloud and edge.
microsoft/JARVIS
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
jina-ai/jina
☁️ Build multimodal AI applications with cloud-native stack
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
stas00/ml-engineering
Machine Learning Engineering Open Book
chenzomi12/AISystem
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
FMInference/FlexGen
Running large language models on a single GPU for throughput-oriented scenarios.
huggingface/text-generation-inference
Large Language Model Text Generation Inference
justinamiller/SoftwareArchitect
Path to a Software Architect
modelscope/modelscope
ModelScope: bring the notion of Model-as-a-Service to life.
Azure-Samples/azure-search-openai-demo
A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
NVIDIA/FasterTransformer
Transformer related optimization, including BERT, GPT
xinliangnote/go-gin-api
基于 Gin 进行模块化设计的 API 框架，封装了常用功能，使用简单，致力于进行快速的业务研发。比如，支持 cors 跨域、jwt 签名验证、zap 日志收集、panic 异常捕获、trace 链路追踪、prometheus 监控指标、swagger 文档生成、viper 配置文件解析、gorm 数据库组件、gormgen 代码生成工具、graphql 查询语言、errno 统一定义错误码、gRPC 的使用、cron 定时任务 等等。
hibayesian/awesome-automl-papers
A curated list of automated machine learning papers, articles, tutorials, slides and projects
microsoft/LMOps
General technology for enabling AI capabilities w/ LLMs and MLLMs
alpa-projects/alpa
Training and serving large-scale neural networks with auto parallelization.
HuaizhengZhang/AI-System-School
🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
DefTruth/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
traefik/mesh
Traefik Mesh - Simpler Service Mesh
alibaba/EasyCV
An all-in-one toolkit for computer vision
alibaba/EasyRec
A framework for large scale recommendation algorithms.
huggingface/nanotron
Minimalistic large language model 3D-parallelism training
explosion/spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
AIoT-MLSys-Lab/Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
hpcaitech/EnergonAI
Large-scale model inference.
AlibabaPAI/llumnix
Efficient and easy multi-instance LLM serving