fantasy520's Stars
microsoft/DiskANN
Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search
snu-comparch/InfiniGen
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
DefTruth/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
mlabonne/llm-course
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Hannibal046/Awesome-LLM
Awesome-LLM: a curated list of Large Language Model
chatchat-space/Langchain-Chatchat
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
tshu-w/DBCopilot
Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Scaling Natural Language Querying to Massive Databases"
lancedb/vectordb-recipes
High quality resources & applications for LLMs, multi-modal models and VectorDBs
weaviate/weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
AkiRusProd/llm-agent
LLM using long-term memory through vector database
Yu-Fangxu/COLD-Attack
[ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
datawhalechina/self-llm
《开源大模型食用指南》基于Linux环境快速部署开源大模型,更适合**宝宝的部署教程
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
SymbioticLab/Leap
Prefetching and efficient data path for memory disaggregation
newlxj/Crawling_VectorDB_LLM
从零开始搭建爬虫+向量数据库+LLM大模型构建企业私有化知识库
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
mlcommons/storage
MLPerf™ Storage Benchmark Suite
cloudarxiv/emucxl
microsoft/ML-For-Beginners
12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all
google-research/bert
TensorFlow code and pre-trained models for BERT
mlcommons/inference
Reference implementations of MLPerf™ inference benchmarks
RUCAIBox/LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
microsoft/DeepSpeedExamples
Example models using DeepSpeed
FMInference/FlexiGen
Running large language models on a single GPU for throughput-oriented scenarios.
juncongmoo/pyllama
LLaMA: Open and Efficient Foundation Language Models
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
andikleen/pmu-tools
Intel PMU profiling tools