fantasy520

fantasy520's Stars

• microsoft/DiskANN

  Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search

  Language:C++1.1k210

• snu-comparch/InfiniGen

  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)

  Language:Python389

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  2.4k159

• mlabonne/llm-course

  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  Language:Jupyter Notebook36.9k3.9k

• Hannibal046/Awesome-LLM

  Awesome-LLM: a curated list of Large Language Model

  17.2k1.4k

• chatchat-space/Langchain-Chatchat

  Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

  Language:TypeScript31.1k5.4k

• tshu-w/DBCopilot

  Code and data for the paper "DBCᴏᴘɪʟᴏᴛ: Scaling Natural Language Querying to Massive Databases"

  Language:Python476

• lancedb/vectordb-recipes

  High quality resources & applications for LLMs, multi-modal models and VectorDBs

  Language:Jupyter Notebook56696

• weaviate/weaviate

  Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

  Language:Go10.7k735

• AkiRusProd/llm-agent

  LLM using long-term memory through vector database

  Language:Python416

• Yu-Fangxu/COLD-Attack

  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability

  Language:Python8115

• datawhalechina/self-llm

  《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合**宝宝的部署教程

  Language:Jupyter Notebook7.7k933

• liguodongiot/llm-action

  本项目旨在分享大模型相关技术原理以及实战经验。

  Language:HTML9k879

• SymbioticLab/Leap

  Prefetching and efficient data path for memory disaggregation

  Language:C6121

• newlxj/Crawling_VectorDB_LLM

  从零开始搭建爬虫+向量数据库+LLM大模型构建企业私有化知识库

  Language:Python244

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python26.1k3.8k

• mlcommons/storage

  MLPerf™ Storage Benchmark Suite

  Language:Shell7426

• cloudarxiv/emucxl

  Language:C82

• microsoft/ML-For-Beginners

  12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all

  Language:HTML69k14.2k

• google-research/bert

  TensorFlow code and pre-trained models for BERT

  Language:Python37.8k9.6k

• mlcommons/inference

  Reference implementations of MLPerf™ inference benchmarks

  Language:Python1.2k518

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python10k784

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python132k26.2k

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python6k1k

• FMInference/FlexiGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  Language:Python9.1k540

• juncongmoo/pyllama

  LLaMA: Open and Efficient Foundation Language Models

  Language:Python2.8k312

• hazelcast/hazelcast

  Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

  Language:Java6.1k1.8k

• apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing

  Language:Scala39.3k28.2k

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python34.6k4k

• andikleen/pmu-tools

  Intel PMU profiling tools

  Language:Python2k331