LLM-Powered-RAG-System

Frameworks

  • langchain - ⚡ Building applications with LLMs through composability ⚡ GitHub Repo stars
  • llama_index - LlamaIndex (formerly GPT Index) is a data framework for your LLM applications GitHub Repo stars
  • graphrag - A modular graph-based Retrieval-Augmented Generation (RAG) system GitHub Repo stars
  • embedchain - Embedchain is an Open Source RAG Framework that makes it easy to create and deploy AI apps. - GitHub Repo stars
  • FlagEmbedding - Dense Retrieval and Retrieval-augmented LLMs - GitHub Repo stars
  • fastRAG - Efficient Retrieval Augmentation and Generation Framework - GitHub Repo stars
  • llmware - Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models. - GitHub Repo stars
  • llm-applications - A comprehensive guide to building RAG-based LLM applications for production. - GitHub Repo stars
  • DB-GPT - Revolutionizing Database Interactions with Private LLM Technology - GitHub Repo stars
  • pandas-ai - Chat with your data (SQL, CSV, pandas, polars, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
  • canopy - Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone - GitHub Repo stars
  • autollm - Ship RAG based LLM web apps in seconds. - GitHub Repo stars

Projects

  • quivr - Your GenAI Second Brain 🧠 A personal productivity assistant (RAG) ⚡️🤖 Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, that you can share with users ! - Ship RAG based LLM web apps in seconds. - GitHub Repo stars
  • fastGPT - FastGPT is a knowledge-based platform built on the LLM, offers out-of-the-box data processing and model invocation capabilities, allows for workflow orchestration through Flow visualization! - GitHub Repo stars
  • Langchain-Chatchat - Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 - GitHub Repo stars
  • LangChain-ChatGLM-Webui - 基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答 - GitHub Repo stars
  • anything-llm - Open-source multi-user ChatGPT for all LLMs, embedders, and vector databases. Unlimited documents, messages, and users in one privacy-focused app. - GitHub Repo stars
  • QAnything - Question and Answer based on Anything.
  • danswer - Ask Questions in natural language and get Answers backed by private sources. Connects to tools like Slack, GitHub, Confluence, etc. - GitHub Repo stars
  • rags - Build ChatGPT over your data, all with natural language - GitHub Repo stars
  • khoj - A copilot to search and chat (using RAG) with your knowledge base (pdf, markdown, org). Use powerful, online (e.g gpt4) or private, offline (e.g mistral) LLMs. - GitHub Repo stars
  • Verba - Retrieval Augmented Generation (RAG) chatbot powered by Weaviate - GitHub Repo stars
  • llm-app - LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources. - GitHub Repo stars
  • casibase - ⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️ - GitHub Repo stars
  • trt-llm-rag-windows - A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM - GitHub Repo stars
  • GPT-RAG - GPT-RAG core is a Retrieval-Augmented Generation pattern running in Azure, using Azure Cognitive Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. - GitHub Repo stars
  • rag-demystified - An LLM-powered advanced RAG pipeline built from scratch - GitHub Repo stars

Components

Chat with Documents

  • privateGPT - Interact with your documents using the power of GPT, 100% privately, no data leaks
  • localGPT - Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
  • ChatFiles - Document Chatbot
  • pdfGPT - PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
  • chatd - Chat with your documents using local AI - GitHub Repo stars
  • IncarnaMind - Connect and chat with your multiple documents (pdf and txt) through GPT 3.5, GPT-4 Turbo, Claude and Local Open-Source LLMs
  • ArXivChatGuru - Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache. - GitHub Repo stars

Database

  • vanna - 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄. - GitHub Repo stars
  • txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows - GitHub Repo stars
  • infinity - The AI-native database built for LLM applications, providing incredibly fast vector and full-text search - GitHub Repo stars
  • postgresml - The GPU-powered AI application database. - GitHub Repo stars
  • lancedb - Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Optimize Method

  • sparrow - Data extraction with ML and LLM - GitHub Repo stars
  • fastembed - Fast, Accurate, Lightweight Python library to make State of the Art Embedding - GitHub Repo stars
  • self-rag - SELF-RAG: Learning to Retrieve, Generate and Critique through Self-reflection - GitHub Repo stars
  • instructor - Your Gateway to Structured Outputs with OpenAI
  • swirl-search - Swirl is open source software that simultaneously searches multiple content sources and returns AI ranked results. - GitHub Repo stars
  • kernel-memory - Index and query any data using LLM and natural language, tracking sources and showing citations. - GitHub Repo stars

Others

  • chatgpt-retrieval-plugin - The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
  • RAGxplorer - Open-source tool to visualise your RAG 🔮 - GitHub Repo stars

Papers

  • Awesome-LLM-RAG - This repo aims to record advanced papers of Retrieval Agumented Generation (RAG) in LLMs.

Blog

Other Resources