/ollama_pdf_rag

A demo Jupyter Notebook showcasing a simple local RAG (Retrieval Augmented Generation) pipeline to chat with your PDFs.

Primary LanguageJupyter NotebookMIT LicenseMIT

🤖 Chat with PDF locally using Ollama + LangChain

A powerful local RAG (Retrieval Augmented Generation) application that lets you chat with your PDF documents using Ollama and LangChain. This project includes both a Jupyter notebook for experimentation and a Streamlit web interface for easy interaction.

📺 Video Tutorial

Watch the video

✨ Features

  • 🔒 Fully local processing - no data leaves your machine
  • 📄 PDF processing with intelligent chunking
  • 🧠 Multi-query retrieval for better context understanding
  • 🎯 Advanced RAG implementation using LangChain
  • 🖥️ Clean Streamlit interface
  • 📓 Jupyter notebook for experimentation

🚀 Getting Started

Prerequisites

  1. Install Ollama

    • Visit Ollama's website to download and install
    • Pull required models: 
      ollama pull llama2  # or your preferred model
ollama pull nomic-embed-text

  2. Clone Repository

    git clone https://github.com/tonykipkemboi/ollama_pdf_rag.git
cd ollama_pdf_rag

  3. Set Up Environment

    python -m venv venv
source venv/bin/activate  # On Windows: .\venv\Scripts\activate
pip install -r requirements.txt

🎮 Running the Application

Option 1: Streamlit Interface

streamlit run streamlit_app.py

Then open your browser to http://localhost:8501

Streamlit UI Streamlit interface showing PDF viewer and chat functionality

Option 2: Jupyter Notebook

jupyter notebook

Open updated_rag_notebook.ipynb to experiment with the code

💡 Usage Tips

  1. Upload PDF: Use the file uploader in the Streamlit interface or try the sample PDF
  2. Select Model: Choose from your locally available Ollama models
  3. Ask Questions: Start chatting with your PDF through the chat interface
  4. Adjust Display: Use the zoom slider to adjust PDF visibility
  5. Clean Up: Use the "Delete Collection" button when switching documents

🤝 Contributing

Feel free to:

  • Open issues for bugs or suggestions
  • Submit pull requests
  • Comment on the YouTube video for questions
  • Star the repository if you find it useful!

⚠️ Troubleshooting

  • Ensure Ollama is running in the background
  • Check that required models are downloaded
  • Verify Python environment is activated
  • For Windows users, ensure WSL2 is properly configured if using Ollama

📝 License

This project is open source and available under the MIT License.

Built with ❤️ by Tony Kipkemboi