A collection of awesome things regarding DSPy.
DSPy - A library for compiling declarative language model calls into self-improving pipelines.
- XMC - Infer Retrieve Rank multi-label classification tasks with an extreme amount of classes (≥10,000 classes)
- dspy-arxiv - Explore the use of DSPy for extracting features from PDFs
- DSPyGen - A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.
- dspy-inspector - DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
- Storm - STORM, a writing system for the Synthesis of Topic Outlines through Retrieval and Multi-perspective Question Asking. Paper
- DSPy with FASTAPI - a straightforward example of building a FastAPI backend with DSPy capabilities.
- DSPy OpenTOM - Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset.
- Self Discover - SELF-DISCOVER: Large Language Models Self-Compose Reasoning Structures Paper Video
- dspy-gradio-rag - RAG example using DSPy, Gradio, FastAPI
- Synthesizer - Synthetic data generation colab.
- Self Discover Colab - Self Discover demo using Colab.
Resources
- Prompt engineering is a task best left to AI models
- What makes DSPy a valuable framework for developing complex language model pipelines?
- DSPy: A new framework to program your foundation models just by prompting
- Intro to DSPy: Goodbye Prompting, Hello Programming
- DSPyGen: Revolutionizing AI
- Building an AI Assistant with DSPy
- DSPy: Transforming Language Model Calls into Smart Pipelines // Omar Khattab - MLOps.community
- Omar Khattab, DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines - FunctionalTV
- DSPy Explained! - Connor Shorten
- Programming Foundation Models with DSPy / Multivector Semantic Search with ColBERT // Omar Khattab -- Cohere
- Getting Started with RAG in DSPy! - Connor Shorten
- Getting started with DSPy tutorial - QDrant
- NEW DSPyG: DSPy combined w/ Graph Optimizer in PyG - code_your_own_AI
- Adding Depth to DSPy Programs - In depth on DSPy optimiser.
- Self-Discover in DSPy with Chris Dossman - Weaviate Podcast #90!
- Can You Tell Me About DSPy Optimizers: How Module Signatures & Prompts Are Modified by Optimizers - Best explanation of DSPy Optimizers I have seen.
- Can You Tell Me About DSPy: How DSPy Automates Prompt Engineering Modularly
- Introducing 7 Modules Their Application & Prompts in DSPY: Can You Tell Me About DSPy Modules
- Can You Tell Me How To Connect Multiple Open Source Models With DSPy & Run Inference With Predict
- DSPy Tutorial Playlist: Goes in depth on Signatures, Modules, Optimizers