This repos contains a collection of guides on how to effectively use the Spider service to crawl or scrape. Contributors are welcome! 😁
- Using the Spider API
- How to Use Proxy Mode
- LangChain + Groq + Spider = 🚀 (Integration Guide)
- CrewAI Spider Stock Research
- Extracting Contacts
- Automated Cold Email Outreach Using Spider
- How to Archive Full Website
- Building A Speedy Resilient Web Scraper for RAG AI (Part 1, Part 2)
- Agents from Scrach
We're happy to accept requests in the issue tracker, improvements to the content, and additional guides.