/scrapegraph-sdk

🕷️ Official Scrapegraph API SDK: Effortlessly extract content from any website. AI-powered. 🤖 Hassle-free web scraping made simple.

Primary LanguageJupyter NotebookMIT LicenseMIT

🌐 ScrapeGraph AI SDKs

License Python SDK JavaScript SDK Documentation

ScrapeGraph API Banner

Official SDKs for the ScrapeGraph AI API - Intelligent web scraping and search powered by AI. Extract structured data from any webpage or perform AI-powered web searches with natural language prompts.

Get your API key!

🚀 Quick Links

📦 Installation

Python

pip install scrapegraph-py

JavaScript

npm install scrapegraph-js

🎯 Core Features

  • 🤖 AI-Powered Extraction & Search: Use natural language to extract data or search the web
  • 📊 Structured Output: Get clean, structured data with optional schema validation
  • 🔄 Multiple Formats: Extract data as JSON, Markdown, or custom schemas
  • High Performance: Concurrent processing and automatic retries
  • 🔒 Enterprise Ready: Production-grade security and rate limiting

🛠️ Available Endpoints

🤖 SmartScraper

Using AI to extract structured data from any webpage or HTML content with natural language prompts.

🔍 SearchScraper

Perform AI-powered web searches with structured results and reference URLs.

📝 Markdownify

Convert any webpage into clean, formatted markdown.

🌟 Key Benefits

  • 📝 Natural Language Queries: No complex selectors or XPath needed
  • 🎯 Precise Extraction: AI understands context and structure
  • 🔄 Adaptive Processing: Works with both web content and direct HTML
  • 📊 Schema Validation: Ensure data consistency with Pydantic/TypeScript
  • Async Support: Handle multiple requests efficiently
  • 🔍 Source Attribution: Get reference URLs for search results

💡 Use Cases

  • 🏢 Business Intelligence: Extract company information and contacts
  • 📊 Market Research: Gather product data and pricing
  • 📰 Content Aggregation: Convert articles to structured formats
  • 🔍 Data Mining: Extract specific information from multiple sources
  • 📱 App Integration: Feed clean data into your applications
  • 🌐 Web Research: Perform AI-powered searches with structured results

📖 Documentation

For detailed documentation and examples, visit:

💬 Support & Feedback

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.


Made with ❤️ by ScrapeGraph AI