ai-scraping
There are 14 repositories under ai-scraping topic.
mendableai/firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
D4Vinci/Scrapling
🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!
itsOwen/CyberScraper-2077
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
raznem/parsera
Lightweight library for scraping web-sites with LLMs
devflowinc/firecrawl-simple
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
mendableai/firecrawl-app-examples
🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.
ArchiveBox/abx-dl
⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...
kaymen99/ai-web-scraper
AI web scraper built with Crawl4AI for extracting structured leads data from websites.
spider-rs/web-crawling-guides
How to guides on web-crawling or scraping
spider-rs/spider-clients
Python, Javascript, and Rust libraries for the Spider Cloud API.
nathabonfim59/md-fetch
A CLI tool and REST API that converts web content to clean Markdown, bypassing anti-scraping measures using headless browsers. Perfect for AI/LLM applications
nsourlos/AI_tools
AI tools to enhance productivity and automate web-scraping
jenslys/skrape-js
TypeScript/Node.js SDK to easily interact with the skrape.ai API
skrapeai/examples
This repository contains complete application examples, developed using Skrape.ai