/mini-puppeteer

Basic puppeteer scraping tool to supplement "smart scraper" (textsurfer) to capture rendered HTML from pages that require cookies and javascript to be enabled.

Primary LanguageJavaScript

Basic Puppeteer Scraper

This supplements a more efficient Rust-based static Web scraper (smart_scraper) for pages that require a headless browser that can accept cookies and render content via Javascript.