scrapers
There are 133 repositories under scrapers topic.
emcf/thepipe
Extract clean data from anywhere, powered by vision-language models ⚡
openstates/openstates-scrapers
source for Open States scrapers
alltheplaces/alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
josephlimtech/linkedin-profile-scraper-api
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
oxylabs/quick-start-guide
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
AlexMathew/scrapple
A framework for creating semi-automatic web content extractors
needmorecowbell/sniff-paste
Pastebin OSINT Harvester
amoudgl/short-jokes-dataset
Python scripts for building 'Short Jokes' dataset, featured on Kaggle
DiegoCaraballo/Email-extractor
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
alash3al/scraply
Scraply a simple dom scraper to fetch information from any html based website
philshem/gmaps_popular_times_scraper
Scraper for Google Maps "Popular Times" for place entries
RealEstateWebTools/property_web_scraper
Web based UI to make scraping data from real estate websites super simple
SilentDemonSD/FZBypassBot
A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!
OpenByteDev/SourceScraper
Simple library which helps you to retrieve the source of various video streaming sites.
scrapehero-code/amazon-review-scraper
A basic python 3 based web scraper for extracting reviews from Amazon. Built using Selectorlib and requests
shashwatah/instahunter
CLI OSINT app that can fetch data from Instagram's Web API without authentication.
mendableai/firecrawl-app-examples
🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.
xbmc/repo-scrapers
Official source repository for Kodi scraper add-ons
xtream1101/scraperx
Library for scraping websites or apis at any scale
lvxhnat/pyetfdb-scraper
Scrape ETF data for free - the unofficial python wrapper for ETFDB
omardelarosa/pitchfork-npm
An Unofficial Pitchfork Music API client for Node.js
kadnan/airflow-scraping
Using Apache Airflow to schedule web scrapers
flulemon/sneakpeek
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
sup-Udh/Scraper-io
📈 A visual & terminal based web scraper
asimpson/nodejs-web-scraper-cookbook
📝 Resources for web scraping with node.js
sallamy2580/python-web-scrapping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
AgentANAKIN/Google-Web-Scraper
This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.
oxylabs/Web-Scraping-With-Selenium
In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6
recommend-games/board-game-scraper
Board game data scraper
yuis-ice/jseval
Evaluate JavaScript on a URL through headless Chrome browser.
crawlbase/proxycrawl-node
ProxyCrawl Node library for scraping and crawling
crawlbase/proxycrawl-php
ProxyCrawl PHP library for scraping and crawling websites
robertciotoiu/mobile-de-car-data-collector
Crawl, scrape and persist Mobile.de car listings data in a smart & responsible way
rtunazzz/Craper
Collection of product scrapers for various websites.
jamesbower/Reddit-Scraper
Reddit Scraper is a Python script that utilizies the PRAW Python library to interact with Reddit's API.
Seng-Jik/QwQ
Anime Wallpaper Downloader.