scrapers
There are 128 repositories under scrapers topic.
openstates/openstates-scrapers
source for Open States scrapers
emcf/thepipe
Feed PDFs, URLs, Slides, YouTube, and more into Vision-Language models with one line of code⚡
alltheplaces/alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
AlexMathew/scrapple
A framework for creating semi-automatic web content extractors
josephlimtech/linkedin-profile-scraper-api
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
needmorecowbell/sniff-paste
Pastebin OSINT Harvester
amoudgl/short-jokes-dataset
Python scripts for building 'Short Jokes' dataset, featured on Kaggle
DiegoCaraballo/Email-extractor
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
alash3al/scraply
Scraply a simple dom scraper to fetch information from any html based website
RealEstateWebTools/property_web_scraper
Web based UI to make scraping data from real estate websites super simple
philshem/gmaps_popular_times_scraper
Scraper for Google Maps "Popular Times" for place entries
SilentDemonSD/FZBypassBot
A Elegant Fast Multi Threaded Bypass Bot for Bigger Deeds. Try Now !!
OpenByteDev/SourceScraper
Simple library which helps you to retrieve the source of various video streaming sites.
shashwatah/instahunter
CLI OSINT app that can fetch data from Instagram's Web API without authentication.
scrapehero-code/amazon-review-scraper
A basic python 3 based web scraper for extracting reviews from Amazon. Built using Selectorlib and requests
xtream1101/scraperx
Library for scraping websites or apis at any scale
xbmc/repo-scrapers
Official source repository for Kodi scraper add-ons
omardelarosa/pitchfork-npm
An Unofficial Pitchfork Music API client for Node.js
kadnan/airflow-scraping
Using Apache Airflow to schedule web scrapers
flulemon/sneakpeek
Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis
sup-Udh/Scraper-io
📈 A visual & terminal based web scraper
lvxhnat/pyetfdb-scraper
Scrape ETF data for free - a python wrapper for scraping ETFDB
asimpson/nodejs-web-scraper-cookbook
📝 Resources for web scraping with node.js
AgentANAKIN/Google-Web-Scraper
This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.
recommend-games/board-game-scraper
Board game data scraper
oxylabs/Web-Scraping-With-Selenium
In this guide on how to web scrape with Selenium, we will be using Python 3. The code should work with any version of Python above 3.6
yuis-ice/jseval
Evaluate JavaScript on a URL through headless Chrome browser.
crawlbase/proxycrawl-node
ProxyCrawl Node library for scraping and crawling
sallamy2580/python-web-scrapping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
crawlbase/proxycrawl-php
ProxyCrawl PHP library for scraping and crawling websites
rtunazzz/Craper
Collection of product scrapers for various websites.
robertciotoiu/mobile-de-car-data-collector
Crawl, scrape and persist Mobile.de car listings data in a smart & responsible way
FoxInFlame/matomari
Unofficial MAL API.
jamesbower/Reddit-Scraper
Reddit Scraper is a Python script that utilizies the PRAW Python library to interact with Reddit's API.
Seng-Jik/QwQ
Anime Wallpaper Downloader.
muhamed-didovic/ccdown
Scraper and downloader for codecourse.com