scraping-tool
There are 61 repositories under scraping-tool topic.
lorien/awesome-web-scraping
List of libraries, tools and APIs for web scraping and data processing.
omkarcloud/botasaurus
The All in One Framework to Build Undefeatable Scrapers
ispras/web-scraper-chrome-extension
Web data extraction tool implemented as chrome extension
pavlovtech/WebReaper
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
fernandod1/Instagram-downloader
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
OpenByteDev/SourceScraper
Simple library which helps you to retrieve the source of various video streaming sites.
lspahija/torchestrator
Spin up Tor containers and then proxy HTTP requests via these Tor instances
harismuneer/Android-Apps-Downloader
📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).
ScrapingAnt/zoominfo_scraper
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
fernandod1/ProductHunt-scraper
Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
omkarcloud/botasaurus-starter
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Marcel0024/CocoCrawler
An declarative and easy to use web crawler and scraper in C#
pim97/scrappey-wrapper-python
An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)
ScrapingAnt/alibaba_scraper
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
Joabutt/ScrapeDogg
GPT4 Assisted Web Scraping Library
JonusNattapong/Crewzombitx64
This project was inspired by the unclecode/crawl4ai repository. It provided valuable insights and ideas that helped shape the development of Crewzombitx64.
mapmeld/aoc_reply_dataset
Building a dataset of Twitter replies for unsupervised learning / bot-blocking
DemonMartin/scrappey-wrapper
An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)
pim97/scrappey.js
Scrappey.js: A versatile JavaScript wrapper for Scrappey API for solving Cloudflare, datadome, enabling seamless web scraping of anti-bot protected websites. Simplify data extraction with robust functionality and reliable results. Unlock valuable insights effortlessly. Get started with Scrappey
andytyler/gethtml
Utility for web scraping and fetching the html from a url, using various strategies in a 'waterfall' approach.
luminati-io/Awesome-Web-Scraping
A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.
omkarcloud/web-scraping-template
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
skvrahul/chegg_dl
Python script to automate the download of textbooks from Chegg
jaeyk/digital_data_collection_workshop
Digital Data Collection Workshop
rija/ghost-ssg
A Docker-based pipeline to publish the content of a local Ghost 4 server as static pages.
Ekans122/Aliexpress-scraper-without-api-free
Aliexpress products scraping.
MustakAbsarKhan/DSE_COMPANY_SCRAPER_Python
The DSE Company Scraper is a Python program that extracts data from the Dhaka Stock Exchange website and saves it to an Excel file for analysis.
seaavey/scapers
The Scapers is a collection of tools for scraping data from the web.
colonelpanic8/lastfm-edit
Edit last.fm scrobbles programmatically
CyberSudo/Udemy-Enroller
Python script that written by selenium to automate the process of enrolling in Udemy courses.
franckferman/Scraping-Deputes-France
Script pour scraper les député·e·s français (Nom, Région, Email, Groupe, Circonscription) depuis le site de l'Assemblée nationale.
ayushsoni1010/portfoliogram
⚡️Elevate your portfolio analysis with our cutting-edge web scraping tool. Uncover valuable insights about individuals, their skills, and social profiles effortlessly.
mannasoumya/instapy_pubprofiles
Download Instagram Photos and Videos given Link to Posts
lordpaoloo/Poder
Poder is A powerful tool to collect publicly available data from social media platforms such as Facebook, YouTube, and Instagram. It organizes the extracted information, including names, phone numbers, emails, and links, into an easy-to-manage Excel sheet. Features include AI chat integration, multi-platform data collection, and real-time insights.
LukeRenton/wsctools
Collection of helper functions designed to facilitate efficient web scraping in python
Pryodon/Web-Spider-Linux-shell-script
Generate a list of file links you can feed to wget for easy downloading! Mainly used for spidering web folders with lots of files. Can even generate a sitemap.txt or XML file for your website!