scrapping
There are 597 repositories under scrapping topic.
Xonshiz/comic-dl
Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.
baptisteArno/tinking
🧶 Extract data from any website without code, just clicks.
hemansnation/Python-Roadmap
Python Roadmap. Learn Python programming as your first programming language. Python for Absolute Beginners, Non-Tech Professionals, 15+ Projects, 30 Topics, 500+ Practice Questions, with Data Structures & Algorithms
DiegoCaraballo/Email-extractor
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Mati365/librus-api
📚🇵🇱 A free, open-source utility for scraping data from the Synergia Librus (http://synergia.librus.pl/) electronic gradebook. Developed and maintained by the community, it allows easy access to grades, attendance, messages, and more - completely free of charge.
tharyckgusmao/Skill-Share-Crawler---DL
Download Videos Skill Share per ID or per Class
clemfromspace/scrapy-cloudflare-middleware
A Scrapy middleware to bypass the CloudFlare's anti-bot protection
meetps/mit-ocw-dl
Download all video lectures from a MIT-OCW course with a single command.
carmolim/olx-monitor
Script que monitora novos anúncios feitos no OLX, alteração de preços em anúncios existentes e envia notificações para seu Telegram.
pwnedshell/Bugs-feed
Bug's feed is a local hosted portal where you can search for the latest news, videos, CVEs, vulnerabilities...
lfreneda/statusinvest
:money_with_wings: statusinvest.com.br stocks info web scraper
msoap/html2data
Library and cli for extracting data from HTML via CSS selectors
floriandiud/whatsapp-group-members-scraper
Scrape WhatsApp group member for free
shivam5992/pyscrapper
:camera: web scrapping in python: multiple libraries -requests, beautifulsoup, mechanize, selenium
invoice-collector/invoice-collector
Free automatic invoice collector 🧾 Collect your invoices in seconds ⏰ Docker container 🐳
clouedoc/goquotes
A Go scraper aimed at scrapping quotes.
soulee-dev/fuckvkeypad
가상키보드(vKeypad) 우회도구
isso/pararius-apartment-hunting-dashboard
🏡 A NodeJS server to scrape Pararius listings and show them in a dashboard 🏘️
LakshyaKhatri/Bookshelf-Reader-API
A browsable REST API for recognizing book spines in an image.
davidAlgis/zotero2SemanticScholar
Send zotero libraby to semantic scholar and add alert on them
capyvara/brazil-civil-registry-data
Raw scrapings of ARPEN https://transparencia.registrocivil.org.br/
bhushankummar/chrome-extension-starter-kit
Chrome Extension starter Kit with es6 standards
matheusfelipeog/fordev
Gere e valide dados randômicos com fordev 🎲
its0x08/duckduckgo
A simple DuckDuckGo URL scraper.
kserhii/money-parser
Price and currency parsing utility
yuis-ice/jseval
Evaluate JavaScript on a URL through headless Chrome browser.
Stvad/google_books_highlight_extractor
A script to extract highlights and notes from Google Books GDoc to RoamResearch, Markdown, Anki CSV
MihailCosmin/AutoMonkey
Python Automation using Mouse and Keyboard, for the masses
aydinnyunus/ScrapIn
LinkedIn Scraper
spaiz/hrscanner
Websites scanner for X-Recruiting header
tal95shah/OLX_Scraper
:radio: An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
wrobirson/ConsultasDgii
Provee un API de .NET escrita en el lenguaje C# que permite realizar validaciones de RNC/Cédula en el sitio web de la Dirección General de Impuestos Internos (DGII) de la República Dominicana
InvestigUser/InvestigUser
X - Twitter, WhatsApp, Facebook, Instagram, Telegram, SnapChat and TikTok investigation (OSINT / SOCMINT tool) - Username and email checkers on websites. Full plateform scrapping tool, deep tweets searches, followers and following scrapping and friends comparaison.
luiseduardobr1/PCIConcursos
Extrair os concursos disponíveis do site PCI Concursos em nível nacional e estadual, avisando quando tem um novo concurso disponível para a região escolhida
luismr/the-pudim-hunter
The Pudim Hunter 🍮 is a Proof of Concept (PoC) tool to scrape job listings from SimplyHired, analyze them against your resume, and assign a relevance score. Get insights into how well each job matches your skills. Automate your job search smarter! 🚀
NemesisX1/cine_book_scrapping_api
A simple api to scrap a popular theater in Africa to get movies and theaters data