mrks111's Stars
sherlock-project/sherlock
Hunt down social media accounts by username across social networks
sundowndev/phoneinfoga
Information gathering framework for phone numbers
OpenRefine/OpenRefine
OpenRefine is a free, open source power tool for working with messy data and improving it
BruceDone/awesome-crawler
A collection of awesome web crawler,spider in different languages
dedupeio/dedupe
:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
novnc/websockify
Websockify is a WebSocket to TCP proxy/bridge. This allows a browser to connect to any application/server/service.
daviddrysdale/python-phonenumbers
Python port of Google's libphonenumber
quoid/userscripts
An open-source userscript manager for Safari
my8100/scrapydweb
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
CrawlScript/WebCollector
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
scrapy/scrapyd
A service daemon to run Scrapy spiders
apify/fingerprint-suite
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
amq/firefox-debloat
Stop Firefox leaking data about you
je-suis-tm/web-scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
yatish27/linkedin-scraper
Scrapes the public profile of the linkedin page
HoloClean/holoclean
A Machine Learning System for Data Enrichment.
mdsecactivebreach/LinkedInt
LinkedInt: A LinkedIn scraper for reconnaissance during adversary simulation
dedupeio/csvdedupe
:id: Command line tool for deduplicating CSV files
website-scraper/website-scraper-puppeteer
Plugin for website-scraper which returns html for dynamic websites using puppeteer
HoangTran0410/useful-script
Chrome extension that provides a lot of useful scripts
champmq/TheScrapper
Scrape emails, phone numbers and social media accounts from a website.
linkedtales/scrapedin-linkedin-crawler
Crawler for LinkedIn full profiles 2019
psalias2006/Google2Csv
Google2Csv a simple google scraper that saves the results on a csv/xlsx/jsonl file
amerkurev/scrapper
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
Ram-95/Indeed_Job_Scraper
:briefcase: Given the Skill and the Location, this script will scrape the Indeed Indian website and present the matching job details.
peerside/awesome-data-wrangling
A curated list of data wrangling resources
jakobgreenfeld/fun_and_profit
ShivrajY/MagicBox
MonashDataFluency/python-web-scraping
Hands-on workshop material on Web scraping using Python
jakobgreenfeld/awesome-indie
Resources for independent developers to make money