Tarster/awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

Awesome Web Scraping

Lists of packages, services and manuals related to web scraping.

Topics

• Python - Python packages
• PHP - PHP packages
• Ruby - Ruby packages
• JavaScript - JavaScript packages
• Go - Go packages
• Web Scraping Manuals - list of articles and books teaching web scraping
• dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
• DNS over HTTPS providers - list of DNS over HTTPs providers

Captcha Solving Services

• https://2captcha.com

Proxy Server Marketplaces

• https://www.blackhatworld.com/forums/proxies-for-sale.112/
• https://forum.antichat.com/forums/147/

Telegram Discussion Groups

• @grablab - English talks
• @grablab_ru - Russian talks

How to Contribute to This List

See Contributing guide.

Credits

The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript