Tang-Li-Jen/SimilarWeb_Scraper

Python Web Scraper For SimilarWeb

SimilarWeb_Scraper

With free account, you can scrape Top 100 website traffic data by all categories on SimilarWeb.

Develop environment

MacOS Siera, Python2

Preparation

1. set file path
2. set Chromedriver/PhantomJS
3. set your email/password

Concept

First, login SimilarWeb with your personal account and then extract the cookies for futher use. Second, send get requests with the cookies to get tables including website traffic data.