/alexa_spider

Primary LanguagePythonMIT LicenseMIT

alexa_spider

About

Spider built with Scrapy. Crawls first 50k ranked websites currently on alexa.com and scrapes data points such as:

  • Country of Rank
  • Rank Number
  • Search Visits
  • Domain

Screenshot

Screenshot

Installation and Running

git clone https://github.com/Lazar-T/alexa_spider
cd alexa_spider
scrapy crawl alexa