/GPlayCrawler

Primary LanguagePython

A crawler based on Scrapy used to crawl App's information in Google Play

Results include information below:

  • Url
  • App'ID
  • Score
  • Publish Date
  • File Size
  • Number of Downloads
  • Software Version
  • Pperating Systems
  • Content Rating
  • Thumbs
  • Icon
  • Description
  • Reviews(include author, date, content and rating)
  • Permissions

Requirements:

  • MongoDB 3.4
  • Python 2.7
  • Scrapy 1.3

Usage:

shell command: scrapy crawl google