/app_monitor

Python scrapy crawlers for apps version update

Primary LanguagePython

My App Monitor Scrapy Module

Prerequisite

pip3 install setuptools wheel scrapy packaging elasticsearch

Setting

Copy app_monitor.sample.cfg to ~/.app_monitor.cfg, and replace with real settings

Start crawl spider

scrapy crawl <spider_name>

Add new spider

scrapy genspider <name> <domain>