抓取 https://spring.io/guides 所列主题的github链接
- 安装Python环境
- 安装scrapy, pymongo:
pip install -i https://pypi.doubanio.com/simple -U scrapy pymongo - 或者
pip install requirements.txt
scrapy crawl spguides --nolog抓取 https://spring.io/guides 所列主题的github链接
pip install -i https://pypi.doubanio.com/simple -U scrapy pymongopip install requirements.txtscrapy crawl spguides --nolog