A simple crawler of 中國哲學書電子化計劃
Just for fun, do not use it to crawl too much data or you will get banned.
- Install
Scrapy
- Crawl 《全唐詩》
scrapy crawl quantangshi -o quantangshi.json
cat quantangshi.json | json_pp > quantangshi.json
A simple crawler of 中國哲學書電子化計劃
Just for fun, do not use it to crawl too much data or you will get banned.
Scrapy
scrapy crawl quantangshi -o quantangshi.json
cat quantangshi.json | json_pp > quantangshi.json