A simple crawler of 中國哲學書電子化計劃
Just for fun, do not use it to crawl too much data or you will get banned.
- Install
Scrapy - Crawl 《全唐詩》
scrapy crawl quantangshi -o quantangshi.json
cat quantangshi.json | json_pp > quantangshi.json
A simple crawler of 中國哲學書電子化計劃
Just for fun, do not use it to crawl too much data or you will get banned.
Scrapyscrapy crawl quantangshi -o quantangshi.json
cat quantangshi.json | json_pp > quantangshi.json