azmat21/UyghurWebsiteCrawler

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy)

UyghurWebsiteCrawler - An Amazing Project

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy) It is an Amazing work piece.

Preparations:

Python and Scrapy is required.

Before run this code , please read the Scrapy Docs in the given link:

http://scrapy.org/

Run

To run this code open the Terminal and run the commond some like below(where xxx is your scrapy spider name ):

scrapy crawl xxxx

download and use this project