xiaozhenliang/tigerspider

tigerspider: a fast high-level screen scraping and web crawling framework for Python.

webspider

a python spider, use tornado, lxml, redis, postgreSQL