life website crawler
scrapy life websit (http://love.heima.com/)
first commit is a raw and the simplest pitch
after then , some work will add into it for faster and more efficient
step one : using mutlithread or twist step two : using scrapy framework step three : support mutlistorages, like mongodb, mysql.
requirement: sqlite3, sqlalchemy, beautifulsoup