taokeqin/spyder

spyder

Run unittest:

python -m unittest discover

Application Demo:

python spyder.py -u "http://docs.python-requests.org/en/latest/" -d 2 -t 5 -l warning

Only support extrack static html link in tag.

Todo:

implement Downloader based on headless webkit