/PyPoecilotheria

A crawler based on events.

PythonPoecilotheria

An event based crawler written in python

Installation

Download latest tar-ball and run setup.:

curl -o pypoeci.tar.gz -O https://codeload.github.com/hanseartic/PyPoecilotheria/tar.gz/develop
tar zxvf pypoeci.tar.gz
cd PyPoecilotheria-develop/
sudo python3 setup.py install

Usage

Create a new object of Crawler in your code, set the pattern to find (css-select) and start the crawl with the first URL.