/phoneutria

Web crawler which saves pages having some keywords.

Primary LanguageCGNU General Public License v3.0GPL-3.0

Phoneutria

Web Crawler written in C

###What is Phoneutria

Phounetria is a web crawler written in C that take in input one or more URL seeds, keywords and depth, scan seed and other URLs founded and save pages (or files) that contain input keywords.

###Installation & configuration Download source and compile it with make file

###How start Start crawler is very simple ( SEED = url string , DEPTH = int , KEYWORD = string ) :

    ./phoneutria SEED1 [SEED2 SEED3 .. ] -d DEPTH KEYWORD1 [KEYWORD2 KEYWORD3 .. ]

###Credits Have participated at project (Alphabetical Order):