/ModCrawl

Modular crawling for data targets. Non-recursive.

Primary LanguagePythonGNU Lesser General Public License v2.1LGPL-2.1

This project is currently discontinued. It is recommended to read the output of the python script when started with --help to get started. The only non-standard-dependency required is requests.