/DeepWebCrawler

Python DeepWebCrawler for onion sites.

Primary LanguagePython

DeepWebCrawler


Simple script for crawling .onion sites.
Crawl pages and find href links.
Follow links and crawl recursively.
Delete duplicate links in the end and show final result.

Install Requirements

apt-get install tor You Should Install Tor For Linux
pip install -r requirements.txt

Prerequisites

Change <.onion site> parts from the code to a valid onion site that you want to crawling

Usage

python DeepWebCrawler.py