Simple script for crawling .onion sites.
Crawl pages and find href links.
Follow links and crawl recursively.
Delete duplicate links in the end and show final result.
apt-get install tor
You Should Install Tor For Linux
pip install -r requirements.txt
Change <.onion site> parts from the code to a valid onion site that you want to crawling
python DeepWebCrawler.py