/crawler

python based multi threaded web crawler crawls links on desired url.

Primary LanguagePython

crawler

Description

Python based multi-threaded web crawler using "urllib"

PreRequisites

  • Python 3

Deployment

Just run the main code using python main.py