/Python-web-crawler

Determine the no. of links that must be followed to reach a page starting from seed page.

Primary LanguagePython

Python-web-crawler

Determine the no. of links that must be followed to reach a page starting from seed page.

Requirements

  • Python 2.7
  • python packages: requests, bs4

Usage

git clone
cd Python-web-crawler
python solution.py

Enter the seed page's URL and max_depth to start the crawl. Be patient for the results to show up.