/web-crawler

A basic web crawler created in Python

Primary LanguagePython

web-crawler

A basic web crawler created in Python 3 using the following libraries:

  • Requests
  • Beautiful Soup (bs4)
  • Argparse
  • Urllib

Example format: web_c.py -H host_to_be_crawled (https:(host)/)