/websitecrawler

Simple website crawler implemented in Python.

Primary LanguagePython

websitecrawler

Simple website crawler implemented in Python 3.7.

Notable libraries/packages used:

  • Requests
  • lxml.html
  • cssselect
  • pathlib.Path
  • collections.Counter
  • unicodedata
  • re
  • time

Simple class diagram