/URL-crawler

inputs list of URLs, outputs top word counts on each domain

Primary LanguagePython

URL-crawler

inputs a list of URLs, outputs top word counts on each domain. #Usage:
$ python main.py input.csv output.csv stop_words.csv #Dependencies: sudo apt-get install python-mechanize sudo apt-get install python-beautifulsoup