benbriggsy/python-web-indexing

Grade: 100% | The reason I got 100% was because I halved the crawl time by making sure https and http url's were not treated as different web pages. The only code written by me is in indexer.py

Python