/WebCrawler

A Web Crawler for my information Retrieval Course

Primary LanguagePython

WebCrawler

A Web Crawler for my information Retrieval Course

Features:

  1. Crawler
  2. Tokenizer
  3. IR Utilities: Bigrams, idf, inverted index etc.