The assignment code consist of two parts:

  1. Web crawling
  2. Retrieval