/crawler

Prerequisites:

  1. Make sure you have ruby installed in
  2. Make sure the file crawler is executable

To Run:

./crawler https://kameshwaran.github.io kameshwaran 2

first parameter - website second parameter - keyword third parameter - depth

Sample output:

Kameshs-MacBook-Pro:crawler kamesh$ ./crawler http://kameshwaran.github.io Kamesh
Crawled 27 pages
Found 7 matches with the term Kamesh
http://kameshwaran.github.io=>elcome to Kameshwaran's bl
http://kameshwaran.github.io=>opy 2017, Kameshwaran S, A
https://github.com/Kameshwaran=>eshwaran (Kameshwaran Sach
https://github.com/Kameshwaran=>   http://kameshwaran.gith
https://github.com/Kameshwaran=>          Kameshwaran has
http://kameshwaran.github.io=>elcome to Kameshwaran's bl
http://kameshwaran.github.io=>opy 2017, Kameshwaran S, A