A simple crawler written for learning basics of ruby. Should not be used for anything other than play.
$ git clone https://github.com/skinnyp/rubycrawl.git
$ cd rubycrawl
$ bundle install
ruby -Ilib ./bin/rubycrawl <seed> <max crawl depth>
rake test