ruby-spidr
Crawl titles & meta description with Ruby and the Spidr gem.
A web crawler that I wrote for a TechLadies article. You can read the step-by-step tutorial that I wrote on how to build the crawler here, https://www.linkedin.com/pulse/build-web-crawler-5-easy-steps-salie-lim.