crawler

143 line in total

how to run

bundle install

then

thor app:crawl http://shop2market.com/

you can pass another parameters like number of pages and depths

thor app:crawl http://shop2market.com/ 50 3

mido18/crawler