/crawler

terminal app for crawling

Primary LanguageRuby

crawler

143 line in total

how to run

bundle install

then

thor app:crawl http://shop2market.com/

you can pass another parameters like number of pages and depths

thor app:crawl http://shop2market.com/ 50 3