/Crawl-Robots

Automatically crawl data from HIT websites

Primary LanguageRubyMIT LicenseMIT

Crawl-Robots

Automatically crawl data from HIT websites

Websites List

How to install

  1. Install either MySQL or libmysqlclient-dev
  2. Install Ruby 2.1.2 or greater using either rbenv or RVM
  3. gem install bundler
  4. rbenv rehash # If you use rbenv, rehash to be able to run the bundle command
  5. bundle install

License

MIT License