Scrapes a URL and stores the contents. It provides a RESTful API to index a page's content.
- git clone
- Go to root directory of rails-page-scrapper
bundle install
- Configure database.yml as per your local settings
- Create database by executing command
rake db:create
- Perform database migrations by
rake db:migrate
- To execute the API calls start the rails server by
rails s
API for Scrapping new URL. URL: /api/v1/scrapper.json
Method: POST
Parameters: Name Type url String
API for get scrapped data. URL: /api/v1/scrapper.json
Method: GET
Parameters: No Parameters Required.