A collection of crawlers for news web sites. API is used to grab links of the latest stories and provide them in a clean json format to be rendered however you need. Most news orgs do not provide an api to get their latest stories, so I have created my own. Included is a simple index file for viewing the current api.
This api relies on node.js so make sure you have a revent version installed.
- git clone https://github.com/OpenNewsLabs/spiders.git
- cd spiders && npm install
- node app.js
- open up the index viewer of all the latest news at the local uri http://localhost/cnn
After local installation is running all apis below can be viewed by appending to base path. example: "http://localhost:3000/cnn"
- GET /cnn
- GET /fox
- GET /bbc
- GET /nyt
API tests are run using mocha. Before you run mocha you must have the API running ( step three under local installation )