/news-scraper

a news article site scraper

Primary LanguageJavaScript

news-scraper

A Web Scraper for New York Times World News section

Technologies used

  • Express
  • Mongodb
  • Mongoose
  • Handlebars
  • Axios
  • Cheerio

Setup

    git clone git@github.com:kepa4/news-scraper.git
    npm install
    node server.js 

if you want to scrape for new articles, replace /articles in the url with /scrape

bugs

  • Cant Post comments on any articles that isn't the first one

Future Implementation

  • A way to delete comments
  • An easier way to scrape again