/ScraperSite

Blog Scrapper - Frontend (React+Redux+Router) / Backend (Node JS + Express Js + Cherrio)

Primary LanguageJavaScript

ScraperSite

Blog Scrapper - Frontend (React+Redux+Router) / Backend (Node JS + Express Js + Cherrio)

Scrapper

  • Read the sitemap
  • Go to each URL and check if the title exist in the DB -if not: add in the DB

It gets the Image URL, Category, Title, Content, Number of Comments.

To test (to myself)

Go to backend (server):

nodemon server

Go to the frontend:

npm start

How to execute the project from zero

  1. Clone this repository locally
  2. Install all necessary packages, execute:
npm install
  1. To run the project (development mode), execute:
npm start