/Nodejs-Web-Crawling

Crawling or web scraping refers to the process of sending an HTTP request to a specific URL and extracting the HTML of the corresponding webpage in order to obtain relevant and valuable information.

Primary LanguageJavaScript

Nodejs-Web-Crawling

By sending HTTP request to a particular URL and then by extracting HTML of that web page for getting useful information is known as crawling or web scraping.

Installation

npm init

npm install request

npm install cheerio

npm install fs

npm install nodemon

We will hit the URL from where we want to crawl data:

const URL = "https://www.flipkart.com/search?q=mobiles"

Image

Image

data.txt

Image

Run the server

npm start