Puppeteer web-scraper

The main goal of this project is to scrape large data using utilize Puppeteer in order to scrape repetitive structures, navigate over pages through repetitive button clicks, and manipulate text and save all of the scraped info into a structure.

Installation Process

To make sure the application runs smoothly. pls install the dependency

npm install

Run

The application takes 2-3 min to end

node main.ts