/intrcptr

nodejs network request web crawler based on puppeteer

Primary LanguageJavaScript

intrcptr

A nodejs network request web crawler based on puppeteer . This basically allows you to sniff network request made by a website, grab all of that good data and save it nicely in a json file.

This basically allows you to trace requests made by a client such as in the program where we grab request data from the urls in urls.

The urls were scraped using this webscraper.

Why that site?

They happen to stream all the radio station in Kenya and other countries and I happen to be interested in that.

Requirements

npm i puppeteer

Compile

node app.js

If you happen to be a nodejs dev

Please bare with my spaghetti code and help me improve it.