Welcome to scrape-tools 👋

✨ Introduction

scrape-tools is a scraping tools that support proxy and user agent generator for now (later will add cloudbypass, web headers, and many more). This project is for educational purposes (at this time), and perhaps will be a scraping tools npm package in the future...

🚀 Usage

To use this project, make sure you have node installed. If you have node already, run the following command:

~Clone this repository

git clone https://github.com/towtin/scrapeTools.git

~Install dependencies (make sure you are in the root of this repository)

npm install

~Generate a random proxy

node getProxy

~Generate user-agent based on your os and browser (modify in getHeaders.js file)

node getHeaders

📦 Package and Sources Used

I mainly used axios for the functionality and proxyscrape.com for the free elite proxies api source.

⭐ Support

Support this project by ⭐ Starring this repo
📍 10 ⭐ - will add http header generator and develop this project into npm package.
📍 100 ⭐ - will develop captcha and cloudflare bot detection bypass tool.

Made by @towtin