tsbolty/scraping

This application demonstrates 5 different ways to scrape websites. Utilizes Fetch, Axios, Puppeteer, Cheerio and an NPM package called Web-Scraper.

5 Ways To Scrape Websites

Description

This application demonstrates 5 different techniques to scrape data from websites. Each technique will return data, but some of these techniques also create an 'output' directory with all of the HTML, CSS, Javascript, Images, etc.

Table of Contents

• Installation
• Usage
• License
• Contributing
• Tests
• Questions

Usage:

This is a Node environment application. Each technique will make requests to a server and return the corresponding website's data. You may not need all packages in the dependencies, that will depend on which technique you decide to use.

Contributing:

If you know of another way to scrape web data, I would love to hear it. Feel free to reach out to me and I will consider any contribution.

License:

MIT

To install necessary dependencies run the following command: npm i

Creator Github account: GitHub