haleyelder/cheerio-demo

Cheerio demo repo for WWC PDX Study Nights! https://github.com/wwcodeportland/study-nights/tree/master/javascript

Web Scraping!

What We'll Need

• Node - https://nodejs.org/en/ - server side JavaScript
• Cheerio https://github.com/cheeriojs/cheerio - the scraper!
• Request https://github.com/request/request - grabbing data

Fun Examples

• Una and Suz web scraping ticket lottery for Hamilton to connect an IoT light
• Web Scraping For Fun and Profit
• Automate the Boring Stuff

(Not So) Fun Examples

• Fair Use Laws!
• A Couple of Lawsuits
• price scraping (travel sites, ticketing, shopping)
• content (scrape and sell for $$)
• Some limits: rate limits, gated content, poor markup, etc..

History && Other!

• Web Scraping Protection
• Crawling Techniques
• All you need to know about Web Crawling
• Web Scraping for your Site