This repository introduces the fundamental cencepts of web scraping and practices using different web-scraping packages in Python. It also includes a brief introduction of API request for data collection.
- Request and Parsing
- Explore HTML Structure
- Isolate Data
- Preparing for Paginated Scraping
- Scraping Paginated Content
- Automating Web Browsing
- Basic Browser Interactions
- Handling Drag and Drop
- Selenum Implicit Wait Functions
- Selenum Explicit Wait Functions
- Create API Requests
- Parsing through JSON
- Using API Keys
- Linking API Calls
Selenium | Quotes to Scrape | Scraping Club | ChromeDriver | GeckoDriver | Rapid API
Note: There is a challenge exercise and solution included in this repository. We suggest beginners to play around with the tools and practice with some real-world examples. The best way to learn a tool is to use it!
Copyright © 2020 Norman Lo