/crawl_data

web scraping, beautifulsoup, scrapy,etc.

Primary LanguagePython

crawl_data

web scraping, beautifulsoup, scrapy,etc. learn practice and some concepts from video, then read the offical document, then maybe ebook

Data source

[PublicAPI] -> [html-request][beautifulsoup] -> [Selenium]

Request-HTML

Python Tutorial: Web Scraping with Requests-HTML

Python Tutorial: Web Scraping with BeautifulSoup and Requests

request-html-official-document

BeautifulSoup

official-document

Web Scraping with Python - Beautiful Soup Crash Course

Comprehensive Python Beautiful Soup Web Scraping Tutorial! (find/find_all, css select, scrape table)

web-scraping-method

Selenium

official-website

official-document

Selenium Course for Beginners

Scrapy

official-website

official-document