/scraping

tools n tricks

Primary LanguagePythonBSD 2-Clause "Simplified" LicenseBSD-2-Clause

scraping

tools n tricks for web scraping

Project setup

  • Modelled after docs linked here.

XPath selectors

  • These are very helpful for debugging a given scraping script. A cheat sheet I like is linked here.
    • GET text content related to each result in the Google SERP: $x("//div[contains(concat(' ',normalize-space(@class),' '),' VwiC3b ')]")