has9h/web-scraping

Learning the art of a much needed craft

Getting Started with Web Scraping

Working with beautifulsoup and requests

Parser: html5lib(lxml does not work for some reason)

Files

• alon_colon.py - Scraping dataset for gene microarray expression, which is in html
• springer-fetching-pdfs.py - Automating downloading free Springer books

Helpful guidelines found here:

• Downloading with urllib
• Using Unicode Normalization to Represent Strings
• Unicode HOWTO
• Unicode Equivalence
• unicodedata.normalize