/scraper-practice

miniprojects built to develop scraping ability

Primary LanguagePython

scraper-practice

This repository is a a repository filled with exercises in learn how to Scrape

A) RealPython Projects: these projects are exercises based on the Pt2 of the Real Python course

hackernews - prepares an introduction to Scrapy, by scraping just the list of titles of https:\news.ycombinator.com :

wikipedia - prepares an introduction to Scrapy, by scraping the list of films made in 2014

socrata - prepares an introduction to Scrapy, by crawling and scraping socrata and outputting to a database in sqlite3

B) Original Projects: these projects are exercises devised by CM to further skills or just for kicks!

angelcrunch - this project is designed to investigate the data available on angellist and crunchbase as requested as part of an exercise for work