/Web_scraping

Scraping the course catalog of IIT-Kharagpur using Beautiful Soup scraper in Python

Primary LanguageJupyter Notebook

Web_scraping

Scraping the course catalog of IIT-Kharagpur using Beautiful Soup scraper in Python. Steps performed -

  • Identified coures and pre-requisites and output the same as a CSV to local directory.
  • Histogram of courses by number of prerequisites
  • Pushed the local CSV as a SQL to AWS
  • Pulled the resultant SQL back to local directory.