0xcuriousapple/WebScraper

To scrape multiple web pages with Python using BeautifulSoup and requests.

WebScraper

To scrape multiple web pages with Python using BeautifulSoup and requests.

What are we Scrapping

We are scraping following details of a movie from the IMDB website.

• Name
• Year
• IMDB rating
• Meta score
• Votes

Third party Packages

• Python Requests : http://docs.python-requests.org/en/master/

  pip install requests
  

  Basically, it opens the webpage for us in this one.

• BeautifulSoup 4 : https://www.crummy.com/software/BeautifulSoup/bs4/doc/

  pip install beautifulsoup4
  

  This allows us to search & extract content from an HTML webpage

For reference:

• (More Depth) https://realpython.com/beautiful-soup-web-scraper-python/
• (Difference Between Crawling and Scrapping) https://blog.datahut.co/how-to-build-a-web-crawler-from-scratch/