thomascayne/beautifulsoup-tutorial

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

BeautifulSoup Web Scraping Tutorial

A beginner's tutorial to scraping websites using Python's BeautifulSoup library. This repository is the source code for the tutorial found here: https://hackersandslackers.com/scraping-urls-with-beautifulsoup/

Installation

Installation via requirements.txt:

$ git clone https://github.com/hackersandslackers/beautifulsoup-tutorial.git
$ cd beautifulsoup-tutorial
$ python3 -m venv myenv
$ source myenv/bin/activate
$ pip3 install -r requirements.txt
$ python3 main.py

Installation via Pipenv:

$ git clone https://github.com/hackersandslackers/beautifulsoup-tutorial.git
$ cd beautifulsoup-tutorial
$ pipenv shell
$ pipenv update
$ python3 main.py

Installation via Poetry:

$ git clone https://github.com/hackersandslackers/beautifulsoup-tutorial.git
$ cd beautifulsoup-tutorial
$ poetry shell
$ poetry update
$ poetry run

How to Use

This script will output metadata scraped from whichever URL is specified in config.py. Simply change the value of this variable to test the script against any URL of your choice.

---

Hackers and Slackers tutorials are free of charge. If you found this tutorial helpful, a small donation would be greatly appreciated to keep us in business. All proceeds go towards coffee, and all coffee goes towards more content.