Board Game Geek Scraper
This script takes a category from Board Game Geek and posts the contents to Pinterest.
You will need
- Python 2.7x
- Requests and Beautiful Soup installed (if you don't have this installed we will later)
- A Pinterest account registered as a developer
- A Pinterest access token with read public and write public permissions
- A public Pinterest board to upload content too - make a note of the URL
Instructions
- Download and unzip this repository
- Open a terminal window and change to the directory with this repository. Example:
cd ~/Downloads/BGG-Scraper/- If you don't have Requests and Beautiful Soup already installed, we can do that now:
sudo pip install -r requirements.txt- Update the scraper.py script with your Pinterest access token. Look for the line:
"access_token": "Put your token in these quote marks",- Still in the script, update the category ID with the one you want to scrape. Its the number in the URL. Look for the line:
category_id = 1055- Nearly there. Now you need the last part of the URL of your Pinterest board. So one of mine is: https://www.pinterest.com/thisisthechris/test/ - I just need the last bit - "thisisthechris/test". Now look for the line to update:
board_name = "the name goes in these quote marks"- Save the file!
- Run it! In your terminal:
python scraper.py- Keep an eye on it initially. There will be a pause while the list of games is downloaded, then you should start seeing the names of the board games appearing.
- Go to your Pinterest board - the games are showing up! It's exciting!
- Keep your computer on and go and have a cup of tea. It'll take a little while to go through all the games.
- Come back, check that the script reached the end of the list. You might need to tweak some of the parameters if there are more than 1k games in the category.
- You're done. :)