Web scraping Warframe weapons from fandom.com Warframe wiki

Web scraping the warframe.fandom.com website to create a dataset of all the weapons in Warframe.

Warframe

Warframe is my favorite game. I wanted to make a dataset about it's weapons since it has so many nowadays (632).

Warframe wiki

warframe.wiki is a website that features the entire weapon roster of Warframe.
For each weapon this website features some data about different aspects and attributes such as damage, fire rate, magazine size and others.

Tools

To extract the data I used the Python programming language as well as some of its modules.

For requests I used the Requests module.
For the web scraping I used the Beautiful Soup module
To save the data I used a json file.

Data

All weapons share some basic attributes while other attributes are unique to the weapon type.
Aside from that, Warframe has several weapons with special attacks that are unique to that weapon. Consequently, a csv format is not best suited for this kind of data.
However, the weapons' attributes are grouped up in different sections of the info card on the website. This gave me the idea to organize the data in a json format.
Each weapon's name is the key and the value is made up of the weapon's attributes, json formatted by the section they belong to.

More weapons?

No. I made this dataset for my own enjoyment but I am not invested in maintaining it up to date.
If you want to get an up to date version of the dataset, feel free to use my code to create it yourself. I would be happy if you did.
This dataset is up to date as of 4/10/2021. Warframe Update 29.10.10.
I used Python 3.9.1 and bs4 0.0.1.