- IG-DataAnalysis is a web scrapping tool combined with data analysis. It extracts useful information from public Instagram profiles, using Selenium, to analyse patterns and trends.
- Make sure that you have python3 installed on your computer.
- Open the application folder and install the required packages in requirements.txt with the following command
pip3 install -r requirements.txt
- The folder
src/d00_scrapper
possesses the web scrapping functionalities and amain.py
function with a recommendation of how the json containing the raw mined data could be saved. An example of raw mined data is available atdata/neymarjr-raw.json
. - The folder
src/d01_clean
is dedicated to process raw data into a proper format for the data analysis. Amain.py
function is available with a recommendation of how the json containing the processed data could be saved. An example of a processed data set is available atdata/neymarjr-clean.json
. - The data analysis is performed by the notebook at
notebooks/IGAnalyser.ipynb
.
- Data mined from
neymarjr
public Instagram page.