Instagram Profile Scraper

Scrape and analyze Instagram profiles to show relevant data in the UI.

Overview:

API: provide an endpoint to scrape and analyze profiles from Instagram.
- detect popular #hashtags and @mentions from post.
- detect and analyze brand affinity and interests from post descriptions and post images using NLP and ML service.
- calculate engagement and engagement rate.
UI: list all the viewable profiles that are scraped and show the details of the individual profile.

Used node.js, nestJS, typescript, typeorm, MySql, docker-compose & eslint for back-end API. And vue.js, vuex, bootstrap, SCSS, docker-compose, eslint & prettier for UI. Also used Google Vision API for parsing text from image and NL API for natural language processing.

Setup:

Please clone this repo:

git clone https://github.com/nazmulb/instagram-profile-scraper.git

Please change directory to this project:

cd instagram-profile-scraper

Please set the environment variable API_KEY_GCP from docker-compose.yml file.

Run the App:

docker-compose up

Open your browser and use the below URL:

http://localhost:8080/