instagram-scrapper
Node project to collect Profiles, Posts and Likes, Comments, Follows, Following stats from Instagram profiles without sign-up to their API and without user consent.
Is there a live example?
You can go to http://iscrapper.herokuapp.com/ and register profiles, but please delete them later because this database is limited. There is also an API to export the collected data at: http://iscrapper.herokuapp.com/api-docs
About the app
Actually, there are two separated apps. The Client which serves the FrontEnd (using React), and the Backend (in Node/Express/Mongo).
How to run the Backend
- Navigate to the
backend
directory. - Change the
.env
file to your desired configuration. - Open a terminal.
- Run
npm install
to install all dependencies. - Run
npm start
to start the app.
How to run the Client
- Navigate to the
client
directory. - Change the
.env
file to your desired configuration. - Open a terminal.
- Run
npm install
to install all dependencies. - Run
npm start
to start the app.
Check if they are connected
- With the two apps running, open your browser in http://localhost:3000/.
- Open chrome dev tools to check for backend logs.
- Enjoy!
To build the project for deployment
- Navigate to the
client
directory. - Open a terminal.
- Run
npm run build
to build the client project. - Copy the contents of the
client/build
folder tobackend/app/public
- Deploy the contents of the
backend
folder to your server. (I'm using Heroku and mLab)
Backend .env configuration fields
APPLICATION_INSIGHTS_KEY # Azure application insights instrumentation key
MONGODB_URI # mongodb://<user>:<password>@<server and options>
MONGODB_DBNAME # Database name
MONGODB_CREATE # This option when is true will create all collections and indexes
MAX_PROFILES # How many profiles will be scrapped at the same time
MAX_DOWNLOADS # How many posts download will be placed at the same time
ISCRAPPER_READONLY # This will disable delete and creation of profiles on your instance
ENVIRONMENT # Outputs logs to console when in DEV
Client .env configuration fields
REACT_APP_BACKEND_URL # Backend address
REACT_APP_APPLICATION_INSIGHTS_KEY # Azure application insights instrumentation key
Donations
Please consider donating some if your app is successful or you learned something valuable here.
Keep in mind that I am maintaining this repository on my free time so thank you for considering a donation. 👍