Backend side app: https://github.com/DenisLebedinsky/crawler-client
Youtube crawler is an app for CRUD data from Youtube.com to database
Deployed on Heroku: https://scrapy-youtube.herokuapp.com/
Client: https://crawler-client.herokuapp.com/
To get a local copy up and running follow steps below.
You need to install the following:
pip 19.0.2
Python 3.7.3
MongoDB
- Clone the repo
git clone https://github.com/DenisLebedinsky/crawler-server.git
- Install pip packages
pip3 install -r requirements.txt
- Set env
VIRTUAL_ENV = <production>|<development>|<test>
HOST = <your host>
PORT = <your port>
MONGODB_URI = <URI MongoDB>
Run client ([https://github.com/DenisLebedinsky/Astroscreen]) and it will communicate with this app
Denis Lebedinsky - denis.lebedinsky@intspirit.com