/Stock-Scrapper

Scrapping NSE website and storing data into django model and eventually building a website

Primary LanguagePython

Stock-Scrapper Django Scrapy

Scrapping NSE website data and storing data into our database and serving in our a website

Prerequisites

Python3, virtualenv en pip installed on your system. NSE - Google Chrome 18-06-2021 12_50_04

NSE - Google Chrome 18-06-2021 12_50_13 Architecture 0_26rEcLHEhdXBwZE2 NSE - Google Chrome 18-06-2021 12_50_26

NSE - Google Chrome 18-06-2021 12_50_32 Scrapper crawller py - internship - Visual Studio Code 18-06-2021 12_34_54

How to run it?

  1. Download zip fie
  2. Go to the folder with cd Stock-Scrapper-main
  3. Create 'python -m venv env' and Activate the virtualenv: .env\Scripts\activate
  4. Download required files use pip install -r requirements.txt
  5. Now run your server with cd NSEscrapper_app -> python ./manage.py runserver
  6. Website running on localhost, port 8000.

How to scrape new data ?

  1. Go to the "spider" folder inside 'scrapper' and run scrapy runspider crawller.py
  2. New Model is updated.
  3. Now run your server inside NSEscrapper_app with python ./manage.py runserver