/TSECrawler

Primary LanguagePython

TSE Crawler

ETL pipeline to crawl, process and store the data from a specefic api.

Getting Started

Dependencies

  • libraries : requsts, pandas, psycopg2
  • stack : python, postgresql, docker

Installing

git pull https://github.com/AliZare76/TSECrawler.git

Executing program

pip install -r requirements.txt
python3 main.py

or :

docker compose up