Environment Setup

  1. Clone repository
$ git clone https://github.com/abdellatifLabr/ftx-data-scraper
  1. Install dependencies
  2. Install redis
  3. Install postgresql (create database with name ftx)
  4. Install pipenv
$ pip install pipenv
  1. Set up environment
$ pipenv --three
  1. Install packages
$ pipenv install --dev
  1. Configure th database set database settings in ftx_data_scraper/.env as postgres://<username>:<password>@localhost/<database_name>.
  2. Migrate
  3. Create .env file similar to .example.env
$ python manage.py migrate
  1. Start redis server (redis-server command)
  2. Start project server
$ daphne ftx_data_scraper.asgi:application
  1. Start celery worker
$ celery worker -A ftx_data_scraper -l INFO
  1. Start celery beat
$ celery beat -A ftx_data_scraper -l INFO --scheduler django_celery_beat.schedulers:DatabaseScheduler