/CryptoBigData

Final project for the "Big Data Processing" course.

Primary LanguagePython

TODO

  1. Fix batch processing
  2. Make cassandra
  3. Make batch processing job start automatically
  4. Implement all required batch precomputations
  5. Implement all endpoints in fastapi-app

Docs

Configuration

Configure currencies you want to track in websocket-client/config.json file:

{
    "currencies": ["XBTUSD", "ETHUSD", "LTCUSD"]
}

Deployment

1 Launch the application

docker-compose up --build -d
  1. Run sh run-compose-and-cassandra.sh to run compose and to create keyspace and tables. It will wait for cassandra to initialize.

Debug

1 Launch admin console

./admin-tools/start.sh