conduit

A beatiful data pipeline implemented in golang that concurrently collects live transaction data for anything traded against bitcoin on Binance

To run locally

1. `cp config.env.template config.env`
2. insert env vars into `config.env`
3. Either 
	a) `make build` and `./bin/candles`
	b) `make docker-build` and `make docker-run`

Start writing to database

Docker 
	1. `docker exec -it <CONTAINER_NAME> /bin/sh`
	2. `touch start`
Local 
	1. `touch start` in root directory of repo

Send finish signal

Docker 
	1. `docker exec -it <CONTAINER_NAME> /bin/sh`
	2.  `touch finish` 
Local 
	1. `touch finish` in root directory of repo

Deployment

Before deploying to prod:

Ensure all unit tests pass
Ensure all integration tests pass
Create a temp ec2 and deploy to there and monitor the service

Follow these steps to deploy:

Ensure you're on master branch
Double check all of the above steps are complete and at least 2 other team members have reviewed the changes
Tag the branch via NEW_VERSION=<vx.x> make tag"
- This will create a git tag for the new version and update the version file
Push the tags via `git push origin ${NEW_VERSION}

Testing

Documentation

[https://volatrade.atlassian.net/wiki/spaces/SOF/pages/245202945/Conduit-Guidebook] Guide Book [https://volatrade.atlassian.net/wiki/spaces/SOF/pages/276660225/Conduit+Bug+Report+2020-12-09] Bug Report 12/09/2020