Covidify a very stupid and insecure restaurant registration service

This app is meant as a end-to-end example on DC/OS using multiple stateful packages, edgelb, marathon and metronome.

Its currently in an early development state and is not yet ready to use.

Goals

Main goal of this project is to simulate an end-user app which receives data and shares and stores the data in multiple layers of states ( Cassandra, Kafka ). Also Edgelb should redirect the traffic path based to multiple instances of the app to separate the load of the application.

User simulation

To simulate the user behaviour a visit generator based on locust and boom is generating requests.

Monitoring

The app and the generator should expose their metrics via Prometheus Endpoint config so dcos-monitoring will be able to receive the metrics

API

See API Docs

DC/OS

Run a 3 node cassandra cluster

Get node0 task ID

dcos task list testing.covidify.cassandra__node-0 --json | jq -r '.[0].id'

Get shell on node0

dcos task exec --tty --interactive testing.covidify.cassandra__node-2-server__40d24407-7d53-4acc-bc6c-82d70cda14a8 "/bin/sh"

Exec cql

dcos cassandra --name "testing/covidify/cassandra" endpoints native-client | jq -r '.dns | map(split(":")[0])[0]'

apache-cassandra-*/bin/cqlsh <nodelist>

Now place the content of model.csql

Marathon app

Get the list of DNS names:

dcos cassandra --name "testing/covidify/cassandra" endpoints native-client | jq -r '.dns | map(split(":")[0]) | join(",")'

{
  "env": {
    "COVIDIFY_CASSANDRA": "node-0-server.testingcovidifycassandra.autoip.dcos.thisdcos.directory,node-1-server.testingcovidifycassandra.autoip.dcos.thisdcos.directory,node-2-server.testingcovidifycassandra.autoip.dcos.thisdcos.directory"
  },
  "id": "/testing/covidify/api",
  "instances": 1,
  "portDefinitions": [],
  "container": {
    "type": "MESOS",
    "volumes": [],
    "docker": {
      "image": "fatz/covidify",
      "forcePullImage": false,
      "parameters": []
    }
  },
  "cpus": 0.1,
  "mem": 256,
  "requirePorts": false,
  "networks": [],
  "healthChecks": [],
  "fetch": [],
  "constraints": []
}

EdgeLB pool

dcos edgelb create pool.json

{
  "apiVersion": "V2",
  "name": "http",
  "count": 1,
  "haproxy": {
    "frontends": [{
      "bindPort": 80,
      "protocol": "HTTP",
      "linkBackend": {
        "map": [{
          "hostEq": "covidify.dcos.d2iq.com",
          "backend": "covidifyapi"
        }]
      }
    }],
    "backends": [{
      "name": "covidifyapi",
      "protocol": "HTTP",
      "services": [{
        "marathon": {
          "serviceID": "/testing/covidify/api"
        },
        "endpoint": {
          "portName": "http"
        }
      }]
    }]
  }
}

curl -H "Host: covidify.dcos.d2iq.com" -X POST "http:///visit" -H "accept: /" -H "Content-Type: application/json" -d "{"id":"d290f1ee-6c54-4b01-90e6-d701748f0851","table_number":"outside-1","visitors":[{"name":"John Doe","email":"john.doe@googlemail.com","phone":"+49-30-123456789","country":"DEU","city":"Berlin","zip_code":"11011","street":"Platz der Republik 1"}],"risk":{"risk":"low","description":"string"}}"

kubernetes

Start cassandra

Using cass operator on konvoy

K8S_VER=1.18 kubectl apply -f https://raw.githubusercontent.com/datastax/cass-operator/v1.4.1/docs/user/cass-operator-manifests-$K8S_VER.yaml
kubectl -n cass-operator apply -f deployments/dkp/cassandra.yml

Watch for ready state

Apply csql

CASS_PASS=$(kubectl -n cass-operator get secret cluster1-superuser -o json | jq -r '.data.password' | base64 --decode)
CASS_USER=$(kubectl -n cass-operator get secret cluster1-superuser -o json | jq -r '.data.username' | base64 --decode)
kubectl -n cass-operator exec -ti cluster1-dc1-default-sts-0 -c cassandra -- sh -c "cqlsh -u '$CASS_USER' -p '$CASS_PASS'"

paste model.csql

Create namespace:

kubectl create namespace covidify

Create a secret with Cassandra credentials:

kubectl create secret generic cassandra-credentials -n covidify --from-literal=COVIDIFY_USERNAME=$(kubectl -n cass-operator get secret cluster1-superuser -o json | jq -r '.data.username' | base64 --decode) --from-literal=COVIDIFY_PASSWORD=$(kubectl -n cass-operator get secret cluster1-superuser -o json | jq -r '.data.password' | base64 --decode)

Start app, service and ingress

kubectl apply -n covidify -f deployments/dkp/api.yml

jhgaylor/covidify