TNS Observability Demo

A simple three-tier demo application, fully instrumented with Prometheus, OpenTracing and Go-kit logging.

The "TNS" name comes from "The New Stack", where the original demo code was used for an article.

Instructions

Build:

$ make

Run:

$ kubectl apply -f ./production/k8s-yamls

Monitoring with Prometheus

Requires tanka and a recent version of jsonnet-bundler:

$ GO111MODULE=on go get github.com/grafana/tanka/cmd/tk@v0.5.0
$ go get github.com/jsonnet-bundler/jsonnet-bundler/cmd/jb

$ mkdir tanka; cd tanka
$ tk init
$ tk env set environments/default --server=https://kubernetes.docker.internal:6443 # if you're using docker desktop.
$ jb install github.com/grafana/jsonnet-libs/prometheus-ksonnet
$ curl https://raw.githubusercontent.com/ksonnet/ksonnet-lib/master/ksonnet.beta.3/k8s.libsonnet > vendor/k8s.libsonnet
$ curl https://raw.githubusercontent.com/ksonnet/ksonnet-lib/master/ksonnet.beta.3/k.libsonnet > vendor/k.libsonnet

Update environments/default/main.jsonnet to be:

local prometheus = import "prometheus-ksonnet/prometheus-ksonnet.libsonnet";

prometheus {
  local service = $.core.v1.service,
  _config+:: {
    namespace: "default",
    cluster_name: "docker",
  },

  _images+:: {
    grafana: "grafana/grafana-dev:explore-trace-ui-demo-c8434d13350e0f43c3937ff37ce8932310ac7fd9-ubuntu",
  },

  prometheus_service+: $.prometheus {
    name: "prometheus",

    prometheus_container+::
        $.util.resourcesRequests('250m', '500Mi'),
  },

  // Expose the nginx admin frontend on port 30040 of the node.
  nginx_service+:
    service.mixin.spec.withType("NodePort") +
    service.mixin.spec.withPorts({
        nodePort: 30040,
        port: 8080,
        targetPort: 80,
    }),
}

Apply:

$ tk apply environments/default

Then go to http://localhost:30040/ to see the monitoring stack.

3b. Add dashboards for demo app

$ jb install https://github.com/grafana/tns/production/tns-mixin/

Update environments/default/main.jsonnet to be:

local prometheus = import "prometheus-ksonnet/prometheus-ksonnet.libsonnet";
local mixin = import "tns-mixin/mixin.libsonnet";

prometheus + mixin {
...

$ tk apply environments/default

Log Aggregation with Grafana Loki

$ helm init
$ helm repo add loki https://grafana.github.io/loki/charts
$ helm repo update
$ helm upgrade --install loki loki/loki-stack

Add a Loki datasource to Grafana, pointing at http://loki.default.svc.cluster.local:3100.

Install Jaeger

$ kubectl apply -f ./production/jaeger

(The app is already configured to send traces to jaeger.)

Setup The Trace Demo

Override the Grafana Image by adding the following to your main.jsonnet and run tk apply.

_images+:: {
  grafana: "grafana/grafana-dev:explore-trace-ui-demo-b56f2a8ae23d399f6e170f439c058f4bdb08f0da-ubuntu",
},

Add a Jaeger datasource:

URL: http://localhost:31686
Access: Browser

Navigate to the Loki datasource and add a derived field:

Name: traceID
Regex: traceID=(\w+)
URL: http://localhost:31686/trace/${__value.raw}?uiEmbed=v0
Internal Link: Jaeger

annanay25/tns

TNS Observability Demo

Instructions