nginx-ot

nginx config with opentracing

Demo of nginx plus with the NGINX Plus OpenTracing module. These are all docker containers.

NGINX Plus

Start by building a CENTOS nginx-plus container named nginx-plus.

Docker setup

Create a docker network so hostnames work with the built-in docker DNS

     docker network create --subnet 10.10.220.0/24 TenNet

Running the containers

Run NGINX Plus containers for backend application and proxy.

     docker run -d --network TenNet --name upstream1 --hostname upstream1 nginx-plus
     docker run -d --network TenNet --name upstream2 --hostname upstream2 nginx-plus
     docker run -d -p 80:80 -p 443:443 -p 8080:8080 --network TenNet --name nginx-plus --hostname nginx-plus nginx-plus

Push the configurations to each of the containers

     docker cp hello/. upstream1:/etc/nginx/
     docker cp hello/. upstream2:/etc/nginx/
     docker exec -ti upstream1 rm /etc/nginx/conf.d/default.conf
     docker exec -ti upstream2 rm /etc/nginx/conf.d/default.conf
     docker cp nginx.conf nginx-plus:/etc/nginx/nginx.conf

Install OpenTracing Module

Install NGINX Plus OpenTracing module on N+ Containers

     docker exec -ti nginx-plus yum -y install nginx-plus-module-opentracing
     docker exec -ti upstream1 yum -y install nginx-plus-module-opentracing
     docker exec -ti upstream2 yum -y install nginx-plus-module-opentracing

Jaeger Install

run the jaegertracing/all-in-one:1.10 with the name jaeger

     docker run -d --network TenNet --name jaeger -p 16686:16686 jaegertracing/all-in-one:1.10

Push Jaeger plugin configurations

Copy and modify the jaeger.json to /etc/

     docker cp jaeger.json nginx-plus:/etc/jaeger.json
     docker cp jaeger.json upstream1:/etc/jaeger.json
     docker cp jaeger.json upstream2:/etc/jaeger.json
     docker exec -ti upstream1 sed -ie s/nginx/nginx-upstream/ /etc/jaeger.json
     docker exec -ti upstream2 sed -ie s/nginx/nginx-upstream/ /etc/jaeger.json

Add the C++ Jaeger plugin

Copy the lib64/ to /usr/local/lib64

     docker cp lib64/ nginx-plus:/usr/local/
     docker cp lib64/ upstream1:/usr/local/
     docker cp lib64/ upstream2:/usr/local/

Reload nginx

     docker exec -ti upstream1 nginx -s reload
     docker exec -ti upstream2 nginx -s reload
     docker exec -ti nginx-plus nginx -s reload

Load generation

Run some load against the load balancer

   ab -t 300 http://localhost/

Jaeger traces

Open browser and navigate to the docker host on port 16686

bgautrea/nginx-ot