MansM/vagrant-kubernetes

Kubernetes setup

Usage:

review settings in ansible/host_vars && Vagrantfile

vagrant up

usefull commands

show etcd member list

docker exec -i `docker ps -q --filter label=io.kubernetes.container.name=etcd` etcdctl --endpoints=https://172.16.50.11:2379 --ca-file=/etc/kubernetes/ssl/ca.pem member list

show kubernetes component statuses

docker run --rm -it -v /etc/kubernetes/ssl:/etc/kubernetes/ssl:ro manager1:5000/gcr.io/google_containers/hyperkube-amd64:v1.5.3 /hyperkube kubectl --server https://172.16.50.11 --certificate-authority=/etc/kubernetes/ssl/ca.pem --client-certificate=/etc/kubernetes/ssl/host-manager1.pem --client-key=/etc/kubernetes/ssl/host-manager1-key.pem get componentstatuses

kubectl create -f /mount/whatever.yaml

docker run --rm -it -v /etc/kubernetes/ssl:/etc/kubernetes/ssl:ro -v ${PWD}:/mount manager1:5000/gcr.io/google_containers/hyperkube-amd64:v1.5.2 /hyperkube kubectl --server https://172.16.50.11 --certificate-authority=/etc/kubernetes/ssl/ca.pem --client-certificate=/etc/kubernetes/ssl/host-manager1.pem --client-key=/etc/kubernetes/ssl/host-manager1-key.pem create -f /mount/canal.yaml

when kubedns has issues with credentials:

kubectl delete -f /mount/kube-dns.yaml && kubectl delete -f /mount/kube-dns-deployment.yaml

- grab coffee - 

kubectl -n kube-system get secrets |tail -1 |awk {'print $1'}|xargs docker run --rm -t -v /root:/mount -v /etc/kubernetes/ssl:/etc/kubernetes/ssl:ro manager1:5000/gcr.io/google_containers/hyperkube-amd64:v1.5.2 /hyperkube kubectl --server https://172.16.50.11:443 --certificate-authority=/etc/kubernetes/ssl/ca.pem --client-certificate=/etc/kubernetes/ssl//host-manager1.pem --client-key=/etc/kubernetes/ssl/host-manager1-key.pem  -n kube-system delete secret && kubectl create -f /mount/kube-dns.yaml && kubectl create -f /mount/kube-dns-deployment.yaml

Todo:

• Implement ServiceAccounts for nginx ingress controller
• Add some addons like logging (fluentd, etc)
• Metrics with node exporter and prometheus (https://coreos.com/blog/prometheus-and-kubernetes-up-and-running.html)

Issues:

• Nginx (and other) ingress controller doesnt work with cni: kubernetes/kubernetes#23920
• vagrant & real world use different NIC's
• Using more then 2 manager nodes, requires you to start with 2 and add one by one

usefull stuff

• [https://storage.googleapis.com/kubernetes-release/release/stable.txt](kubernetes version number)
• [https://github.com/kelseyhightower/kubernetes-the-hard-way](Kubernetes the hard way by Kelsey Hightower)
• [https://coreos.com/kubernetes/docs/latest/](coreos install)
• [https://github.com/coreos/etcd/blob/master/Documentation/op-guide/configuration.md](etcd vars)