deltajuliet/pi_kube_kluster

pi_kube_kluster

Initial installation steps:

Imaging

1. Download Raspbian Lite image.
2. Download and install balenaEtcher
3. Image SD card with Raspbian Lite

Initial headless configuration

1. Enable SSH (for Buster) touch /Volumes/boot/ssh
2. Configure WIFI vim /Volumes/boot/wpa_supplicant.conf Then add the following:

country=US # Your 2-digit country code
ctrl_interface=DIR=/var/run/wpa_supplicant GROUP=netdev
network={
    ssid="YOUR_NETWORK_NAME"
    psk="YOUR_PASSWORD"
    key_mgmt=WPA-PSK
}

3. Unmount SD card sudo diskutil unmount /Volumes/boot
4. Insert SD card in Pi and power up
5. SSH using pi:raspberry
6. Change default password
7. Install VIM sudo apt-get install vim
8. Change the hostname sudo vim /etc/hostname
9. Reboot
10. Setup DHCP reservation on router
11. Add host to local /etc/hosts file sudo vim /etc/hosts and change /etc/hosts sudo vim /etc/hosts:

192.168.1.70    pi-kube-master
192.168.1.71    pi-kube-node01
192.168.1.72    pi-kube-node02
192.168.1.73    pi-kube-node03

12. Copy local SSH key to pi ssh-copy-id [PI_HOSTNAME_OR_IP]

Setup k3s master node

1. Generate an ssh key ssh-keygen
2. Push key to other nodes ssh-copy-id pi@[NODE_HOSTNAME]
3. Setup CPU for containers vim and then add cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory to the end of the first line in /boot/cmdline.txt
4. Reboot
5. Install k3s curl -sfL https://get.k3s.io | sh -
6. Validate the server is up and running sudo systemctl status k3s
7. Copy the server token sudo cat /var/lib/rancher/k3s/server/node-token
8. Copy out the k3s.yaml file from /etc/rancher/k3s/k3s.yaml to your local system. Change the "server:" address from localhost to the remote clusters IP address and save into the .kube/config file

Setup other nodes

1. Setup CPU for containers vim and then add cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory to the end of the first line in /boot/cmdline.txt
2. Reboot
3. Setup environmental variables for k3s agent installation:

export K3S_URL="https://[MASTER_IP_ADDRESS]:6443"
export K3S_TOKEN="[MASTER_SERVER_TOKEN]"

4. Install k3s curl -sfL https://get.k3s.io | sh -

Validate installation

1. List out nodes sudo kubectl get node -o wide

Multi-interface quirks

1. Configure the eth0 interfaces with addresses referened above by using the /etc/dhcpcd.conf file to statically assign IP addresses based on fallback profiles.
2. Use the following install command for the k3s master node curl -sfL https://get.k3s.io | INSTALL_K3S_EXEC="server --advertise-address=192.168.1.70 --bind-address=192.168.1.70" sh -

Uninstall quirks

the k3s-uninstall.sh and k3s-agent-uninstall.sh commands don't completely clean up all left over files... use sudo rm -rf /etc/rancher/ /var/lib/rancher/ /run/k3s/ to completely clean up all of the files.

Dashboard Configuration

1. Pull down the latest recommended file for the web dashboard. Example wget https://raw.githubusercontent.com/kubernetes/dashboard/v2.0.0-rc5/aio/deploy/recommended.yaml
2. Change the image in the deployment to use the ARM image. Example: image: kubernetesui/dashboard:v2.0.0-rc5 to image: kubernetesui/dashboard-arm:v2.0.0-rc5
3. Apply the deployment kubectl apply -f recommended.yaml
4. Create a service account for accessing the dashboard kubectl create serviceaccount dashboard -n default
5. Create a role binding for the service account to the new role kubectl create clusterrolebinding dashboard-admin -n default --clusterrole=cluster-admin --serviceaccount=default:dashboard
6. Run the following to get the token for the new dashboard admin service account kubectl get secret $(kubectl get serviceaccount dashboard -o jsonpath="{.secrets[0].name}") -o jsonpath="{.data.token}" | base64 --decode
7. Run kubectl proxy to create a local proxy for the web ui
8. Login using the token obtained above.

References

-k3s Github Page -Pi Dramble -https://blog.alexellis.io/test-drive-k3s-on-raspberry-pi/