Ruuvi-collector on Raspberry Pi with InfluxDB + Grafana in AWS

This repository contains instructions and a Terraform project for setting up a Raspberry Pi with Ruuvi-collector that transmits data to an InfluxDb in AWS. Grafana is set up as the UI for viewing the RuuviTag data.

The Raspberry Pi part

These are mainly notes to self on how to set up the Raspberry Pi to have all needed software and settings and the ruuvi-collector software running. My older version of the Raspberry Pi (Model B Rev 2 that doesn't have wifi nor Bluetooth) requires some additional setup for my dongles to work. This might not be necessary depending on your version of the Pi.

Setup Raspbian

Download Raspbian Lite
Flash it onto an SD card with Etcher
Re-insert card (into Mac, will make it mount the boot partition)
Set up headless SSH access
- cd /Volumes/boot
- touch ssh
- Create wpa_supplicant.conf from this template, change it to match your environment
Insert card into Raspberry Pi, boot
Check IP with arp -a from OS X or use raspberrypi.local
Connect
- ssh pi@raspberrypi.local
To add and switch between wifi networks on the RPi
- Add network to /etc/wpa_supplicant/wpa_supplicant.conf
- wpa_cli reconfigure
- sudo iwconfig wlan0 essid FrediPhone key s:password
- sudo iwconfig wlan0 essid ManegenS key s:password
- sudo iwconfig wlan0 essid Skedo key s:password
Check wifi connection with iwconfig
Check wifi signal with cat /proc/net/wireless

This wasn't enough for me, I had to setup the wifi dongle using Ethernet connection before being able to connect over wifi

Set the timezone using sudo raspi-config > Localisation Options > Change Timezone > [Select timezone]
Install driver for the wifi dongle
- ssh pi@raspberrypi.local over Ethernet (you can connect the Pi straight to your Mac if you enable Internet sharing in the System Preferences)
- wget https://gist.github.com/bostrom/da1e6d26fba47aa3144a02f09c635531/raw/7e04bd3dd4d76eb21eca9f602247d757b89648da/RPi-install-wifi.sh
- sudo mv RPi-install-wifi.sh /usr/bin/install-wifi
- chmod 755 /usr/bin/install-wifi
- sudo install-wifi
- sudo reboot

Install Ruuvi Collector

ssh pi@raspberrypi.local
sudo apt update
sudp apt full-upgrade
Note: if the linux kernel was upgraded in the above process, you might need to re-install the wifi driver with sudo install-wifi if you had to install it manually earlier (see above)
sudo apt install -y git bluez bluez-hcidump maven
Install a JDK (Java Development Kit). For newer Pi's and Raspbians it might be sudo apt install openjdk-11-jdk-headless. For older ones, you might have to select an older JDK, e.g. openjdk-8-jdk-headless. If your /etc/alternatives/java is a different version than the JDK you're installing, then uninstall the other JRE with sudo apt remove openjdk-11-jre-headless (or whatever version is installed).
sudo setcap 'cap_net_raw,cap_net_admin+eip' `which hcitool`
sudo setcap 'cap_net_raw,cap_net_admin+eip' `which hcidump`
git clone https://github.com/Scrin/RuuviCollector.git
cd RuuviCollector
mvn clean package
Edit ruuvi-collector.properties and ruuvi-names.properties, modify to match your needs
Create /etc/systemd/system/ruuvi-collector.service from this template
sudo systemctl enable ruuvi-collector.service
sudo systemctl start ruuvi-collector.service
sudo systemctl status ruuvi-collector.service

Backup your Raspberry SD card

In case (or rather, when) the SD card dies or gets corrupted you don't need to go through the whole process above if you make an image of the SD card using these instruction.

Then, when you need to re-flash your SD card just use your custom image.

The AWS part

The AWS setup is managed with Terraform. The scripts take care of everything including provisioning the Grafana datasources and dashboards.

The setup includes:

Elastic Load Balancer accepting requests from the Internet over HTTPS
An EC2 instance running InfluxDb and Grafana
Security Groups for controlling open ports to ELB and EC2 instance
An EBS volume for persisting InfluxDb data
An SSL certificate for your domain, so you can access Grafana over HTTPS on your own subdomain (DNS not included)

Setup

Enter aws dir
- cd aws
Install aws-cli
- brew install awscli
Install terraform
- brew install terraform
Configure aws-cli
- Create a key pair in your AWS console for your user
- aws configure
Setup Terraform variables
- cp secrets.auto.tfvars.example secrets.auto.tfvars
- Modify terraform.tfvars and secrets.auto.tfvars to match your needs
- Modify main.tf and backend.tf to match your needs, if needed
Optionally set up an S3 backend for Terraform.
- If omitted, remove backend.tf
Run
- terraform init
- terraform plan
- terraform apply

This might hang on the SSL Certificate creation since it waits for it to become verified. To continue, add the verification records to your DNS and wait for the certificate to become verified (see below, and check the AWS console for this). Then re-run terraform apply.

The Terraform outputs the EC2 instance's IP address (for SSH connections) and the ELB domain name where Grafana will be accessible (and InfluxDb on port 8086).

The DNS part

I'm using my own domain name configured in Namecheap, so to get the custom domain name working, I had to do this in the Namecheap admin panel:

Add a CNAME to the DNS configuration for verifying the AWS certificate (instructions in the AWS console when Terraform has created it)
Add a CNAME which points to the ELB DNS name for the chosen subdomain (displayed as output from the Terraform script)

bostrom/ruuvi-on-aws