WeatherCube

This repo provides code and schematics for the WeatherCube, an environmental monitoring platform used for the Baltimore OpenAir project. More info is on our project page at baltimoreopenair.github.io

Hardware

Circuit Boards

Component list:

1- The main board: It supports the microcontrollers. Its the brain of the device

2- Charging controller: provides power to the main board, charge up the battery with the solar panel

3- Lithium polymer battery: holds the power for the device

4- Analog front end board: holds the air quality sensors

5- Coin CR battery: powers the clock in case of loss of power

6- temperature sensor board: measures temperature and humidity in the tunnel

7- solar pannel: powers the unit

8- 4x air quality sensor: for N02,03,SO2 and H2S

9- 3X Molex picoblade cable assembly (2X 4 pins and 1X 5 pins): connects boards together

10- FTDI ttl/usb controller: allows to load code

11- ttl/usb ESP adapter: allows to connect the FTDI controller to load code in the ESP wifi chip

12- ttl/usb ATMEGA adapter: allows to connect the FTDI controller to load code in the ATMEGA microcontroller

Electronic Assembly:

Necessary equipment

1- Soldering iron

2- snips

3- box cutter

4- lead free rosin core solder of small gauge

5- a breadboard to serve as jig

6- A good multimeter for quality check

7- tweezers

9- a brush (such as a toothbrush)

10- methanol or rubbing alcohol

Solder male header pins onto the main sensor board

Use male 2.54mm (1/10th in) pitch headers. The headers come in 40 pins assembly, and will need to be sniped to the correct size. for this board you need 3x 7pins, 2x 2pins and 1x 1pin headers. You can use the ttl/usb adapter and/or a breadboard as jig to hold the pins in place at a right angle from the board. the pins should protrude in the front of the board and be soldered from the back. The positions of the headers are marked by yellow cirlces in the following image.

Solder female header pins onto the Analog Front End (AFE) board

Use female 2mm pitch 2pin headers. You will need 12x 2pin headers. The pins should protrude from the front of the board and be soldered from the back. You can make a jig with 2mm male headers on a unassembled AFE PCB in order to correctly align the female headers. The pins should be scrubed with high proof methanol or other alcohol after soldering to avoid sensor bias. Resistance should be in excess of 40M Ohm between the reference and control electrode when the sensor is not mounted. The positions of the headers are marked by yellow cirlces in the following image.

Solder the main sensor board to the solar charging board

The main board is to be soldered with the wires coming from the charge controller. If the battery is already soldered to the charge controller, you will be soldering live wires if the black and white wire connect. This does not constitute a danger of electrocution due to the low DC voltage but may lead to burining the charge controller if the board is shorted, and is a risk of fire. Therefore, extreme caution is necessary. The recommended order for soldering is red wire (5v) then the white wire ( enable wire). At this point, it is important to check that the red and white wires do not connect in any way, and trimming the wire ends may be a good idea. You can then solder the black wire (ground). Be careful not to short the circuit accidentally with the tip of your soldering iron. This closes the circuit. The positions of the wires are marked in the following image.

Solder the usb/ttl adapters

The usb/ttl adapter need both male and female headers of 2.54mm pitch. The male headers are suposed to be protruding on the front of both boards and the female headers on the back. You may use a soldered main board as a jig to gold the female headers in place. To snip the female headers to the correct size, first count the numbers of pins you need and pull the next pin. You can then cut the header to sizer with a box cutter and shave the plastic for esthetics. The following image displat the positions of the male headers (yellow circles) and female headers (purple circles). For this, you need 2X 6pin male headers and 4X 7pin female headers. for the female headerds of the usb/ttl ESP adapter, you will need to pull some of the pins to fit in the soldering holes.

Plug things together

Follow the following figures to connect the differents component together. Do not forget to place the enable jumper on the main board once the code is loaded in

Sensors

Read the calibration codes off the sensor QR codes using any QR code reader. Save these codes for later calibration. Then, plug in the sensors clockwise from the top left in the following order: O3, H2S, SO2, and NO2.

Code loading

The software section describes the code that need to be loaded for the project. Here we describe the hardware setup necessary to communicate with the assembled device.

1- take the jumper off the enable pin on the main board.

2- connect the usb/ttl adapters on the wifi chip and on the atmega adapter.

3- make sure the FTDI controller jumper is on 3.3V

4- connect the FTDI controller with the usb cable to the computer. make sure that the ftdi controller has the proper driver installed. This can be done on windows by running this executable.

5- connect the ftdi controller on the esp adapter.

6- Using Arduino IDE, select the right com port and select the generic esp8266 in the tool section and load the esp8266 code. Make sure to modify the code with the target wifi credentials.

7- disconnect the FTDI controller and connect it to the atmega adapter. Using Arduino IDE, select the right com port and the arduino UNO board, load the code. You may have trouble to establish connections with the atmega when loading a code more than once. Restarting the computer seem to help in that case.

8- disconnect the adapters and put back the enable jumper. your weathercube is ready to be deployed!

Hardware Quality checks

Using a multimeter one can check all the parameters of the device to check if all the component are working nominaly.

1- Check battery power: on the charge controller board, check the voltage potential at the soldered battery wires. The voltage should be between 2.8v and 4.2V. If close to 0V, check the battery wiring connections. If higher that 0.5V but lower than 2.8V, the battery is probably damaged. If higher than 4.2V the charge controller is damaged. If higher than 2.8V but lower than 3.3V, you should connect and charge the battery before usage using the mini usb port until reaching 4.2V.

2- Solar panel check: on the charge controller board, measure the voltage between the two wires of the solar panel. This should read between 4.1 and 4.4 V when the panel is exposed to direct sunlight. If the voltage is very low, there must be a problem in the wire connection on the solar panel. It the voltage is higher, the solar panel is runing in an open circuit, which means that either the battery is full, or if it is not, that the charge controller is damaged ore the solar panel wire connection on the charge controller is not good.

3- battery charge tester on the charge controller: click on the push button on the charge controller. If the charge controller leds do not light up and the battery voltage is superior to 2.8V this means that the charge controller is damaged.

4- main board power: check the voltage between the red and black wire of the charge controller on the main board. This should read close to 5V. if not the charge controller is damaged, or the connection of the white and black wire is not good. you can then check the volatege between vcc and ground on the board. it should read 3.3v when the enable pin is jumped and 0v else. If it reads 0V when the enable pin is in, the charge board is damaged or the connection is not good. if th reads 3.3V weither or not the jumper is on the enable pin, it means that the enable pin is shorted: check for solder residues that may short the two pins.

5- AFE board checks: the resistance between the 2mm pitch pins should be checked with a good multimeter (measurs resistance up to 40Mohm at least such as this). Off the trio of headers for each sensor, the top one should have a resistance higher than 40Mohm when the sesor is not pluged in while the other should display no resistance. a 40Mohm reistance would bias the result by about 20ppb, which is the resolution of the sensor we are using. If the resistance is lower than that, pluck the plastic part of the pin and clean thourouly the plastic part and the pins with methanol. reassemble when dry and check again.

6- Fan check: in normal operation the fan should be runing every 15minutes for 30 seconds. If the fan does not run, you may try to run the fan by applying a 5v potential between its ground and live wires. Make sure you respect polarity. if the fan does not spin, it might be jammed. To unjam the fan, disasemble the air tunnel and manually check for fan rotation. take out any obstruction and check for rotation again. replace fan if need be.

7- Charging operation: check the battery volatage and note it up to 4 significant numbers. Put the weathercube in full sun for few hours. Without the main board unabled the unit should charge the battery at about .05V to .2V per hour in full unobstructed sun. The unit should still charge between .04V to .15V per hours when the unit is in operation. If not, the whole power circuit (solar panel, charging board and battery) might have to be recheched or replaced.

8- Com operation: when the cube is deployed in normal operation, you should recieve wifi communication once every day or as specified. if not, you may want to check first power then wifi communication credential in that unit.

Software

Arduino Installation

Step zero is to install Arduino. Note that in Linux, you may need need to launch Arduino using sudo priveleges.

1. Add the ESP8266 board to Arduino.

Follow: https://learn.sparkfun.com/tutorials/esp8266-thing-hookup-guide/installing-the-esp8266-arduino-addon

2. Verify that you have the following libraries. If not, in Arduino, click Sketch--> Include Library --> Manage Libraries and search for the following libraries. When you find the library, click on it and an install button should appear. Click on this button to install.

  • Statistic
  • SoftwareSerial
  • Wire
  • Adafruit_ADS1015
  • EEPROM
  • ESP8266WiFi

3. Download the following libraries for the Arduino Uno and save to your default Arduino library path (~/Arduino/libraries/):

4. Download the following files/libraries for the ESP8266 :

Download and move the following files into the AWSArduinoSDK directory you just created:

AWS setup

These instructions are courtesy Daniele Salvagni at https://github.com/daniele-salvagni/aws-sdk-esp8266/

1. Create an AWS account

Create an account at https://aws.amazon.com/. Note this requires a credit card but it's possible to be on AWS' free tier. You may also qualify for educational credits. Follow along steps 1 and 2 using the instructions in http://ncar.github.io/chords/aws.html .

Then, create a user in the IAM managment console: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_users_create.html#id_users_create_console Get your awsKeyID and awsSecKey in the last step by going to IAM--> Users--> Security credentials. .

2. Set up the DynamoDB Table

You will need to set up a DynamoDB table with the same name, hash key, and range key as in the sample you are using. These values are defined as constants in the sample, i.e. HASH_KEY_NAME and TABLE_NAME.

You can follow the steps below to get the tables set up with the right values:

  • Log into the AWS Console and navigate to DynamoDB.
  • Click on the "Create Table" button.
  • Enter ESP8266AWSDemo as the Table Name, id as the primary Partition Key, and timest as the primary Sort Key. Be sure to mark id as String and timest as Number.
  • Just one Read Capacity Unit and one Write Capacity Unit will be more than enough for this demo. Press create with these values.
  • After the table has finished creating you are good to go, your ESP will take care about populating it.

3. Creating keys.h and keys.cpp

You will need to create and add keys.h and keys.cpp into the AWSArduinoSDK directory you made. Alternatively, if you want to use different access keys for every sketch you make, just put them inside your current sketch folder. These files define the awsKeyID and awsSecKey values used by the sketch, the files may be structured as following:

// keys.h
#ifndef KEYS_H_
#define KEYS_H_

extern const char* awsKeyID;  // Declare these variables to
extern const char* awsSecKey; // be accessible by the sketch
extern const char* pSSID; 
extern const char* pPassword; 
extern const char* SERIAL_ID;

#endif
// keys.cpp
#include "keys.h"

const char* awsKeyID = "YOUR AWS KEY ID HERE";
const char* awsSecKey = "YOUR AWS SECRET KEY HERE";
extern const char* pSSID = "YOUR WIFI NETWORK NAME HERE"; 
extern const char* pPassword = "YOUR PASSWORD HERE"; 
extern const char* SERIAL_ID = "ID NUMBER HERE";

Do not share your AWS keys with anyone, it is reccomended to create a dedicated user with restricted permissions, do not use your root account. If you accidentally push your keys online disable them immediatly from the AWS IAM console

Programming

1. Bootload the boards using Atmel studio (if we've given you boards, we've already done this for you)

2. Load the Blink example sketch onto the ATMega selecting Arduino Uno as the board

For this step, you could use any sketch onto the ATMega that doesn't tie up the serial lines, such as reset_esp.ino.

3. Edit the keys.h file from AWS setup step 3

4. Load esp_main sketch onto the ESP8266

4. Load wxcube_main sketch onto the ATMega using the Uno settings

Data

Data access through AWS Console

To view your data, log in to the AWS Console and navigate to DynamoDB. Click on "Tables" in the left hand menu, select your table and click on "Items". To download your table, first create a filter by selecting "filter". You can select for ids or for time. Note that ids are strings and time is a number such as '20170908000015'. Click start search. When the search is complete, click "Actions" and select "Download as CSV".

Command line/Python data access

Install and configure Boto3 in Python following the documentation.

The following sample code can be used to retrieve one sensor's data and turn it into a Pandas dataframe with a 'datetime' index.

import pandas as pd
import boto3
from boto3.dynamodb.conditions import Key, Attr
dynamodb = boto3.resource('dynamodb')
table = dynamodb.Table('BaltimoreOpenAir2017')
sel_id = 1 # change this to the sensor id you are querying 
# the following will pull any data after September 8, 2017; change to your desired date
response = table.query(KeyConditionExpression=Key('id').eq(str(sel_id)) & Key('timest').gt(20170908000015)) 
df = pd.DataFrame(response['Items'])
# clean up the dataframe
df['timest'] = [pd.to_datetime(str(date)[:-4], format = '%Y%m%d%H%M') for date in df['timest']]
# read in batteryAV to get the time
df[['something', 'HourMinute', 'MonthDay', 'AV', 'drop'] ] = df['battAV'].str.split(',').apply(pd.Series)
# key in the calibration codes, m_o3, m_no2, m_so2, m_h2s
df[['O3_avg', 'O3_std']]   = df[['O3_avg', 'O3_std']].astype(float)/ m_o3)
df[['NO2_avg', 'NO2_std']] = df[['NO2_avg', 'NO2_std']].astype(float)/m_no2)
df[['SO2_avg', 'SO2_std']] = df[['SO2_avg', 'SO2_std']].astype(float)/m_so2)
df[['H2S_avg', 'H2S_std']] = df[['H2S_avg', 'H2S_std']].astype(float)/m_h2s)

# set up time index 
date_index = []
for date in df[['MonthDay', 'HourMinute']].values : 
    try: 
        if date[0] == '32767' : 
            date_index.append(np.nan)
        elif date[0] == '0' : 
            date_index.append(np.nan)
        else:
            date_index.append(pd.to_datetime('2017' +date[0]+date[1], format = '%Y%m%d%H%M'))
    except ValueError:  
        date_index.append(np.nan)
df['date_index'] = date_index

For an implementation of the code & a proposed calibration technique, see (https://github.com/BaltimoreOpenAir/BOAFieldEvaluation/blob/master/MDE_Beltsville_Analysis.ipynb).