/HAR

Primary LanguagePython

Real-time human activity recognition from accelerometer data using Convolutional Neural Networks

1. Overview

This code implements a Convolutional Neural Network-based approach for real-time human activity recognition.

The proposed architecture combines a shallow CNN for unsupervised local feature extraction together with statistical features that encode global characteristics of the time series. Among its main benefits are short recognition intervals of size up to 1 second, almost no manual feature engineering or data preprocessing, and a domain-independent architecture that with a minimal amount of modifications can be applied to different types of datasets.

2. Dependencies

Data segmentation:
  • matlab or octave
Activity classification
  • python 2.7+
  • scikit-learn
  • numpy
  • tesnorflow

3. Experiments

The system was evaluated on two commonly used WISDM and UCI datasets that contain labeled accelerometer data from 36 and 30 users respectively and can be freely downloaded from the corresponding websites.

Data Segmentation

To perform a segmentation of the initial time series and generate datasets for testing the model, unzip file
"data_processing/datasets.zip" and run matlab scripts "run_WISDM.m" or "run_UCI.m" for WISDM and UCI datasets respectively. The parameters of segmentation are specified in the header of these scripts.

Baseline HAR techniques
  • To test an approach based on Random Forest + hand-crafted features run "wisdm_random_forest.py".
  • To test an approach based on Random Forest + PCA features set parameter 'use_pca_features' to true in "run_WISDM.m" and after the data is generated run "wisdm_random_forest.py".
  • To test an approach based on the classification of raw accelerometer time series using K-nearest neighbor algorithm, run "wisdm_knn.py".
CNN Model

The proposed CNN-based model is implemented using tensorflow machine learning library.

To apply CNN to WISDM dataset, generate traing data and run "cnn_wisdm.py". For UCI dataset run "cnn_uci.py". The parameters of the CNN are specified in the header of these scripts.

4. System performance

When using UCI dataset and segments (recognition intervals) of size 128, CNN should achieve the accuracy score of about 97%. For segments of size 50 this value should be about 94%.

When using WISDM dataset and segments (recognition intervals) of size 200, CNN should achieve the accuracy score of about 93%. For segments of size 50 this value should be about 90%.