Finger Flexion Detection using ECoG signals

The goal of this project was to predict finger flexion motions of individual fingers from Electrocorticography (ECoG) data recorded from three subjects. To achieve this, our team adopted a Deep Learning approach. Our final algorithm consists of a collection of Neural Networks to make finger-wise predictions. The ECoG data for each subject was first pre-processed using an FIR Band-pass filter, followed by a Notch filter. Next, eight essential (time-domain and frequency-domain) features were identified and collected over the ECoG data using moving windows of length 100ms and overlap 50ms. The feature set was then used for training the models to enable predictions on unknown test data. Finally, the resulting predictions were interpolated using Cubic Spline and post-processed by convolution with a Trapezoid Kernel to improve the correlation between our predictions and the actual values.

Flexion predictions before and after post processing for one subject

Flow Chart

Reference

  1. Decoding Flexion of Individual Fingers using Electrocorticographic Signals in Humans by Kubanek et al. (2009).
  2. Decoding Visual Information From a Population of Retinal Ganglion Cells by Warland et al. (1997).
  3. Decoding Finger Flexion from Band-Specific ECoG Signals in Humans by Nanying Liang and Laurent Bougrain (2012).