/ubispark-tflite

Distributed Mobile Vision using Tensorflow Lite (CNN)

Primary LanguageJava

Tensorflow Lite - based object detection executor: ubispark-tflite

This program was used to execute tasks on clusters of smartphones as part of the publication "Pervasive Data Science on the Edge" published in IEEE Pervasive Computing in 2019 and supported by Academy of Finland ( Project number 297741 ).

Full text (authors' copy) available at: https://researchportal.helsinki.fi/en/publications/pervasive-data-science-on-the-edge

Official publication: https://ieeexplore.ieee.org/document/8915957

Usage

  1. Download an image dataset, like the CORe50 or ILSVRC
  2. Extract the files to a folder
  3. Use the preprocess shell script to randomly select N files for classification:
$ preprocess <folder> <N>
  1. Install the dependencies for master node using npm
$ cd master && npm install
  1. Run the master node with Node.js:
node master.js
  1. Build the client in Android Studio
  2. Install and open the client on worker devices, enter the master ip:port and press START
  3. Type "ready" in the master console to start the inference

Standalone version

For comparison, there is a non-distributed (but threaded) Java implementation under /standalone. You can build it using IntelliJ IDEA and Maven.

NOTE: Using a .pb instead of .tflite requires that colors are formatted in 0-1 range.

NOTE: TF handles threading, rolling your own threadpool might end up in deadlock.

(C) 2018 - Jonatan Hamberg <jonatan.hamberg@cs.helsinki.fi>