/VGG16CAM-keras

Keras implementation of the VGG16-CAM model

Primary LanguagePython

Implementation of the VGG-CAM model with keras

Source

Original matlab implementation and paper here.

Requirements

  • keras with theano backend
  • h5py
  • numpy
  • matplotlib
  • opencv3

External data

Download the keras vgg16 weights.

Usage

  1. Use the train_VGGCAM function to fine tune the VGG16 model on your data. You should write your own code to feed the data into the network.
  2. Use the plot_classmap function to then plot the class activation map on an image specified by its path.

Example plot

On the Kaggle StateFarm dataset:

Drive + Phone 1 Drive + Phone 2

The network is focusing on the cell phone the driver is holding, regardless of driver ID or hand position.