/Visual-Memorability-through-Caffe

CNN, Caffe, LaMem,Azure

Primary LanguageJupyter Notebook

Visual Memorability with Caffe Model

@inproceedings{ICCV15_Khosla, author = "Aditya Khosla and Akhil S. Raju and Antonio Torralba and Aude Oliva", title = "Understanding and Predicting Image Memorability at a Large Scale", booktitle = "International Conference on Computer Vision (ICCV)", year = "2015" }

Score the memorability of pictures by Running LaMem (image process model) through Caffe (deep learning framework)

Interface:

  • IPython Notebook

Platform:

  • Ubuntu

Knowledge Applied:

  • Convolutional Neural Network and Gradient Descent
  • Loss Functions and Optimization
  • Activation Functions and Weight Regularization

Mini-batch SGD:

  • Sample a batch of data
  • Forward prop it through the graph, get loss
  • Backprop to calculate the gradients
  • Update the parameters using the gradient

Convoluntion Layer: COnvolvve the filter with the image and convolve(slide) over all spatial locations

Pooling Layer: make the representations smaller and more manageable and operate over each activation map independently

Fully Connected Layer(FC layer): contain neurons that connect to the entire input volume, as in ordinary Neural Networks

Summary

  • ConNets stack CONV,POOL, FC layers
  • Trend towards smaller filters and deeper architectures
  • Trend towards getting rid of POOL/FC layers(just CONV)
  • Trend towards smaller