/ST-RSBP

Primary LanguageCudaGNU General Public License v3.0GPL-3.0

Spike-Train level Recurrent Spiking Neural Networks Backpropagation (ST-RSBP) for SNNs

This repo is the CUDA implementation of SNNs trained the Spike-Train level RSNNs Backpropagation, modified based on HM2-BP for spiking neuron networks.

The paper Spike-Train Level Backpropagation for Training Deep Recurrent Spiking Neural Networks is accepted by the Thirty-third Conference on Neural Information Processing Systems, 2019.

Contact stonezwr@gmail.com if you have any questions or concerns.

Dependencies and Libraries

  • OpenCV (3.4 or higher)
  • CUDA (8.0 or higher)
  • OpenMP

You can compile the code on windows or linux.

SDK include path(-I)
  • linux: /usr/local/cuda/samples/common/inc/ (For include file "helper_cuda"); /usr/local/include/opencv/ (Depend on situation)
  • windows: X:/Program Files (x86) /NVIDIA Corporation/CUDA Samples/v6.5/common/inc (For include file "helper_cuda"); X:/Program Files/opencv/vs2010/install/include (Depend on situation)
Library search path(-L)
  • linux: /usr/local/lib/
  • windows: X:/Program Files/opencv/vs2010/install/x86/cv10/lib (Depend on situation)
libraries(-l)
  • opencv_core
  • opencv_highgui
  • opencv_imgproc
  • opencv_imgcodecs (need for opencv3.0)
  • openmp
  • cublas
  • curand
  • cudadevrt
  • cudacusparse
  • cudacurand
  • cudacusolver

Installation

The repo requires CUDA 8.0+ to run.

Please install the opencv and cuda before hand.

Install CMake and OpenCV

$ sudo apt-get install cmake libopencv-dev

Checkout and compile the code:

$ git clone https://github.com/jinyyy666/mm-bp-snn.git
$ cd mm-bp-snn
$ mkdir build
$ # change the libraries, dependencies and capability of GPU in CMakeLists.txt
$ # if the cmake version is less than 3, set the libraries of CUDA manually
$ cd build
$ cmake ..
$ # if gcc version > 6, using "cmake -DCMAKE_C_COMPILER=gcc-5 -DCMAKE_CXX_COMPILER=g++-5 .."
$ make -j
GPU compute compatibility
  • capability 6.0 for Titan XP, which is used for the authors.
  • Check the compatibility and change the CMAKE file before compile.

Get Dataset

MNIST:

$ cd mnist/
$ ./get_mnist.sh

N-MNIST: Get the N-MNIST dataset by N-MNIST. Then unzip the ''Test.zip'' and ''Train.zip''. Run the matlab code: NMNIST_Converter.m

N-Tidigits: N-Tidigits, read the dataset using N-Tidigits_Converter.py.

Fashion-MNIST: Fashion-MNIST

TI46: Download from TI46 and preprocess it using Lyon ear model using TI46_Lyon_ear.m

Run the code

Before running, use eij_function.m to generate eij file and put the file in Effect_Ratio_file.

By default, put the data in the previous directory "../" Then run

$ ./build/CUDA-RSNN

and follow the instruction.

For Window user

Do the following to set up compilation environment.

  • Install Visual Stidio and OpenCV.
  • When you create a new project using VS, You can find NVIDIA-CUDA project template, create a cuda-project.
  • View-> Property Pages-> Configuration Properties-> CUDA C/C++ -> Device-> Code Generation-> compute_60,sm_60
  • View-> Property Pages-> Configuration Properties-> CUDA C/C++ -> Common-> Generate Relocatable Device Code-> Yes(-rdc=true)
  • View-> Property Pages-> Configuration Properties-> Linker-> Input-> Additional Dependencies-> libraries(-l)
  • View-> Property Pages-> Configuration Properties-> VC++ Directories-> General-> Library search path(-L)
  • View-> Property Pages-> Configuration Properties-> VC++ Directories-> General-> Include Directories(-I)

Notes

  • The SNNs are implemented in terms of layers. User can config the SNNs by using configuration files in Config/
  • The program will save the best test result and save the network weight in the file "Result/checkPoint.txt", If the program exit accidentally, you can continue the program form this checkpoint.
  • The logs for the reported performance and the settings can be found in Result folder.
  • Only batch size = 1 is used in the experiments. Other value of batch size may cause problem.