etheleon/deepore

SRU

Closed this issue · 3 comments

Implementing SRU u first because it is easier and will speed up training

Implemented SRU on the SRU branch, build ontop of the weight visualisation branch.

However the SRU don't have batch norm which the paper uses with it's LSTM

Ok implemented Batch normalisation