/RWKV-SeqMNIST

An implementation of sequential MNIST, using PyTorch Lightning

Primary LanguagePython

Modification of RWKV V6 RNN mode to support batches of data

increasing size of the model increases performance as expected

at the moment only the mnist input dim of 28 works, I haven't debugged 1 yet

Training using PyTorch Lightning.

Visualization

Tensorboard Screenshot