TokenLearner in Pytorch

Unofficial Pytorch implementation of TokenLearner by Ryoo et al. from Google AI

The following figure presents a pictorial overview of the module (source). TokenLearner module GIF

In this repository, we implement the TokenLearner module and demonstrate its performance with a ViT tiny and the CIFAR-10 dataset.

Installation

pip install -r requirements.txt

Run

python train_classifier.py