Eurus-Holmes/DeiT-CIFAR

Finetune Deit on CIFAR-10

The code was adapted from DeiT, but make sure you have the pytorch-image-models package timm==0.4.12.

pip install timm==0.4.12

Example

With DeiT-tiny:

python main.py --finetune https://dl.fbaipublicfiles.com/deit/deit_tiny_patch16_224-a1311bcf.pth --data-set CIFAR-10 --model deit_tiny_patch16_224 --batch-size 128 --epochs 20 --output_dir tiny_CIFAR10

With DeiT-base:

python main.py --finetune https://dl.fbaipublicfiles.com/deit/deit_base_patch16_224-b5f2ef4d.pth --data-set CIFAR-10 --model deit_base_patch16_224 --batch-size 128 --epochs 20 --output_dir output