/MobileViT

MobileViT implementation in Tensorflow

Primary LanguagePython

MobileViT Implementation in Tensorflow2

Introduction

This repository contains tensorflow2 implementation of MobileViT.

You can train a network for cifar dataset.

arch table

Dependencies

pip install -r requirements.txt

Usage

python train.py --ep 50 --bs 16 --data cifar10 --arch [S, XS, XXS] --size [64, 128, 256, 512, ...]

To do

  • AdamW Optimizer
  • Learning rate scheduler(including cosine annealing)
  • Label Smoothing(0.1)
  • Multi-Scaler Training(Adaptive Batch size)
  • L2 Weight Decay
  • Change Data augmentation from complex to simple one