/Approximate-HetConv

An approximate but simple implementation of HetConv

Primary LanguagePython

Approximate-HetConv

Introduction

This is an approximate but simple pytorch implementation of HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNs. The main purpose is to reduce the number of FLOPs and parameters without sacrificing speed.

Experimentation

Results for VGG-16 on CIFAR-10 after 200 epochs

Model FLOPs Params Acc%
vgg16_bn_P1 313.47M 14.99K 93.66
vgg16_bn_P2 192.36M 9.27K 93.48
vgg16_bn_P4 114.50M 5.59K 93.88
vgg16_bn_P8 75.57M 3.75K 93.68
vgg16_bn_P16 56.11M 2.83K 93.36
vgg16_bn_P32 46.38M 2.37K 93.13