/FGSE

A Systematic Evaluation: Fine-Grained CNN vs. Traditional CNN Classifiers, 2023

MIT LicenseMIT

A Systematic Evaluation: Fine-Grained CNN vs. Traditional CNN Classifiers

This repository is for comparison of fine-grain classifiers and traditional classifiers introduced in the following paper

Saeed Anwar, Nick Barnes, and Lars Petersson, "A Systematic Evaluation: Fine-Grained CNN vs. Traditional CNN Classifiers", Electronics, 2023

Contents

  1. Introduction
  2. Network
  3. Requirements
  4. Test
  5. Results
  6. Citation

Introduction

To make the best use of the underlying minute and subtle differences, fine-grained classifiers collect information about inter-class variations. The task is very challenging due to the small differences between the colors, viewpoint, and structure in the same class entities. The classification becomes more difficult due to the similarities between the differences in viewpoint with other classes and differences with its own. In this work, we investigate the performance of the landmark general CNN classifiers, which presented top-notch results on large scale classification datasets, on the fine-grained datasets, and compare it against state-of-the-art fine-grained classifiers. This paper poses two specific questions: (i) Do the general CNN classifiers achieve comparable results to fine-grained classifiers? (ii) Do general CNN classifiers require any specific information to improve upon the fine-grained ones? We train the general CNN classifiers throughout this work without introducing any aspect specific to fine-grained datasets. We show an extensive evaluation on six datasets to determine whether the fine-grained classifier can elevate the baseline in their experiments.

The difference between classes (inter-class variation) is limited forvarious classes

The intra-class variation is usually high due to pose, lighting, and color.

Network

The networks in this evaluation can be broadly categorized into plain networks, residual networks, and densely connected networks. The three architectures we investigate against fine-grained classifiers are VGG, ResNet, and DenseNet.

Requirements

The model is built using

  1. PyTorch 1.6.0
  2. Python 3.8
  3. Cuda 10.2
  4. imageio
  5. logging
  6. Tested on Ubuntu 14.04/16.04 environment

Test

Quick start

  1. Download the trained models from

  2. cd to the dataset such Airplane, Cars, CUB, Dogs, Flowers and NaBirds and then cd to the model r50, r152 or d161 for example, '/Cars/r50_cars/' or '/Airplane/r152_plane', run the following scripts.

    You can use the following script to test the algorithm

    #Script
CUDA_VISIBLE_DEVICES=0 python test.py

Results

Datasets

Details of six fine-grained visual categorization datasets to evaluate the proposed method.

Quantitative Results

Performance comparison with Traditional CNN learning and Fine-grained algorithms. Comparison of the state-of-the-art fine grain classification on CUB dataset. Best results are highlighted in bold.

Experimental results on FGVC Aircraft and Cars.

Comparison of the state-of-the-art fine grain classification on Dogs, Flowers, and NABirds dataset.

Differences strategies for initialing the network weights i.e. finetuning from ImageNet and random initialization (scratch) for Cars dataset.

For more information, please refer to our paper

Citation

If you find the code helpful in your resarch or work, please cite the following papers.

@article{anwar2023systematic,
  title={A Systematic Evaluation: Fine-Grained CNN vs. Traditional CNN Classifiers},
  author={Anwar, Saeed and Barnes, Nick and Petersson, Lars},
  journal={Electronics},
  year={2023}
  volume = {12},
  number = {23},
  article-number = {4877},
  issn = {2079-9292}
}