/FoveaBox

FoveaBox: Beyond Anchor-based Object Detector

Primary LanguagePythonApache License 2.0Apache-2.0

FoveaBox: Beyond Anchor-based Object Detector

This repo is a official implementation of "FoveaBox: Beyond Anchor-based Object Detector" on COCO object detection based on open-mmlab's mmdetection. Many thanks to mmdetection for their simple and clean framework.

News

FoveaBox is supported by the official mmdetection repo here. Thanks again for open-mmlab's work on open source projects.

Introduction

FoveaBox is an accurate, flexible and completely anchor-free object detection system for object detection framework, as presented in our paper https://arxiv.org/abs/1904.03797: Different from previous anchor-based methods, FoveaBox directly learns the object existing possibility and the bounding box coordinates without anchor reference. This is achieved by: (a) predicting category-sensitive semantic maps for the object existing possibility, and (b) producing category-agnostic bounding box for each position that potentially contains an object.

FoveaBox detection process.

Installation

This FoveaBox implementation is based on mmdetection. Therefore the installation is the same as original mmdetection.

Please check INSTALL.md for installation instructions.

Train and inference

The FoveaBox config is in configs/foveabox.

Inference

# single-gpu testing
python tools/test.py ${CONFIG_FILE} ${CHECKPOINT_FILE} [--out ${RESULT_FILE}] --eval bbox [--show]

# multi-gpu testing
./tools/dist_test.sh ${CONFIG_FILE} ${CHECKPOINT_FILE} ${GPU_NUM} [--out ${RESULT_FILE}] --eval bbox

Training

# single-gpu training
python tools/train.py ${CONFIG_FILE}

# multi-gpu training
./tools/dist_train.sh ${CONFIG_FILE} ${GPU_NUM} [optional arguments]

Please check GETTING_STARTED.md for detailed instructions.

Main Results

Results on R50/101-FPN with backbone

Backbone Style align ms-train Lr schd Mem (GB) Train time (s/iter) Inf time (fps) box AP Download
R-50 pytorch N N 1x 5.7 0.450 13.5 36.5 model
R-50 pytorch N N 2x - - 36.9 model
R-50 pytorch Y N 2x - - 37.9 model
R-50 pytorch Y Y 2x - - 40.1 model
R-101 pytorch N N 1x 9.4 0.712 11.5 38.5 model
R-101 pytorch N N 2x - - - 38.5 model
R-101 pytorch Y N 2x - - - 39.4 model
R-101 pytorch Y Y 2x - - - 41.9 model

[1] 1x and 2x mean the model is trained for 12 and 24 epochs, respectively.
[2] Align means utilizing deformable convolution to align the cls branch.
[3] All results are obtained with a single model and without any test time data augmentation.
[4] We use 4 NVIDIA Tesla V100 GPUs for training.

Any pull requests or issues are welcome.

Citations

Please consider citing our paper in your publications if the project helps your research. BibTeX reference is as follows.

@article{kong2019foveabox,
  title={FoveaBox: Beyond Anchor-based Object Detector},
  author={Kong, Tao and Sun, Fuchun and Liu, Huaping and Jiang, Yuning and Li, Lei and Shi, Jianbo},
  journal={IEEE Transactions on Image Processing},
  pages={7389--7398},
  year={2020}
}