Pyramid Spatial-Temporal Aggregation for Video-based Person Re-Identification
This is repository contains the code for the paper(ICCV 2021):
Pyramid Spatial-Temporal Aggregation for Video-based Person Re-Identification [pdf(baidu:PSTA)]
Yingquan Wang, Pingping Zhang, Shang Gao, Xia Geng, Hu Lu*, Dong Wang
Abstract
Video-based person re-identification aims to associate the video clips of the same person across multiple non-overlapping cameras. Spatial-temporal information provides richer and complementary information between frames, which is crucial to distinguish the target person when occlusion occurs. This paper proposes a novel Pyramid Spatial-Temporal Aggregation (PSTA) framework to aggregate the frame-level features progressively and fuse the hierarchical temporal features into a final video-level representation. Thus, short-term and long-term temporal information could be well exploited by different hierarchies. Furthermore, a Spatial-Temporal Aggregation Module (STAM) is proposed to enhance the aggregation capability of PSTA. It mainly consists of two novel attention blocks: Spatial Reference Attention (SRA) and Temporal Reference Attention (TRA). SRA explores the spatial correlations within a frame to determine the attention weight of each location. While TRA extends SRA with the correlations between adjacent frames, temporal consistency information can be fully explored to suppress the interference features and strengthen the discriminative ones. Extensive experiments on several challenging benchmarks demonstrate the effectiveness of the proposed PSTA, and our full model reaches 91.5% and 98.3% rank-1 accuracy on MARS and DukeMTMC-VideoReID benchmarks.
Training and Test
# For MARS
bash scripts/Mars_train.sh
bash scripts/Mars_test.sh
# For DukeMTMC-VID
bash scripts/Duke_train.sh
bash scripts/Duke_test.sh
Result
| Dataset | Mars | Duke-VID |
|---|---|---|
| Rank-1 | 91.5 | 98.3 |
| mAP | 85.8 | 97.7 |
| model | baidu:PSTA;Google | baidu:PSTA;Google |
Citation
if you use this code for your research, please cite our paper:
@inproceedings{PSTA,
title = {Pyramid Spatial-Temporal Aggregation for Video-based Person Re-Identification},
author = {Yingquan Wang and Pingping Zhang and Shang Gao and Xia Geng and Hu Lu and Dong Wang},
booktitle = {ICCV},
year = {2021}
}
Platform
This code was developed and tested with pytorch version 1.3.1.
Acknowledgments
This code is based on the implementations of baseline