/3DInvarReID

Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification (ICCV 2023)

Primary LanguagePythonMIT LicenseMIT

Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification

International Conference on Computer Vision (ICCV 2023). [Arxiv, PDF, Project]

Feng Liu, Minchul Kim, Ziang Gu, Anil Jain, Xiaoming Liu

Long-Term Person Re-Identification (LT-ReID) has become increasingly crucial in computer vision and biometrics. In this work, we aim to extend LT-ReID beyond pedestrian recognition to include a wider range of real-world human activities while still accounting for cloth-changing scenarios over large time gaps. This setting poses additional challenges due to the geometric misalignment and appearance ambiguity caused by the diversity of human pose and clothing. To address these challenges, we propose a new approach 3DInvarReID for (i) disentangling identity from non-identity components (pose, clothing shape, and texture) of 3D clothed humans, and (ii) reconstructing accurate 3D clothed body shapes and learning discriminative features of naked body shapes for person ReID in a joint manner. To better evaluate our study of LT-ReID, we collect a real-world dataset called CCDA, which contains a wide variety of human activities and clothing changes. Experimentally, we show the superior performance of our approach for person ReID.

Prerequisites

This code is developed with

  • Python 3.7
  • Pytorch 1.8
  • Cuda 11.1

Stage1: Pre-train the Joint Two-Layer Implicit Model

Please refer to pretrain/README for the details.

Stage2: Person Re-Identification

Please refer to matching/README for the details.

The Cloth-Changing and Diverse Activities (CCDA) dataset

Please find the dataest here

Citation

@inproceedings{liu2023learning,
  title={Learning clothing and pose invariant 3d shape representation for long-term person re-identification},
  author={Liu, Feng and Kim, Minchul and Gu, ZiAng and Jain, Anil and Liu, Xiaoming},
  booktitle={ICCV},
  year={2023}
}

Acknowledgments

Here are some great resources we benefit from:

  • gDNA for 3D clothed human model modeling.
  • Simple-CCReID for person re-identification.

License

MIT License

Contact

For questions feel free to post here or drop an email to - liufeng6@msu.edu