Skip to main content
SpringerLink
Log in

Uncertainty-guided Robust labels refinement for unsupervised person re-identification

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Existing state-of-the-art unsupervised person re-identification (Re-ID) methods rely on clustering to generate pseudo labels for training. The reliability of pseudo labels directly affects the performance of these methods. Due to unsatisfactory feature embedding and imperfect clustering, pseudo labels are not always reliable that significantly hinder the representation learning of person. To address this issue, an Uncertainty-guided Robust labels refinement method is proposed. It employs uncertainty as guidance to selects and optimizes unreliable pseudo labels, which alleviates the impact of incorrect pseudo labels. Specially, an uncertainty estimation module is constructed, which identifies the samples with low reliability applies base on consistency between the ideal distribution and the predicted distribution. To mitigate the impact of unreliable samples, the labels refinement module is designed, which rebuilds labels for low reliability samples by measuring similarity from the closest centroid. Thanks to the reliability of pseudo labels provided by uncertain estimation module, the proposed method enhances robustness to noisy labels and learns discriminative representations of person. Extensive experiments demonstrate that the proposed method is effective and achieves advanced performance for unsupervised person Re-ID.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability Statement

All data generated or analyzed during this study are included in this published article.

References

  1. Bai S, Bai X, Tian Q (2017) Scalable person re-identification on supervised smoothed manifold. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2530–2539

  2. Bai Z, Wang Z, Wang J, Hu D, Ding E (2021) Unsupervised multi-source domain adaptation for person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12914–12923

  3. Chang J, Lan Z, Cheng C, Wei Y (2020) Data uncertainty learning in face recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5710–5719

  4. Chen H, Lagadec B, Bremond F (2021) Ice: inter-instance contrastive encoding for unsupervised person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 14960–14969

  5. Chen H, Wang Y, Lagadec B, Dantcheva A, Bremond F (2021) Joint generative and contrastive learning for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2004–2013

  6. Cho Y, Kim WJ, Hong S, Yoon SE (2022) Part-based pseudo label refinement for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7308–7318

  7. Dai Y, Sun Y, Liu J, Tong Z, Yang Y, Duan LY (2022) Bridging the source-to-target gap for cross-domain person re-identification with intermediate domains. arXiv preprint arXiv:2203.01682

  8. Dai Z, Wang G, Yuan W, Liu X, Zhu S, Tan P (2021) Cluster contrast for unsupervised person re-identification. arXiv preprint arXiv:2103.11568

  9. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pp 248–255. IEEE

  10. Ester M, Kriegel H-P, Sander J, Xiaowei X et al (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd 96:226–231

    Google Scholar 

  11. Fu Y, Wei Y, Wang G, Zhou Y, Shi H, Huang TS (2019) Self-similarity grouping: a simple unsupervised cross domain adaptation approach for person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 6112–6121

  12. Ge Y, Chen D, Li H (2020) Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification. arXiv preprint arXiv:2001.01526

  13. Ge Y, Zhu F, Chen D, Zhao R et al (2020) Self-paced contrastive learning with hybrid memory for domain adaptive object re-id. Adv Neural Inf Process Syst 33:11309–11321

    Google Scholar 

  14. Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: Proceedings of the IEEE international workshop on performance evaluation for tracking and surveillance (PETS), vol 3, pp 1–7. Citeseer

  15. Guo J, Yuan Y, Huang L, Zhang C, Yao JG, Han K (2019) Beyond human parts: Dual part-aligned representations for person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 3642–3651

  16. Han J, Li Y-L, Wang S (2022) Delving into probabilistic uncertainty for unsupervised domain adaptive person re-identification. In: Proceedings of the AAAI conference on artificial intelligence vol 36, pp 790–798

  17. He K, Fan H, Wu Y, Xie S, Girshick R (2020) Momentum contrast for unsupervised visual representation learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 9729–9738

  18. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  19. Hu Z, Sun Y, Yang Y, Zhou J (2022) Divide-and-regroup clustering for domain adaptive person re-identification

  20. Isobe T, Han J, Zhuz F, Liy Y, Wang S (2020) Intra-clip aggregation for video person re-identification. In: 2020 IEEE international conference on image processing (ICIP), pp 2336–2340. IEEE

  21. Joo HT, Kim KJ (2019) Visualization of deep reinforcement learning using grad-cam: how ai plays atari games? In: 2019 IEEE conference on games (CoG), pp 1–2. IEEE

  22. Joyce JM (2011) Kullback-leibler divergence. In: International encyclopedia of statistical science, pp 720–722. Springer

  23. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980

  24. Li J, Zhang S (2020) Joint visual and temporal consistency for unsupervised domain adaptive person re-identification. In: European conference on computer vision, pp 483–499. Springer

  25. Li Z, Shi Y, Ling H, Chen J, Wang Q, Zhou F (2022) Reliability exploration with self-ensemble learning for domain adaptive person re-identification. In: Proceedings of the AAAI conference on artificial intelligence vol 36, pp 1527–1535

  26. Lin Y, Dong X, Zheng L, Yan Y, Yang Y (2019) A bottom-up clustering approach to unsupervised person re-identification. In: Proceedings of the AAAI conference on artificial intelligence vol 33, pp 8738–8745

  27. Lin Y, Xie L, Wu Y, Yan C, Tian Q (2020) Unsupervised person re-identification via softened similarity learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, vol 10, pp 3390–3399

  28. Liu X, Liu W, Ma H, Fu H (2016) Large-scale vehicle re-identification in urban surveillance videos. In: 2016 IEEE international conference on multimedia and expo (ICME), pp 1–6. IEEE

  29. Lu Z, Lin R, He Q, Hu H (2023) Mask-aware pseudo label denoising for unsupervised vehicle re-identification. IEEE Trans Intell Transp Syst 24(4):4333–4347

    Article  Google Scholar 

  30. Luo H, Jiang W, Youzhi G, Liu F, Liao X, Lai S, Jianyang G (2019) A strong baseline and batch normalization neck for deep person re-identification. IEEE Trans Multimedia 22(10):2597–2609

    Article  Google Scholar 

  31. MacQueen J (1967) Classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, pp 281–297

  32. Pang Z, Wang C, Wang J, Zhao L (2023) Reliability modeling and contrastive learning for unsupervised person re-identification. Knowl-Based Syst 263:110263

    Article  Google Scholar 

  33. Ristani E, Solera F, Zou R, Cucchiara R, Tomasi C (2016) Performance measures and a data set for multi-target, multi-camera tracking. In: European conference on computer vision, pp 17–35. Springer

  34. Song L, Wang C, Zhang L, Bo D, Zhang Q, Huang C, Wang X (2020) Unsupervised domain adaptive re-identification: theory and practice. Pattern Recogn 102:107173

    Article  Google Scholar 

  35. Song L, Wang C, Zhang L, Bo D, Zhang Q, Huang C, Wang X (2020) Unsupervised domain adaptive re-identification: theory and practice. Pattern Recogn 102:107173

    Article  Google Scholar 

  36. Sun X, Zheng L (2019) Dissecting person re-identification from the viewpoint of viewpoint. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 608–617

  37. van der Maaten L, Hinton G (2008) Visualizing data using t-sne. J Mach Learn Res 9(11)

  38. Wang D, Zhang S (2020) Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 10981–10990

  39. Wang D, Zhang S (2020) Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 10981–10990

  40. Wang H, Yang M, Liu J, Zheng WS (2023) Pseudo-label noise prevention, suppression and softening for unsupervised person re-identification. IEEE Trans Inf Forens Secur

  41. Wang M, Lai B, Huang J, Gong X, Hua X-S (2021) Camera-aware proxies for unsupervised person re-identification. In: Proceedings of the AAAI conference on artificial intelligence vol 35, pp 2764–2772

  42. Wang X, Zhang H, Huang W, Scott M (2020) Cross-batch memory for embedding learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 6388–6397

  43. Wei L, Zhang S, Gao W, Tian Q (2018) Person transfer gan to bridge domain gap for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 79–88

  44. Yu W, Lin Y, Dong X, Yan Y, Bian W, Yang Y (2019) Progressive learning for person re-identification with one example. IEEE Trans Image Process 28(6):2872–2881

    Article  MathSciNet  Google Scholar 

  45. Yuhang W, Huang T, Yao H, Zhang C, Shao Y, Han C, Gao C, Sang N (2022) Multi-centroid representation network for domain adaptive person re-id. In: Proceedings of the AAAI conference on artificial intelligence vol 36, pp 2750–2758

  46. Xuan S, Zhang S (2021) Intra-inter camera similarity for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11926–11935

  47. Yu HX, Zheng WS, Wu A, Guo X, Gong S, Lai JH (2019) Unsupervised person re-identification by soft multilabel learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2148–2157

  48. Zeng K, Ning M, Wang Y, Guo Y (2020) Hierarchical clustering with hard-batch triplet loss for person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13657–13665

  49. Zhang G, Zhang H, Lin W, Arun KC, Xuan J (2023) Camera contrast learning for unsupervised person re-identification. IEEE Trans Circ Syst Video Technol

  50. Zhang M, Ping L (2023) A simple similarity-ranking-based pseudo-label redistribution method for unsupervised person re-identification. TechRxiv. preprint techrXiv.22698361.v1

  51. Zhang X, Cao J, Shen C, You M (2019) Self-training with progressive augmentation for unsupervised cross-domain person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8222–8231

  52. Zhang Z, Zhang H, Liu S (2021) Person re-identification using heterogeneous local graph attention networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 12136–12145

  53. Zheng A, Sun X, Li C, Tang J (2021) Aware progressive clustering for unsupervised vehicle re-identification. IEEE Trans Intell Transp Syst 23(8):11422–11435

    Article  Google Scholar 

  54. Zheng K, Lan C, Zeng W, Zhang Z, Zha Z-J (2021) Exploiting sample uncertainty for domain adaptive person re-identification. In: Proceedings of the AAAI conference on artificial intelligence vol 35, pp 3538–3546

  55. Zheng K, Liu W, He L, Mei T, Luo J, Zha ZJ (2021) Group-aware label transfer for domain adaptive person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5310–5319

  56. Zheng Liang, Shen Liyue,Tian Lu , Wang Shengjin, Wang Jingdong,Tian Qi (2015) Scalable person re-identification: A benchmark. In Proceedings of the IEEE international conference on computer vision, pp 1116–1124

  57. Zheng Y, Tang S, Teng G, Ge Y, Liu K, Qin J, Donglian Q, Dapeng C (2021) Online pseudo label generation by hierarchical cluster dynamics for adaptive person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8371–8381

  58. Zheng Z, Yang Y (2021) Rectifying pseudo label learning via uncertainty estimation for domain adaptive semantic segmentation. Int J Comput Vision 129(4):1106–1120

    Article  Google Scholar 

  59. Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1318–1327

  60. Zhong Z, Zheng L, Luo Z, Li S, Yang Y (2020) Learning to adapt invariance in memory for person re-identification. IEEE Trans Pattern Anal Mach Intell 43(8):2723–2738

    Google Scholar 

Download references

Acknowledgements

This work was supported by Hebei Natural Science Foundation (No. F2022201009), by Central Government Guides Local Science and Technology Development Fund Projects (No. 236Z0301G), by Science Research Project of Hebei Education Department (No. QN2023186).

Author information

Authors and Affiliations

  1. School of Cyber Security and Computer, Hebei University, Baoding, 071000, Hebei, China

    Chengjun Wang, Jinjia Peng & Zeze Tao

  2. Hebei Machine Vision Engineering Research Center, Baoding, 071000, Hebei, China

    Jinjia Peng & Zeze Tao

  3. School of Computer Science and Technology, Dalian Maritime University, Dalian, 116024, Liaoning, China

    Huibing Wang

Authors
  1. Chengjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinjia Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zeze Tao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huibing Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jinjia Peng.

Ethics declarations

Conflict of interest

All the authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, C., Peng, J., Tao, Z. et al. Uncertainty-guided Robust labels refinement for unsupervised person re-identification. Neural Comput & Applic 36, 977–991 (2024). https://doi.org/10.1007/s00521-023-09071-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-09071-1

Keywords

Search

Navigation