Abstract
Cross-view identification is one of the challenges in the task of vehicle re-identification. Because of the different shapes, structures, and surface area, changes in viewing angle have a greater impact on vehicle re-ID than on person re-ID. Previous work mainly focused on generating other viewing angle features through a single view feature of the vehicle to achieve cross-view identification. This paper proposes a systematic framework to realize the alignment and discrimination of key features by learning high-order relationships and topological information. First, the feature extraction module (FEM) is applied to extract local and global features of the vehicle. Then,the graph convolution module (GCM) integrates the topological structure information between the key points of the vehicle into the local features to compensate for the unexposed key points caused by the blind zone. Finally, the graph matching module(GMM) robustly aligns the key features between the two graphs and calculates their similarity. Experimental results show that our proposed method VGM has competitive results with the existing state-of-the-art methods on benchmark datasets VeRi-776 and VARI.
Similar content being viewed by others
References
Liu X, Liu W, Ma H, Fu H (2016) Large-scale vehicle re-identification in urban surveillance videos. In: 2016 IEEE International conference on multimedia and expo (ICME). IEEE, pp 1–6
Wang P, Jiao B, Yang L, Yang Y, Zhang S, Wei W, Zhang Y (2019) Vehicle re-identification in aerial imagery: Dataset and approach. In: Proceedings of the IEEE international conference on computer vision, pp 460–469
Zheng L, Yang Y, Hauptmann AG (2016) Person re-identification: Past, present and future. arXiv:1610.02984
Wang K, Wang H, Liu M, Xing X, Han T (2018) Survey on person re-identification based on deep learning. CAAI Trans Intell Technol 3(4):219–227
Khan SD, Ullah H (2019) A survey of advances in vision-based vehicle re-identification. Comput Vis Image Underst 182:50–63
Wang H, Hou J, Chen N (2019) A survey of vehicle re-identification based on deep learning. IEEE Access 7:172,443–172,469
Yang L, Luo P, Change Loy C, Tang X (2015) A large-scale car dataset for fine-grained categorization and verification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3973–3981
Liu X, Zhang S, Huang Q, Gao W (2018) Ram: a region-aware deep model for vehicle re-identification. In: 2018 IEEE International conference on multimedia and expo (ICME). IEEE, pp 1–6
Liu X, Liu W, Mei T, Ma H (2016) A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: European conference on computer vision. Springer, pp 869–884
Zhang Y, Liu D, Zha ZJ (2017) Improving triplet-wise training of convolutional neural network for vehicle re-identification. In: 2017 IEEE International conference on multimedia and expo (ICME). IEEE, pp 1386–1391
Bai Y, Lou Y, Gao F, Wang S, Wu Y, Duan LY (2018) Group-sensitive triplet embedding for vehicle reidentification. IEEE Trans Multimed 20(9):2385–2399
Zhou Y, Shao L (2017) Cross-view gan based vehicle generation for re-identification. In: BMVC, vol 1, pp 1–12
Khorramshahi P, Kumar A, Peri N, Rambhatla SS, Chen JC, Chellappa R (2019) A dual-path model with adaptive attention for vehicle re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 6132–6141
Chen D, Yuan Z, Chen B, Zheng N (2016) Similarity learning with spatial constraints for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1268–1277
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 815–823
Zhang D, Wu W, Cheng H, Zhang R, Dong Z, Cai Z (2017) Image-to-video person re-identification with temporally memorized similarity learning. IEEE Trans Circuits Syst Video Technol 28(10):2622–2632
You J, Wu A, Li X, Zheng WS (2016) Top-push video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1345–1353
Ma X, Zhu X, Gong S, Xie X, Hu J, Lam KM, Zhong Y (2017) Person re-identification by unsupervised video matching. Pattern Recogn 65:197–210
Liu H, Tian Y, Yang Y, Pang L, Huang T (2016) Deep relative distance learning: Tell the difference between similar vehicles. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2167–2175
Wang Z, Tang L, Liu X, Yao Z, Yi S, Shao J, Yan J, Wang S, Li H, Wang X (2017) Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 379–387
Zhou Y, Shao L (2018) Aware attentive multi-view inference for vehicle re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6489–6498
Barrois B, Hristova S, Wohler C, Kummert F (2009) Hermes, c.: 3d pose estimation of vehicles using a stereo camera. In: 2009 IEEE Intelligent vehicles symposium. IEEE, pp 267–272
Ding W, Li S, Zhang G, Lei X, Qian H (2018) Vehicle pose and shape estimation through multiple monocular vision. In: 2018 IEEE International conference on robotics and biomimetics (ROBIO). IEEE, pp 709–715
Tang Z, Naphade M, Birchfield S, Tremblay J, Hodge W, Kumar R, Wang S, Yang X (2019) Pamtri: Pose-aware multi-task learning for vehicle re-identification using highly randomized synthetic data. In: Proceedings of the IEEE international conference on computer vision, pp 211–220
Shell M, Doe J (2020) Pose-invariant feature learning for vehicle re-identification. IEEE Internet of Things Journal
Zanfir A, Sminchisescu C (2018) Deep learning of graph matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2684–2693
Hermans A, Beyer L, Leibe B (2017) In defense of the triplet loss for person re-identification. arXiv:1703.07737
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Luo H (2019) Bags of tricks and a strong baseline for deep person re-identification. In: 2019 IEEE/CVF Conference on computer vision and pattern recognition workshops (CVPRW)
Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167
Zhu J, Zeng H, Huang J, Liao S, Lei Z, Cai C, Zheng L (2020) Vehicle re-identification using quadruple directional deep learning features. IEEE Trans Intell Transp Syst 21(1):410–420
Bai Y, Liu J, Lou Y, Wang C, Duan L (2021) Disentangled feature learning network and a comprehensive benchmark for vehicle re-identification. IEEE Trans Pattern Anal Mach Intell, 1–1
Teng S, Zhang S, Huang Q, Sebe N (2021) Multi-view spatial attention embedding for vehicle re-identification. IEEE Trans Circuits Syst Video Technol 31(2):816–827
Liu X, Zhang S, Wang X, Hong R, Tian Q (2020) Group-group loss-based global-regional feature learning for vehicle re-identification. IEEE Trans Image Process 29:2638–2652
Wei XS, Zhang CL, Liu L, Shen C, Wu J (2018) Coarse-to-fine: a rnn-based hierarchical attention model for vehicle re-identification. In: Asian conference on computer vision. Springer, pp 575–591
Chen TS, Liu CT, Wu CW, Chien SY (2020) Orientation-aware vehicle re-identification with semantics-guided part attention network. In: European conference on computer vision, pp 330–346
Acknowledgments
This work was supported by the National Natural Science Foundation of China under Grants 62006242 and 62106258.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article belongs to the Topical Collection: Special Issue on Multi-view Learning Guest Editors: Guoqing Chao, Xingquan Zhu, Weiping Ding, Jinbo Bi and Shiliang Sun
Rights and permissions
About this article
Cite this article
Zhang, C., Yang, C., Wu, D. et al. Cross-view vehicle re-identification based on graph matching. Appl Intell 52, 14799–14810 (2022). https://doi.org/10.1007/s10489-022-03349-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-022-03349-y