Poses Guide Spatiotemporal Model for Vehicle Re-identification

  • Xian Zhong
  • Meng Feng
  • Wenxin Huang
  • Zheng Wang
  • Shin’ichi Satoh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11296)


In this paper, we tackle the vehicle Re-identification (Re-ID) problem, which is important in the urban surveillance. Utilizing visual appearance information is limited on performance due to occlusions, illumination variations, etc. To make the best of our knowledge, the recent few methods consider the spatiotemporal information to solve vehicle Re-ID problem, and neglect the influence of driving direction. In this paper, we explore that the spatiotemporal distribution of vehicle movements follows certain rules, moreover the vehicles’ poses on camera view indicate their directions are closely related to the spatiotemporal cues. Inspired by these two observations, we propose a vehicles’ Poses Guide Spatiotemporal model (PGST) for assisting vehicle Re-ID. Firstly, a Gaussian distribution based spatiotemporal probability model is exploited to predict the vehicle’s spatiotemporal movement. Then a CNN embedding poses classifier is exploited to estimate driving direction by evaluating vehicle’s pose. Finally, PGST model is integrated into the framework which fuses the results of visual appearance model and spatiotemporal model together. Due to the lack of vehicle dataset with spatiotemporal information and topology of cameras, experiments are conducted on a public vehicle Re-ID dataset which is the only one meeting the experiments requirements. The proposed approach achieves competitive performances.


Vehicle re-identification Spatiotemporal model Vehicle poses classifier 



The research was supported by National Nature Science Foundation of China (61572012, 61801335), Hubei Provincial Natural Science Foundation of China (2015CFB52, 2017CFA012).


  1. 1.
    Zheng, L., Yang, Y., Hauptmann, A.G.: Person re-identification: past, present and future. arXiv preprint arXiv:1610.02984 (2016)
  2. 2.
    Wang, Z., Hu, R., et al.: Statistical inference of gaussian-laplace distribution for person verification. In: ACM Proceedings of the 2017 ACM on Multimedia Conference (ACMMM), vol. 9, pp. 1609–1617 (2017)Google Scholar
  3. 3.
    Wang, Z., Ye, M., Yang, F., et al.: Cascaded SR-GAN for scale-adaptive low resolution person re-identification. In: Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI), vol. 18, pp. 3891–3897 (2018)Google Scholar
  4. 4.
    Wang, Z., Hu, R., Chen, C., et al.: Person re-identification via discrepancy matrix and matrix metric. IEEE Trans. Cybern. 48, 3006 (2017)CrossRefGoogle Scholar
  5. 5.
    Feris, R.S., et al.: Large-scale vehicle detection, indexing, and search in urban surveillance videos. IEEE Trans. Multimedia (TMM) 14, 28–42 (2012)CrossRefGoogle Scholar
  6. 6.
    Liu, X., Liu, W., Ma, H., Fu, H.: Large-scale vehicle re-identification in urban surveillance videos. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2016)Google Scholar
  7. 7.
    Liu, X., Liu, W., Mei, T., Ma, H.: A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 869–884. Springer, Cham (2016). Scholar
  8. 8.
    Liu, X., et al.: RAM: a region-aware deep model for vehicle re-identification. In: IEEE International Conference on Multimedia and Expo (ICME), arXiv preprint arXiv:1806.09283 (2018)
  9. 9.
    Liu, H., Tian, Y., Wang, Y., Pang, L., Huang, T.: Deep relative distance learning: tell the difference between similar vehicles. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2167–2175 (2016)Google Scholar
  10. 10.
    Wang, Z., et al.: Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification. In: IEEE International Conference on Computer Vision (ICCV), pp. 379–387 (2017)Google Scholar
  11. 11.
    Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circ. Syst. Video Technol. (TCSVT) 23, 311–325 (2013)CrossRefGoogle Scholar
  12. 12.
    Wen, Y., Lu, Y., Yan, J., Zhou, Z., von Deneen, K.M., Shi, P.: An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans. Intell. Transp. Syst. (TITS) 12, 830–845 (2011)CrossRefGoogle Scholar
  13. 13.
    Liu, X., Liu, W., Mei, T., Ma, H.: PROVID: progressive and multimodal vehicle re-identification for large-scale urban surveillance. IEEE Trans. Multimedia (TMM) 20, 645–658 (2018)CrossRefGoogle Scholar
  14. 14.
    Huang, W., Hu, R., Liang, C., Yu, Y., Wang, Z., Zhong, X., Zhang, C.: Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations. In: Tian, Q., Sebe, N., Qi, G.-J., Huet, B., Hong, R., Liu, X. (eds.) MMM 2016. LNCS, vol. 9516, pp. 174–186. Springer, Cham (2016). Scholar
  15. 15.
    Martinel, N., Foresti, G.L., Micheloni, C.: Person re-identification in a distributed camera network framework. IEEE Trans. Cybern. 47, 3530–3541 (2017)CrossRefGoogle Scholar
  16. 16.
    Javed, O., Shaque, K., Rasheed, Z., Shah, M.: Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views. Comput. Vis. Image Underst. (CVIU) 109, 146–162 (2008)CrossRefGoogle Scholar
  17. 17.
    Lv, J., Chen, W., Li, Q., Yang, C.: Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7948–7956 (2018)Google Scholar
  18. 18.
    Kettnaker, V., Zabih, R.: Bayesian multi-camera surveillance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPRW) vol. 2, p. 259 (1999)Google Scholar
  19. 19.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)Google Scholar
  20. 20.
    Zheng, Z., Zheng, L., Yang, Y.: A discriminatively learned CNN embedding for person re-identification. In: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 14, p. 13 (2017)Google Scholar
  21. 21.
    Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification. a benchmark. In: IEEE International Conference on Computer Vision (ICCV), pp. 1116–1124 (2015)Google Scholar
  22. 22.
    Liao, S., Hu, Y., Zhu, X., Li, S.: Person re-identification by local maximal occurrence representation and metric learning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2197–2206 (2015)Google Scholar
  23. 23.
    Yang, L., Luo, P., Loy, C.C., Tang, X.: A large-scale car dataset for fine-grained categorization and verification. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3973–3981 (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Xian Zhong
    • 1
  • Meng Feng
    • 1
  • Wenxin Huang
    • 1
    • 2
  • Zheng Wang
    • 3
  • Shin’ichi Satoh
    • 3
  1. 1.Wuhan University of TechnologyWuhanChina
  2. 2.Wuhan UniversityWuhanChina
  3. 3.National Institute of InformaticsTokyoJapan

Personalised recommendations