Fine-Grained Vehicle Recognition in Traffic Surveillance

  • Qi Wang
  • Zhongyuan WangEmail author
  • Jing Xiao
  • Jun Xiao
  • Wenbin Li
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9916)


Fine-grained vehicle recognition in traffic surveillance plays a crucial part in establishing intelligent transportation system. The major challenge lies in that differences among vehicle models are always subtle. In this paper, we propose a part-based method combining global and local feature for fine-grained vehicle recognition in traffic surveillance. We develop a novel voting mechanism to unify the preliminary recognition results, which are obtained by using Histograms of Oriented Gradients (HOG) and pre-trained convolutional neural networks (CNN), leading to fully exploiting the discriminative ability of different parts. Besides, we collect a comprehensive public database for 50 common vehicle models with manual annotation of parts, which is used to evaluate the proposed method and serves as supportive dataset for related work. The experiments show that the average recognition accuracy of our method can approach 92.3 %, which is 3.4 %–7.1 % higher than the state-of-art approaches.


Fine-grained vehicle recognition CNN feature Discriminative parts Fine-grained vehicle dataset 



This work was partly supported by the National Natural Science Foundation of China (61502348), the EU FP7 QUICK project under Grant Agreement No. PIRSES-GA-2013-612652, China Postdoctoral Science Foundation funded project (2014M562058), Scientific Research Foundation for the Returned Overseas Chinese Scholars, State Education Ministry ([2014]1685), the Fundamental Research Funds for the Central Universities (2042016gf0033), Natural Science Fund of Hubei Province (2015CFB406).


  1. 1.
    Wah, C., Branson, S., Welinder, P., Perona, P., Belongie, S.: The caltech-UCSD birds-200-2011 dataset (2011)Google Scholar
  2. 2.
    Parkhi, O.M., Vedaldi, A., Zisserman, A., Jawahar, C.V.: Cats and dogs. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3498–3505 (2012)Google Scholar
  3. 3.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  4. 4.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 886–893 (2005)Google Scholar
  5. 5.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  6. 6.
    Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 806–813 (2014)Google Scholar
  7. 7.
    Yang, L., Luo, P., Change Loy, C., Tang, X.: A large-scale car dataset for fine-grained categorization and verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3973–3981 (2015)Google Scholar
  8. 8.
    Sünderhauf, N., McCool, C., Upcroft, B., Perez, T.: Fine-grained plant classification using convolutional neural networks for feature extraction. In: CLEF (Working Notes), pp. 756–762 (2014)Google Scholar
  9. 9.
    Zhang, N., Farrell, R., Iandola, F., Darrell, T.: Deformable part descriptors for fine-grained recognition and attribute prediction. In: IEEE International Conference on Computer Vision, pp. 729–736 (2013)Google Scholar
  10. 10.
    Krause, J., Jin, H., Yang, J., Fei-Fei, L.: Fine-grained recognition without part annotations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5546–5555 (2015)Google Scholar
  11. 11.
    Deng, J., Krause, J., Fei-Fei, L.: Fine-grained crowdsourcing for fine-grained recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2013)Google Scholar
  12. 12.
    Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intelle. 32(9), 1627–1645 (2010)CrossRefGoogle Scholar
  13. 13.
    Azizpour, H., Laptev, I.: Object detection using strongly-supervised deformable part models. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 836–849. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-33718-5_60 CrossRefGoogle Scholar
  14. 14.
    Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia, pp. 675–678 (2014)Google Scholar
  15. 15.
    Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., Darrell, T.: DeCAF: a deep convolutional activation feature for generic visual recognition. arXiv preprint arXiv:1310.1531 (2013)
  16. 16.
    Krause, J., Stark, M., Deng, J., Fei-Fei, L.: 3D object representations for fine-grained categorization. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 554–561 (2013)Google Scholar
  17. 17.
    Liao, L., Hu, R., Xiao, J., Wang, Q., Xiao, J., Chen, J.: Exploiting effects of parts in fine-grained categorization of vehicles. In: IEEE International Conference on Image Processing, pp. 745–749 (2015)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Qi Wang
    • 1
    • 2
  • Zhongyuan Wang
    • 1
    • 2
    • 3
    Email author
  • Jing Xiao
    • 1
    • 2
    • 3
  • Jun Xiao
    • 2
  • Wenbin Li
    • 2
  1. 1.State Key Laboratory of Software EngineeringWuhan UniversityWuhanChina
  2. 2.National Engineering Research Center for Multimedia SoftwareComputer School of Wuhan UniversityWuhanChina
  3. 3.Hubei Provincial Key Laboratory of Multimedia and Network Communication EngineeringWuhan UniversityWuhanChina

Personalised recommendations