Deep Learning Based Vehicle Make-Model Classification

  • Burak Satar
  • Ahmet Emir DirikEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11141)


This paper studies the problem of vehicle make & model classification. Some of the main challenges are reaching high classification accuracy and reducing the annotation time of the images. To address these problems, we have created a fine-grained database using online vehicle marketplaces of Turkey. A pipeline is proposed to combine an SSD (Single Shot Multibox Detector) model with a CNN (Convolutional Neural Network) model to train on the database. In the pipeline, we first detect the vehicles by following an algorithm which reduces the time for annotation. Then, we feed them into the CNN model. It is reached approximately 4% better classification accuracy result than using a conventional CNN model. Next, we propose to use the detected vehicles as ground truth bounding box (GTBB) of the images and feed them into an SSD model in another pipeline. At this stage, it is reached reasonable classification accuracy result without using perfectly shaped GTBB. Lastly, an application is implemented in a use case by using our proposed pipelines which detects the unauthorized vehicles by comparing their license plate numbers and make & models. It is assumed that license plates are readable.


Deep learning Vehicle Model Classification CNN ResNet Detection SSD Fraud License plate 


  1. 1.
    Road motor vehicles (2018). Accessed 5 May 2018
  2. 2.
    Chang, S.L., Chen, L.S., Chung, Y.C., Chen, S.W.: Automatic license plate recognition. IEEE Trans. ITS 5(1), 42–53 (2004)Google Scholar
  3. 3.
    Ciocca, G., Napoletano, P., Schettini, R.: IAT - image annotation tool: Manual. CoRR (2015)Google Scholar
  4. 4.
    Dahms, C.: LPR. Accessed 5 May 2018
  5. 5.
    Dehghan, A., Masood, S.Z., Shu, G., Ortiz, E.G.: View independent vehicle make, model and color recognition using convolutional neural network. CoRR (2017)Google Scholar
  6. 6.
    Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. TCSVT 23(2), 311–325 (2013)Google Scholar
  7. 7.
    Everingham, M., Eslami, S.M.A., Van Gool, L., Williams, C.K.I., Winn, J.: The pascal visual object classes challenge: a retrospective. IJCV 111(1), 98–136 (2015)CrossRefGoogle Scholar
  8. 8.
    Gupte, S., Masoud, O., Martin, R.F.K., Papanikolopoulos, N.P.: Detection and classification of vehicles. IEEE Trans. ITS 3(1), 37–47 (2002)Google Scholar
  9. 9.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on CVPR, pp. 770–778 (2016)Google Scholar
  10. 10.
    LeCun, Y., Bengio, Y.: ConvNets for images, speech, and time series. In: The Handbook of Brain Theory and Neural Networks, pp. 255–258. MIT Press (1998)Google Scholar
  11. 11.
    Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). Scholar
  12. 12.
    Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). Scholar
  13. 13.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR (2014)Google Scholar
  14. 14.
    Tafazzoli, F., Frigui, H., Nishiyama, K.: A large and diverse dataset for improved vehicle make and model recognition. In: CVPRW, pp. 874–881 (2017)Google Scholar
  15. 15.
    Zhou, Y., Cheung, N.M.: Vehicle classification using transferable deep neural network features. CoRR (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Electrical-Electronics EngineeringUludag UniversityBursaTurkey
  2. 2.Department of Computer EngineeringUludag UniversityBursaTurkey

Personalised recommendations