Skip to main content
SpringerLink
Log in

Vehicle identification using modified region based convolution network for intelligent transportation system

  • 1174: Futuristic Trends and Innovations in Multimedia Systems Using Big Data, IoT and Cloud Technologies (FTIMS)
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Intelligent transportation systems (ITS) are the integration of information and communications technologies with applications which are significant in traffic control and management. The increased number of on road vehicles in urban areas urges the need of development of automated methods for traffic management. Vehicle identification, classification and analysis enable the intelligent transportation systems to make decisions. In this paper, an automated method for video analysis for vehicle identification using a modified Region based Convolution Neural Network (RCNN) has been proposed. The traffic videos collected by CCTV cameras installed on the roads are analyzed for vehicle identification in a given frame. The pretrained google net is used to extract features. These features are used by the Region based Convolution Neural Network for vehicle identification. The vehicles are identified using probability score computed using intersection of objects (IoU). The identified vehicles are classified into ten different vehicle classes. The proposed network concatenates features from previous layers to reduce loss and consequently improve the vehicle identification accuracy. The vehicle identification method is further extended for vehicle counting and behavioral analysis. The vehicle counting information can be used for congestion control in smart cities. The behavioral analysis includes computation of speed of vehicles. The speed information is useful for traffic law enforcement in smart cities. The proposed method is applied on MIO-TCD vehicle dataset and EBVT video dataset. The results are calculated using three different metrics namely average accuracy, mean precision and mean recall. Obtained results are also compared with other state of the art methods. The results show significant improvement and thus the method can be effectively used for video analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Arinaldi A, Pradana JA, Gurusinga AA (2018) Detection and classification of vehicles for traffic video analytics. In: INNS Conference on Big Data and Deep Learning, Procedia Computer Science 144: 259–268.

  2. Atiq HM, Farooq U, Ibrahim R, Khalid O, Amar M (2010) Vehicle detection and shape recognition using optical sensors: a review. In 2010 Second International Conference on Machine Learning and Computing : 223–227

  3. Chen YL, Wu BF, Huang HY, Fan CJ (2010) A real-time vision system for nighttime vehicle detection and traffic surveillance. IEEE Transactions on Industrial Electronics 58(5):2030–2044

    Article  Google Scholar 

  4. Chen Z, Ellis T, Velastin SA (2012) Vehicle detection, tracking and classification in urban traffic. 15th International IEEE Conference on Intelligent Transportation Systems: 951–956

  5. Dong Z, Pei M, He Y, Liu T, Dong Y, Jia Y (2014) Vehicle type classification using unsupervised convolutional neural network. In Proceedings of the 22nd International Conference on Pattern Recognition : 172–177

  6. Dong Z, Wu Y, Pei M, Jia Y (2015) Vehicle type classification using a semisupervised convolutional neural network. IEEE Trans. Intell. Transport. Syst. 99:1–10

    Google Scholar 

  7. Gangodkar D, Kumar P, Mittal A (2012) Robust segmentation of moving vehicles under complex outdoor conditions. IEEE Trans intell transport syst 13(4):1738–1752

    Article  Google Scholar 

  8. Hilbert EE, Rennie PA, Kneidl WA (1980) A sensor for control of arterials and networks. IEEE Trans Vehicular Technol 29(2):208–215

    Article  Google Scholar 

  9. Jia Y, Zhang C (2009) Front-view vehicle detection by Markov chain Monte Carlo method. Pattern Recognition 42(3):313–321

    Article  MathSciNet  Google Scholar 

  10. Jung H, Choi MK, Jung J, Lee JH, Kwon S, Young Jung W (2017). ResNet-based vehicle classification and localization in traffic surveillance systems. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops: 61–67

  11. Kalaki AS, Safabakhsh R (2014) Current and adjacent lanes detection for an autonomous vehicle to facilitate obstacle avoidance using a monocular camera. In 2014 Iranian Conference on Intelligent Systems (ICIS): 1–6

  12. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems 1097–1105

  13. Laffont PY, Ren Z, Tao X, Qian C, Hays J (2014) Transient attributes for high-level understanding and editing of outdoor scenes. ACM Trans graph (TOG) 33(4):1–11

    Article  Google Scholar 

  14. Li Y, Li B, Tian B, Yao Q (2013a) Vehicle detection based on the and–or graph for congested traffic conditions. IEEE Trans Intell Transport Syst 14(2):984–993

    Article  Google Scholar 

  15. Li Y, Tian B, Li B, Xiong G, Zhu F, Wang K (2013b) Vehicle detection with a part-based model for complex traffic conditions. In Proceedings of 2013 IEEE International Conference on Vehicular Electronics and Safety: 110–113

  16. Luo Z, Branchaud-Charron F, Lemaire C, Konrad J, Li S, Mishra A, Jodoin PM (2018) MIO-TCD: A new benchmark dataset for vehicle classification and localization. IEEE Trans Image Process 27(10):5129–5141

    Article  MathSciNet  Google Scholar 

  17. Mandellos NA, Keramitsoglou I, Kiranoudis CT (2011) A background subtraction algorithm for detecting and tracking vehicles. Exp Syst Appl 38(3):1619–1631

    Article  Google Scholar 

  18. Mithun NC, Rashid NU, Rahman SM (2012) Detection and classification of vehicles from video using multiple time-spatial images. IEEE Trans Intell Transport Syst 13(3):1215–1225

    Article  Google Scholar 

  19. Moghaddam MJ, Hosseini M, Safabakhsh R (2015) Traffic light control based on fuzzy Q-leaming. In 2015 The International Symposium on Artificial Intelligence and Signal Processing (AISP) : 124–128.

  20. Pang CCC, Lam WWL, Yung NHC (2007) A method for vehicle count in the presence of multiple-vehicle occlusions in traffic images. IEEE Transactions on Intelligent Transportation Systems 8(3):441–459

    Article  Google Scholar 

  21. Rahman SMM (2015) https://mahbubur.buet.ac.bd/resources/DatabaseEBVT.htm

  22. Rashid NU, Mithun NC, Joy BR, Rahman SM (2010). Detection and classification of vehicles from a video using time-spatial image. In International Conference on Electrical & Computer Engineering :502–505

  23. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16):779–788.

  24. Ren S, He K, Girshick R, Sun J (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems: 91–99.

  25. Sharma P, Singh A (2017) Era of deep neural networks: A review. In 2017 8th International Conference on Computing, Communication and Networking Technologies (ICCCNT) :1–5

  26. Sharma P, Singh A, Raheja S, Singh KK (2019) Automatic vehicle detection using spatial time frame and object based classification. J Intell Fuzzy Syst, (Preprint), 1–11

  27. Sivaraman S, Trivedi MM (2009) Active learning based robust monocular vehicle detection for on-road safety systems. In 2009 IEEE intelligent vehicles symposium: 399–404

  28. Sutar VB, Admuthe LS (2012) Night time vehicle detection and classification using support vector machine. IOSR Journal of VLSI and Signal Processing 1(4):1–9

    Article  Google Scholar 

  29. Theagarajan R, Pala F, Bhanu B (2017) EDeN: Ensemble of deep networks for vehicle classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops : 33–40

  30. Unzueta L, Nieto M, Cortés A, Barandiaran J, Otaegui O, Sánchez P (2011) Adaptive multicue background subtraction for robust vehicle counting and classification. IEEE Transactions on Intelligent Transportation Systems 13(2):527–540

    Article  Google Scholar 

  31. Wang X, Zhang W, Wu X, Xiao L, Qian Y, Fang Z (2019) Real-time vehicle type classification with deep convolutional neural networks. Journal of Real-Time Image Processing 16(1):5–14

    Article  Google Scholar 

  32. Wu BF, Juang JH (2012) Adaptive vehicle detector approach for complex environments. IEEE Transactions on Intelligent Transportation Systems 13(2):817–827

    Article  Google Scholar 

  33. Yao Y, Xiong G, Wang K., Zhu F, Wang FY (2013) Vehicle detection method based on active basis model and symmetry in ITS. In 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013): 614–618.

  34. Zhang F, Li C, Yang F (2019) Vehicle detection in urban traffic surveillance images based on convolutional neural networks with feature concatenation. Sensors 594

  35. Zhou J, Gao D, Zhang D (2007) Moving vehicle detection for automatic traffic monitoring. IEEE trans vehicular technol 56(1):51–59

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of CSE, Amity University Haryana, Gurugram, India

    Poonam Sharma

  2. Department of CSE, The NorthCap University, Gurugram, India

    Poonam Sharma & Anuradha Dhull

  3. Department of CSE, ASET, Amity University, Noida, Uttar Pradesh, India

    Akansha Singh

  4. Department of ECE, KIET Group of Institutions, Delhi-NCR, Ghaziabad, India

    Krishna Kant Singh

Authors
  1. Poonam Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Akansha Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Krishna Kant Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anuradha Dhull
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Akansha Singh.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, P., Singh, A., Singh, K.K. et al. Vehicle identification using modified region based convolution network for intelligent transportation system. Multimed Tools Appl 81, 34893–34917 (2022). https://doi.org/10.1007/s11042-020-10366-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10366-x

Keywords

Search

Navigation