Skip to main content
SpringerLink
Log in

A review on various methodologies used for vehicle classification, helmet detection and number plate recognition

  • Special Issue
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

Vehicle detection and classification has been an area of application of image processing and machine learning which is being researched extensively in accordance with its importance due to increasing number of vehicles, traffic rule defaulters and accidents. This paper aims to review various methodologies used and how it has evolved to give better results in the past years, closely moving towards usage of machine learning. This has resulted in advancing the problem statement towards helmet detection followed by number plate detection of defaulters. Object detection and Text recognition that are available in various frameworks offer built-in models which are easy to use or offer easy methods to build and train customized models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Lei M, Lefloch D, Gouton P, Madani K (2008) A video-based real-time vehicle counting system using adaptive background method. In: IEEE international conference on signal image technology and internet based systems (SITIS’08), pp 523–528

  2. O’Mahony N et al (2020) Deep learning vs. traditional computer vision. In: Arai K, Kapoor S (eds) Advances in computer vision. CVC 2019. Advances in intelligent systems and computing, vol 943. Springer, Cham

    Google Scholar 

  3. Kato S, Takeuchi E, Ishiguro Y, Ninomiya Y, Takeda K, Hamada T (2015) An open approach to autonomous vehicles. IEEE Micro 35(6):60–68. https://doi.org/10.1109/MM.2015.133

    Article  Google Scholar 

  4. Ojha S, Sakhare S (2015) Image processing techniques for object tracking in video surveillance—a survey. In: 2015 international conference on pervasive computing (ICPC), Pune, pp 1–6. https://doi.org/10.1109/PERVASIVE.2015.7087180.

  5. Gonzales R, Woods R (1992) Digital image processing. Addison-Wesley Publishing Company, Boston, pp 81–125

    Google Scholar 

  6. Liu F, Koenig H (2010) A survey of video encryption algorithms. Comput Secur 29(1):3–15

    Article  Google Scholar 

  7. Culjak I, Abram D, Pribanic T, Dzapo H, Cifrek M (2012) A brief introduction to OpenCV. In: 2012 proceedings of the 35th international convention MIPRO, Opatija, pp 1725–1730

  8. Cheung S-Y, Varaiya PP (2006) Traffic surveillance by wireless sensor networks: final report. PhD diss., University of California at Berkeley

  9. Oh S, Ritchie S, Oh C (2002) Real-time traffic measurement from single loop inductive signatures. Transp Res Rec J Transp Res Board 1804:98–106

    Article  Google Scholar 

  10. Coifman B (2006) Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J Transp Eng 132(3):213–226

    Article  Google Scholar 

  11. Tursun M, Amrulla G (2013) A video based real-time vehicle counting system using optimized virtual loop method. In: IEEE 8th international workshop on systems signal processing and their applications (WoSSPA)

  12. Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision

  13. Mithun NC, Rashid NU, Rahman SM (2012) Detection and classification of vehicles from video using multiple time-spatial images. IEEE Trans Intell Transp Syst 13(3):1215–1225

    Article  Google Scholar 

  14. Boonsirisumpun N, Puarungroj W,Wairotchanaphuttha P (2018) Automatic detector for bikers with no helmet using deep learning. In: 2018 22nd international computer science and engineering conference (ICSEC), Chiang Mai, Thailand, pp 1–4

  15. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of the advances in neural information processing systems (NIPS), Lake Tahoe, Nevada, United States, 3–6 December 2012, pp 1097–1105

  16. Kumar S, Balyan A, Chawla M (2017) Object detection and recognition in images. Int J Eng Dev Res 5(4):1029–1034

    Google Scholar 

  17. Ren S, He K, Girshick RB, Sun J (2015) Faster R-CNN: towards real time object detection with region proposal networks. In: Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, December 7–12, 2015, Montreal, Quebec, Canada, pp 91–99

  18. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788

  19. Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu C, Berg AC (2016) SSD: single shot multibox detector. In: Computer vision—ECCV 2016—14th European conference, Amsterdam, The Netherlands, October 11–14, 2016, proceedings, part I, pp 21–37

  20. Lin T, Goyal P, Girshick RB, He K, Doll’ar P (2017) Focal loss for dense object detection. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2999–3007

  21. Tekleyohannes MK, Weis C, When N, Klein M, Siegrist M (2018) A reconfigurable accelerator for morphological operations. In: 2018 IEEE international parallel and distributed processing symposium workshops (IPDPSW), Vancouver, BC

  22. Charouh Z, Ghogho M, Guennoun Z (2019) Improved background subtraction-based moving vehicle detection by optimizing morphological operations using machine learning. In: 2019 IEEE international symposium on innovations in intelligent systems and applications (INISTA), Sofia, Bulgaria, pp 1–6

  23. Singh D, Vishnu C, Mohan CK (2016) Visual big data analytics for traffic monitoring in smart city. In: Proceedings of the IEEE conference on machine learning and application (ICMLA), Anaheim, California, 18–20 December 2016

  24. Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

    MATH  Google Scholar 

  25. Annavarapu JK (2015) Statistical feature selection for image texture analysis. Int Res J Eng Technol 2:546–550

    Google Scholar 

  26. Babayan PV, Ershov MD, Erokhin DY (2019) Neural network-based vehicle and pedestrian detection for video analysis system. In: 2019 8th mediterranean conference on embedded computing (MECO), Budva, Montenegro, pp 1–5

  27. Prajwal M, Tejas K, Varshad V, Mahesh M, Shashidhar R (2019) A Review on helmet detection by using image processing and convolutional neural networks. Int J Comput Appl 182:52–55. https://doi.org/10.5120/ijca2019918770

    Article  Google Scholar 

  28. Prajwal MJ, Tejas B, Varshad V, Mahesh M, Shashidhar R (2019) Detection of non-helmet riders and extraction of license plate number using Yolo v2 and OCR method. Int J Comput Appl 9:5167–5172. https://doi.org/10.35940/iji-tee.B6527.129219

    Article  Google Scholar 

  29. Baruah A, Kandali AB (2018) Pedestrian detection on OpenCV and TensorFlow. Int J Res Anal Rev 5(2):1–4

    Google Scholar 

  30. Memon S, Bhatti S, Ali L, Talpur M, Memon M (2018) A video based vehicle detection, counting and classification system. Int J Image Graph Signal Process 9:34–41

    Article  Google Scholar 

  31. Vapnik VN (1998) Statistical learning theory. Wiley, New York

    MATH  Google Scholar 

  32. Friedman N, Russell S (1997) Image segmentation in video sequences: a probabilistic approach. In: Proceedings of the thirteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc

  33. Contractorr D, Pathak K, Sharma S, Bhagat S, Sharma T (2016) Cascade classifier based helmet detection using OpenCV in image processing

  34. Gururaj V, Shriya VR, Ashwini K (2019) Stock market prediction using linear regression and support vector machines. Int J Appl Eng Res 14(8):1931–1934

    Google Scholar 

  35. Dahiya K, Singh D, Mohan CK (2016) Automatic detection of bike-riders without helmet using surveillance videos in real-time. In: 2016 international joint conference on neural networks (IJCNN), Vancouver, BC, pp 3046–3051

  36. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 886–893

  37. Lowe DG (1999) Object recognition from local scale-invariant features. In: Computer vision, seventh IEEE international conference

  38. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  39. Chiverton J (2012) Helmet presence classification with motorcycle detection and tracking. IET Intell Transp Syst 6(3):259–269. https://doi.org/10.1049/ietits.2011.0138

    Article  MathSciNet  Google Scholar 

  40. Silva R, Aires K, Santos T, Abdala K, Veras R, Soares A (2013) Automatic detection of motorcyclists without helmet. In: 2013 XXXIX Latin American computing conference (CLEI), Naiguata, pp 1–7

  41. Doungmala P, Klubsuwan K (2016) Helmet wearing detection in Thailand using haar like feature and circle hough transform on image processing. In: 2016 IEEE international conference on computer and information technology (CIT), Nadi, pp 611–614. https://doi.org/10.1109/CIT.2016.87.

  42. Vishnu C, Singh D, Mohan CK, Babu S (2017) Detection of motorcyclists without helmet in videos using convolutional neural network. In: 2017 international joint conference on neural networks (IJCNN), Anchorage, AK, pp 3036–3041

  43. Raj KCD, Chairat A, Timtong V, Dailey MN, Ekpanyapong M (2018) Helmet violation processing using deep learning. In: 2018 international workshop on advanced image technology (IWAIT), Chiang Mai, pp 1–4. https://doi.org/10.1109/IWAIT.2018.8369734

  44. Mistry J, Misraa AK, Agarwal M, Vyas A, Chudasama VM, Upla KP (2017) An automatic detection of helmeted and non-helmeted motorcyclist with license plate extraction using convolutional neural network. In: 2017 seventh international conference on image processing theory, tools and applications (IPTA), Montreal, QC, pp 1–6. https://doi.org/10.1109/IPTA.2017.8310092.

  45. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions (2014). arXiv preprint arXiv:1409.4842, 7

  46. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

  47. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  48. Li K, Zhao X, Bian J, Tan M (2017) Automatic safety helmet wearing detection. In: 2017 IEEE 7th annual international conference on CYBER technology in automation, control, and intelligent systems (CYBER), Honolulu, HI, pp 617–622

  49. Rattapoom W, Nannaphat B, Vasan T, Chainarong T, Pattanawadee P (2013) Machine vision techniques for motorcycle safety helmet detection. In: Proceedings of the international conference on image and vision computing New Zealand (IVCNZ), Wellington, New Zealand, 27–29 November 2013, pp 35–40

  50. Li J et al (2017) Safety helmet wearing detection based on image processing and machine learning. In: 2017 ninth international conference on advanced computational intelligence (ICACI), Doha, pp 201–205. https://doi.org/10.1109/ICACI.2017.7974509

  51. Long X, Cui W, Zheng Z (2019) Safety helmet wearing detection based on deep learning. In: 2019 IEEE 3rd information technology, networking, electronic and automation control conference (ITNEC).https://doi.org/10.1109/itnec.2019.8729039

  52. Marayatr T, Kumhom P (2014) Motorcyclist’s helmet wearing detection using image processing. Adv Mater Res 931–932:588–592. https://doi.org/10.4028/www.scientific.net/AMR.931-932.588

    Article  Google Scholar 

  53. Goyal A, Bhatia R (2016) Automated car number plate detection system to detect far number plates. IOSR J Comput Eng 18(4):34–40

    Article  Google Scholar 

  54. Qadri MT, Asif M (2009) Automatic number plate recoginization system for vehicle identification using optical character recoginization. In: 2009 international conference on education technology and computer

  55. Kuldeepak MK, Vashishath M (2012) License plate recognition system based on image processing using labview. Int J Electron Commun Comput Technol 2(4):183

    Google Scholar 

  56. Kulkarni Y, Bodkhe S, Kamthe A, Patil A (2018) Automatic number plate recognition for motorcyclists riding without helmet. In: 2018 international conference on current trends towards converging technologies (ICCTCT), Coimbatore, pp 1–6. https://doi.org/10.1109/ICCTCT.2018.8551001

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Global Academy of Technology, Bengaluru, India

    S. Sanjana, S. Sanjana, V. R. Shriya, Gururaj Vaishnavi & K. Ashwini

Authors
  1. S. Sanjana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Sanjana
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V. R. Shriya
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gururaj Vaishnavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. K. Ashwini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Ashwini.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sanjana, S., Sanjana, S., Shriya, V.R. et al. A review on various methodologies used for vehicle classification, helmet detection and number plate recognition. Evol. Intel. 14, 979–987 (2021). https://doi.org/10.1007/s12065-020-00493-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-020-00493-7

Keywords

Search

Navigation