Abstract
In vision-driven Intelligent Transportation Systems (ITS) where cameras play a vital role, accurate detection and re-identification of vehicles are fundamental demands. Hence, recent approaches have employed a wide range of algorithms to provide the best possible accuracy. These methods commonly generate a vehicle detection model based on its visual appearance features such as license-plate, headlights or some other distinguishable specifications. Among different object detection approaches, Deep Neural Networks (DNNs) have the advantage of magnificent detection accuracy in case a huge amount of training data is provided. In this paper, a robust approach for license-plate detection based on YOLO v.3 is proposed which takes advantage of high detection accuracy and real-time performance. The mentioned approach can detect the license-plate location of vehicles as a general representation of vehicle presence in images. To train the model, a dataset of vehicle images with Iranian license-plates has been generated by the authors and augmented to provide a wider range of data for test and train purposes. It should be mentioned that the proposed method can detect the license-plate area as an indicator of vehicle presence with no Optical Character Recognition (OCR) algorithm to distinguish characters inside the license-plate. Experimental results have shown the high performance of the system with precision 0.979 and recall 0.972.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhu, F., Li, Z., Chen, S., Xiong, G.: Parallel Transportation Management and Control System and Its Applications in Building Smart Cities. IEEE Trans. Intell. Transp. Syst. 17, 1576–1585 (2016). https://doi.org/10.1109/TITS.2015.2506156
Zhang, J., Wang, F.Y., Wang, K., et al.: Data-driven intelligent transportation systems: a survey. IEEE Trans. Intell. Transp. Syst. 12, 1624–1639 (2011). https://doi.org/10.1109/TITS.2011.2158001
Bommes, M., Fazekas, A., Volkenhoff, T., Oeser, M.: Video based intelligent transportation systems - state of the art and future development. Transp. Res. Procedia 14, 4495–4504 (2016). https://doi.org/10.1016/j.trpro.2016.05.372
Tian, B., Yao, Q., Gu, Y., et al.: Video processing techniques for traffic flow monitoring: a survey. IEEE Conference on Intelligent Transportation Systems Proceedings, ITSC, pp. 1103–1108 (2011). https://doi.org/10.1109/ITSC.2011.6083125
O’Mahony, N., et al.: Deep learning vs. traditional computer vision. In: Arai, K., Kapoor, S. (eds.) CVC 2019. AISC, vol. 943, pp. 128–144. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-17795-9_10
Pouyanfar, S., Sadiq, S., Yan, Y., et al.: A survey on deep learning: algorithms, techniques, and applications. ACM Comput. Surv. 51 (2018). https://doi.org/10.1145/3234150
Deng, L.: A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Trans. Signal Inf. Process. 3 (2014). https://doi.org/10.1017/atsip.2013.9
Hatt, M., Parmar, C., Qi, J., El Naqa, I.: Machine (deep) learning methods for image processing and radiomics. IEEE Trans. Radiat. Plasma Med. Sci. 3, 104–108 (2019). https://doi.org/10.1109/trpms.2019.2899538
Zeiler, M.D., Fergus, R.: Visualizing and Understanding Convolutional Neural Networks, pp. 1–9 (2012)
Aloysius, N., Geetha, M.: A review on deep convolutional neural networks. In: Proceedings of the 2017 IEEE International Conference on Communication and Signal Processing ICCSP 2017, January 2018, pp. 588–592 (2018). https://doi.org/10.1109/ICCSP.2017.8286426
Uijlings, J.R.R., Van De Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. Int. J. Comput. Vis. 104, 154–171 (2013). https://doi.org/10.1007/s11263-013-0620-5
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014). https://doi.org/10.1109/CVPR.2014.81
Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, December 2016, pp. 779–788 (2016). https://doi.org/10.1109/CVPR.2016.91
Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, January 2017, pp. 6517–6525 (2017). https://doi.org/10.1109/CVPR.2017.690
Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement (2018). https://arxiv.org/abs/1804.02767
Shin, J.S., Kim, U.T., Lee, D.K., et al.: Real-time vehicle detection using deep learning scheme on embedded system. In: International Conference on Ubiquitous and Future Networks, ICUFN, Milan, pp 272–274 (2017)
Huval, B., Wang, T., Tandon, S., et al.: An empirical evaluation of deep learning on highway driving (2015). http://arxiv.org/abs/1504.01716
Wang, J.G., Zhou, L., Pan, Y., et al.: Appearance-based brake-lights recognition using deep learning and vehicle detection. In: IEEE Intelligent Vehicles Symposium Proceedings, August 2016, pp. 815–820 (2016). https://doi.org/10.1109/IVS.2016.7535481
Hsu, S.C., Huang, C.L., Chuang, C.H.: Vehicle detection using simplified fast R-CNN. In: 2018 International Workshop on Advanced Image Technology, IWAIT 2018, pp. 1–3 (2018). https://doi.org/10.1109/IWAIT.2018.8369767
Zhang, Q., Wan, C., Han, W.: A modified faster region-based convolutional neural network approach for improved vehicle detection performance. Multimedia Tools Appl. 78(20), 29431–29446 (2018). https://doi.org/10.1007/s11042-018-6769-8
Wang, L., Liao, J., Xu, C.: Vehicle detection based on drone images with the improved faster R-CNN. In: ACM International Conference Proceeding Series Part F 148150, pp. 466–471 (2019). https://doi.org/10.1145/3318299.3318383
Kim, S.G., Jeon, H.G., Koo, H.I.: Deep-learning-based license plate detection method using vehicle region extraction. Electron. Lett. 53, 1034–1036 (2017). https://doi.org/10.1049/el.2017.1373
Selmi, Z., Ben Halima, M., Alimi, A.M.: Deep learning system for automatic license plate detection and recognition. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, vol. 1, pp. 1132–1138 (2018). https://doi.org/10.1109/ICDAR.2017.187
Silva, S.M., Jung, C.R.: Real-time Brazilian license plate detection and recognition using deep convolutional neural networks. In: Proceedings of the 30th Conference on Graphics, Patterns and Images, SIBGRAPI 2017, pp. 55–62 (2017). https://doi.org/10.1109/SIBGRAPI.2017.14
Abdullah, S., Mahedi Hasan, M., Muhammad Saiful Islam, S.: YOLO-based three-stage network for Bangla license plate recognition in Dhaka metropolitan city. In: 2018 International Conference on Bangla Speech and Language Processing ICBSLP (2018). https://doi.org/10.1109/ICBSLP.2018.8554668
Puarungroj, W., Boonsirisumpun, N.: Thai license plate recognition based on deep learning. Procedia Comput. Sci. 135, 214–221 (2018). https://doi.org/10.1016/j.procs.2018.08.168
Tourani, A., Soroori, S., Shahbahrami, A., et al.: A robust vehicle detection approach based on faster R-CNN algorithm. In: 4th International Conference on Pattern Recognition and Image Analysis IPRIA 2019, pp. 119–123 (2019). https://doi.org/10.1109/PRIA.2019.8785988
Dutta, A., Zisserman, A.: The VIA annotation software for images, audio and video. In: MM 2019 – Proceedings of the 27th ACM International Conference on Multimedia, pp. 2276–2279 (2019). https://doi.org/10.1145/3343031.3350535
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Khazaee, S., Tourani, A., Soroori, S., Shahbahrami, A., Suen, C.Y. (2020). A Real-Time License Plate Detection Method Using a Deep Learning Approach. In: Lu, Y., Vincent, N., Yuen, P.C., Zheng, WS., Cheriet, F., Suen, C.Y. (eds) Pattern Recognition and Artificial Intelligence. ICPRAI 2020. Lecture Notes in Computer Science(), vol 12068. Springer, Cham. https://doi.org/10.1007/978-3-030-59830-3_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-59830-3_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59829-7
Online ISBN: 978-3-030-59830-3
eBook Packages: Computer ScienceComputer Science (R0)