Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 24, pp 35585–35606 | Cite as

License plate detection for multi-national vehicles – a generalized approach

  • Muhammad Rizwan Asif
  • Chun QiEmail author
  • Tiexiang Wang
  • Muhammad Sadiq Fareed
  • Subhan Khan
Article
  • 39 Downloads

Abstract

License plate detection for vehicle identification is one of the key problems for traffic surveillance in urban areas. Most of the existing methods that can handle multiple license plates are country-specific as color information has been typically targeted. In this paper, we propose a real-time multiple license plate detection method feasible for multi-national vehicles having variable colors, sizes and geometrical attributes. A region-of-interest is initially identified for each vehicle using a fuzzy inference system based on the salient feature of its rear lights as license plates generally exist in a vicinity of these lights. Due to the abundance of edges within the license plate region, a local recursive analysis approach is utilized to locate the license plate candidate within each region-of-interest after tilt correction using a rear-light alignment technique. To verify the detected region as a true license plate, a unique combination of local image features is used to achieve high precision. The proposed method has been tested on 2200 images taken during various weather and illumination conditions to detect 5379 license plates out of 5945 available vehicles with 90.5% accuracy. The proposed approach outperforms the conventional and deep learning methods to achieve superior performance with the ability of being applied to multi-national vehicles.

Keywords

Intelligent vision system License plate detection Local image features Multi-national vehicles Vehicle identification Vehicle rear lights 

Notes

Acknowledgments

The authors would like to thank Dr. Bin Tian from Institute of Automation, Chinese Academy of Sciences, Beijing, China for providing the dataset for experimentation.

Author contributions

Conceptualization, Muhammad Rizwan Asif; methodology, Muhammad Rizwan Asif; software, Muhammad Rizwan Asif and Tiexiang Wang; validation, Muhammad Sadiq Fareed and Subhan Khan; formal analysis, Muhammad Sadiq Fareed and Subhan Khan; resources, Chun Qi; data writing—original draft preparation, Muhammad Rizwan Asif; writing—review and editing, Muhammad Rizwan Asif and Chun Qi; supervision, Chun Qi; funding acquisition, Chun Qi.

Funding

This research is supported by the National Natural Science Foundation of China (Grant No. 61572395 and 61675161).

Compliance with ethical standards

Conflict of interest

The authors declare no conflict of interest.

References

  1. 1.
    Asif MR, Chun Q, Hussain S, Fareed MS (2016) Multiple license plate detection for Chinese vehicles in dense traffic scenarios. IET Intell Transp Syst 10(8):535–544CrossRefGoogle Scholar
  2. 2.
    Asif MR, Chun Q, Hussain S, Fareed MS, Khan S (2017) Multinational vehicle license plate detection in complex backgrounds. J Vis Commun Image Represent 46:176–186CrossRefGoogle Scholar
  3. 3.
    Bai X, Zhang T, Wang C, El-Latif AAA, Niu X (2013) A fully automatic player detection method based on one-class SVM. IEICE Trans Inf Syst E96.D(2):387–391CrossRefGoogle Scholar
  4. 4.
    Chao G, Kunfeng W, Yanjie Y, Zhengxi L (2016) Vehicle license plate recognition based on extremal regions and restricted Boltzmann machines. IEEE Trans Intell Transp Syst 17(4):1096–1107CrossRefGoogle Scholar
  5. 5.
    Chu J, Guo Z, Leng L (2018) Object detection based on multi-layer convolution feature fusion and online hard example mining. IEEE Access 6:19959–19967CrossRefGoogle Scholar
  6. 6.
    Jing H, He X, Han Q, El-Latif AAA, Niu X (2014) Saliency detection based on integrated features. Neurocomputing 129:114–121CrossRefGoogle Scholar
  7. 7.
    Jingyu D, Sanyuan Z, Xiuzi Y, Yin Z (2015) Chinese license plate localization in multi-lane with complex background based on concomitant colors. IEEE Intell Transp Syst Mag 7(3):51–61CrossRefGoogle Scholar
  8. 8.
    Jo A, Jang GJ, Han B (2015) Occlusion detection using horizontally segmented windows for vehicle tracking. Multimed Tools Appl 74(1):227–243.  https://doi.org/10.1007/s11042-013-1846-5 CrossRefGoogle Scholar
  9. 9.
    Kang YK, Kim H, Heo G, Song SY (2017) Diagnosis of feedwater heater performance degradation using fuzzy inference system. Expert Syst Appl 69:239–246CrossRefGoogle Scholar
  10. 10.
    Kim SG, Jeon HG, Koo HI (2017) Deep-learning-based license plate detection method using vehicle region extraction. Electron Lett 53(15):1034–1036CrossRefGoogle Scholar
  11. 11.
    Le, TS, Tran VN, Hamamoto K (2014) A robust and flexible license plate detection method. Proc IEEE Intl Conf Advanced Technologies Communication, p 326-331Google Scholar
  12. 12.
    Li H, Yang R, Chen X (2017) License plate detection using convolutional neural network. IEEE Intl Conf Comp Comm:1736–1740Google Scholar
  13. 13.
    Li J, Liang X, Shen S, Xu T, Feng J, Yan S (2018) Scale-aware fast R-CNN for pedestrian detection. IEEE Trans Multimedia 20(4):985–996Google Scholar
  14. 14.
    Li-Hung W, Chao-Kai C, Chung-Bin W (2014) A real-time architecture of multiple features extraction for vehicle verification. Proc IEEE Asia Pacific Conf Circuits Systems, p 615–618Google Scholar
  15. 15.
    Peng J, Li Q, El-Latif AAA, Wang N, Niu X (2013) Finger vein recognition with Gabor wavelets and local binary patterns. IEICE Trans Inf Syst E96.D(8):1886–1889CrossRefGoogle Scholar
  16. 16.
    Peng J, Wang N, El-Latif AAA, Li Q, Niu X Finger-vein verification using Gabor filter and SIFT feature matching. Eighth Intl Conf Intell Inf Hiding and Multimed Sig Proc, p 45-48.Google Scholar
  17. 17.
    Prabhakar P, Anupama P (2014) A novel design for vehicle license plate detection and recognition. Proc IEEE 2nd Intl Conf Current Trends in Engineering and Technology, p 7–12.Google Scholar
  18. 18.
    Runmin W, Nong S, Rui H, Yuehuan W (2014) License plate detection using gradient information and cascade detectors. Optik 125(1):186–190CrossRefGoogle Scholar
  19. 19.
    Shi Z, Yu L, El-Latif AAA, Niu X Skeleton modulated topological perception map for rapid viewpoint selection. IEICE Trans Inf Syst E95.D(10):2585–2588CrossRefGoogle Scholar
  20. 20.
    Tian B, Li Y, Li B, Wen D (2014) Rear-view vehicle detection and tracking by combining multiple parts for complex urban surveillance. IEEE Intell Transp Syst Mag 15(2):597–606CrossRefGoogle Scholar
  21. 21.
    Vladimir T, Miodrag P, Peter O (2016) Fuzzified Gabor filter for license plate detection. Eng Appl Artif Intell 48:40–58CrossRefGoogle Scholar
  22. 22.
    Wang N, Li Q, El-Latif AAA, Peng J, Niu X (2014) An enhanced thermal face recognition method based on multiscale complex fusion for Gabor coefficients. Multimed Tools Appl 72:2339–2358CrossRefGoogle Scholar
  23. 23.
    Wang H, Xu M, Zhua F, Deng Z, Li Y, Zhou B (2018) Shadow traffic: a unified model for abnormal traffic behavior simulation. Comput Graph 70:235–241CrossRefGoogle Scholar
  24. 24.
    Xie L, Ahmad T, Jin L, Liu Y, Zhang S (2018) A new CNN-based method for multi-directional car license plate detection. IEEE Trans Intell Transp Syst 19(2):507–517CrossRefGoogle Scholar
  25. 25.
    Yang S, Xu J, Chen Y et al (2014) On-road vehicle tracking using keypoint-based representation and online co-training. Multimed Tools Appl 72(2):1561–1583.  https://doi.org/10.1007/s11042-013-1453-5 CrossRefGoogle Scholar
  26. 26.
    Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. Proc Euro Conf Comp Vis, p 818–833.Google Scholar
  27. 27.
    Zeng D, Zhu M (2018) Multiscale fully convolutional network for foreground object detection in infrared videos. IEEE Geosci Remote Sens Lett 15(4):617–621CrossRefGoogle Scholar
  28. 28.
    Zhang Q, Wan C, Han W (2018) A modified faster region-based convolutional neural network approach for improved vehicle detection performance. Multimed Tools Appl.  https://doi.org/10.1007/s11042-018-6769-8 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Electronics and Information EngineeringXi’an Jiaotong UniversityXi’anPeople’s Republic of China
  2. 2.Department of EngineeringAarhus UniversityAarhus NDenmark
  3. 3.School of Mechanical and Manufacturing EngineeringUniversity of New South Wales (UNSW)SydneyAustralia

Personalised recommendations