Skip to main content
SpringerLink
Log in

Convolutional neural networks-based intelligent recognition of Chinese license plates

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

License plate recognition has gained extensive applications in many fields. Some interesting algorithms and models have been developed to deal with the issues in the location, segmentation and recognition processes. This paper focuses on the intelligent recognition of Chinese license plates with daily life backgrounds by designing new convolutional neural networks. Firstly, to extract Chinese license plates from the images subject to daily life backgrounds, which is more difficult than from those with fixed background, a color edge algorithm is proposed to detect specific edges of input image. A color-depressed grayscale conversion method is presented to preprocess plate samples with poor quality, and an improved relocation method is given to eliminate plate frames. Then a combination of connected component analysis and projection analysis is implemented for the segmentation. Finally, simplified and recurrent convolutional neural networks are designed to automatically recognize the characters (the first one is Chinese character, which is followed by six alphanumeric characters). A total of 2189 images containing Chinese license plates are collected manually with different backgrounds. Tested on these samples, the location rate of \(98.95\%\), segmentation rate of \(96.58\%\) and recognition rate of \(98.09\%\) are, respectively, achieved by our algorithms. The accuracy rate of recognition of Chinese license plates reaches \(93.74\%\), and it averagely takes 318 ms to complete the recognition of a license plate, which meets the real-time processing requirement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  • Abolghasemi V, Ahmadyfard A (2009) An edge-based color-aided method for license plate detection. Image Vis Comput 27(8):1134–1142

    Article  Google Scholar 

  • Anagnostopoulos CNE, Anagnostopoulos IE, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans Intell Transp Syst 7(3):377–392

    Article  Google Scholar 

  • Ashtari AH, Nordin MdJ, Fathy M (2014) An Iranian license plate recognition system based on color features. IEEE Trans Intell Transp Syst 15(4):1690–1705

    Article  Google Scholar 

  • Bai H, Liu C (2003) A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of intelligent transportation systems, pp 985-987

  • Cabido R, Montemayor AS, Pantrigo JJ (2012) High performance memetic algorithm particle filter for multiple object tracking on modern GPUs. Soft Comput 16(2):217–230

    Article  Google Scholar 

  • Chang CC, Lin D (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm

  • Chang SL, Chen LS, Chung YC, Chen SW (2004) Automatic license plate recognition. IEEE Trans Intell Transp Syst 5(1):42–53

    Article  Google Scholar 

  • Cho BK, Ryu SH, Shin DR, Jung JI (2011) License plate extraction method for identification of vehicle violations at a railway level crossing. Int J Automot Technol 12(2):281–289

    Article  Google Scholar 

  • Dashtban MH, Dashtban Z, Bevrani H (2011) A novel approach for vehicle license plate localization and recognition. Int J Comput Appl 26(11):22–30

    Google Scholar 

  • Du S, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325

    Article  Google Scholar 

  • EI-said SA (2015) Shadow aware license plate recognition system. Soft Comput 19(1):225–235

    Article  Google Scholar 

  • Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of international conference on artificial intelligence and statistics, vol 9, pp 249–256

  • Guo JM, Liu YF (2008) License plate localization and character segmentation with feedback self-learning and hybrid binarization techniques. IEEE Trans Veh Technol 57(3):1417–1424

    Article  Google Scholar 

  • Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580

  • Hsu GS, Chen JC, Chung YZ (2013) Application-oriented license plate recognition. IEEE Trans Veh Technol 62(2):552–561

    Article  Google Scholar 

  • Huang J, Li J, Yu D, Deng L, Gong Y (2013) Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In: Proceedings of international conference on acoustics, speech and signal processing, pp 7304–7308

  • Jiao J, Ye Q, Huang Q (2009) A configurable method for multi-style license plate recognition. Pattern Recognit 42(3):358–369

    Article  MATH  Google Scholar 

  • Jia W, Zhang H, He X, Piccardi M (2005) Mean shift for accurate license plate localization. In: Proceedings of the 8th international IEEE conference on intelligent transportation systems, pp 566–571

  • Jin L, Xian H, Bie J (2012) License plate recognition algorithm for passenger cars in Chinese residential areas. Sensors 12(6):8355–8370

    Article  Google Scholar 

  • Jung K (2001) Neural network-based text location in color images. Pattern Recognit Lett 22(14):1503–1515

    Article  MATH  Google Scholar 

  • Kanayama K, Fujikawa Y, Fujimoto K, Horino M (1991) Development of vehicle-license number recognition system using real-time image processing and its application to travel-time measurement. In: Proceedings of IEEE vehicle technology conference, pp 798–804

  • Kasaei SH, Kasaei SM, Kasaei SA (2010) New morphology based method for robust Iranian car plate detection and recognition. Int J Comput Theory Eng 2(2):264–268

    Article  MATH  Google Scholar 

  • Kim K-B, Cho J-H (2007) Recognition of identifiers from shipping container images using fuzzy binarization and enhanced fuzzy RBF network. Soft Comput 11:213–220

    Article  Google Scholar 

  • Kim I, Xie X (2015) Handwritten Hangul recognition using deep convolutional neural networks. Int J Doc Anal Recognit 18:1–13

    Article  Google Scholar 

  • LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  • Li W, Liang D, Wang X, Yu D (2004) Character segmentation for degraded license plate. J Computer-aided Des Comput Graph 16(5):698–703

    Google Scholar 

  • Liu Y, Huang H (2015) Car plate character recognition using a convolutional neural network with shared hidden layers. In: Proceedings of the 2015 Chinese automation congress, pp 638–643

  • Moon H-M, Seo CH, Pan SB (2016) A face recognition system based on convolution neural network using multiple distance face. Soft Comput. doi:10.1007/s00500-016-2095-0

    Google Scholar 

  • Moreira-Matias L, Cats O, Gama J, Mendes-Moreira J, de Sousa JF (2016) An online learning approach to eliminate Bus Bunching in real-time. Appl Soft Comput 47:460–482

    Article  Google Scholar 

  • Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern SMC 9(1):62–66

    Article  MathSciNet  Google Scholar 

  • Rasooli M, Branch T, Ghofrani S, Fatemizadeh E (2011) Farsi license plate detection based on element analysis and characters recognition. Int J Signal Process Image Process Pattern Recognit 4(1):65–80

    Google Scholar 

  • Rouhani M, Javan DS (2016) Two fast and accurate heuristic RBF learning rules for data classification. Neural Netw 75:150–161

    Article  Google Scholar 

  • Sulehria HK, Zhang Y, Irfan D, Sulehria AK (2008) Vehicle number plate recognition using mathematical morphology and neural networks. WSEAS Trans Comput 7(6):781–790

    Google Scholar 

  • Wang F, Man L, Wang B, Xiao Y, Pan W, Lu X (2008) Fuzzy-based algorithm for color recognition of license plates. Pattern Recognit Lett 29(7):1007–1020

    Article  Google Scholar 

  • Wang M, Chen Y, Wang X (2014) Recognition of handwritten characters in Chinese legal amounts by stacked autoencoders. In: Proceedings of international conference on pattern recognition, pp 3002–3007

  • Wen Y, Lu Y, Shi PF (2007) Handwritten Bangla numeral recognition system and its application to postal automation. Pattern Recognit 40(1):99–107

    Article  MATH  Google Scholar 

  • Wen Y, Lu Y, Yan J, Zhou Z, von Deneen KM, Shi PF (2011) An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans Intell Transp Syst 12(3):830–835

    Article  Google Scholar 

  • Wu C, Fan W, He Y, Sun J, Naoi S (2014) Handwritten character recognition by alternately trained relaxation convolutional neural network. In: Proceedings of international conference on frontiers in handwriting recognition, pp 291–296

  • Yao Y, Rosasco L, Caponnetto A (2007) On early stopping in gradient descent learning. Constr Approx 26(2):289–315

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang Y, Zhang C (2003) A new algorithm for character segmentation of license plate. In: IEEE intelligent vehicles symposium, pp 106–109

  • Zheng D, Zhao Y, Wang J (2005) An efficient method of license plate location. Pattern Recognit Lett 26:2431–2438

    Article  Google Scholar 

  • Zhou W, Li H, Lu Y, Tian Q (2012) Principal visual word discovery for automatic license plate detection. IEEE Trans Image Process 21(9):4269–4279

    Article  MathSciNet  MATH  Google Scholar 

  • Zunino R, Rovetta S (2000) Vector quantization for license-plate location and image coding. IEEE Trans Ind Electron 47(1):159–167

    Article  Google Scholar 

Download references

Acknowledgements

This study was funded by the Qing Lan Project of Jiangsu Province, the National Natural Science Foundation of China under Grant Nos. 61273122 and 61573106, and the National Priority Research Project NPRP 8-274-2-107.

Author information

Authors and Affiliations

  1. School of Electronics and Information Engineering, Soochow University, Suzhou, 215006, People’s Republic of China

    Yujie Liu & He Huang

  2. School of Mathematics, Southeast University, Nanjing, 210096, People’s Republic of China

    Jinde Cao

  3. Department of Mathematics, King Abdulaziz University, Jeddah, 21589, Saudi Arabia

    Jinde Cao

  4. Texas A&M University at Qatar, Doha, 5825, Qatar

    Tingwen Huang

Authors
  1. Yujie Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. He Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jinde Cao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tingwen Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to He Huang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Y., Huang, H., Cao, J. et al. Convolutional neural networks-based intelligent recognition of Chinese license plates. Soft Comput 22, 2403–2419 (2018). https://doi.org/10.1007/s00500-017-2503-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2503-0

Keywords

Search

Navigation