Soft Computing

, Volume 22, Issue 7, pp 2403–2419 | Cite as

Convolutional neural networks-based intelligent recognition of Chinese license plates

  • Yujie Liu
  • He Huang
  • Jinde Cao
  • Tingwen Huang
Methodologies and Application


License plate recognition has gained extensive applications in many fields. Some interesting algorithms and models have been developed to deal with the issues in the location, segmentation and recognition processes. This paper focuses on the intelligent recognition of Chinese license plates with daily life backgrounds by designing new convolutional neural networks. Firstly, to extract Chinese license plates from the images subject to daily life backgrounds, which is more difficult than from those with fixed background, a color edge algorithm is proposed to detect specific edges of input image. A color-depressed grayscale conversion method is presented to preprocess plate samples with poor quality, and an improved relocation method is given to eliminate plate frames. Then a combination of connected component analysis and projection analysis is implemented for the segmentation. Finally, simplified and recurrent convolutional neural networks are designed to automatically recognize the characters (the first one is Chinese character, which is followed by six alphanumeric characters). A total of 2189 images containing Chinese license plates are collected manually with different backgrounds. Tested on these samples, the location rate of \(98.95\%\), segmentation rate of \(96.58\%\) and recognition rate of \(98.09\%\) are, respectively, achieved by our algorithms. The accuracy rate of recognition of Chinese license plates reaches \(93.74\%\), and it averagely takes 318 ms to complete the recognition of a license plate, which meets the real-time processing requirement.


Chinese license plate recognition Color edge Connected component analysis Simplified convolutional neural network Recurrent convolutional neural network 



This study was funded by the Qing Lan Project of Jiangsu Province, the National Natural Science Foundation of China under Grant Nos. 61273122 and 61573106, and the National Priority Research Project NPRP 8-274-2-107.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.


  1. Abolghasemi V, Ahmadyfard A (2009) An edge-based color-aided method for license plate detection. Image Vis Comput 27(8):1134–1142CrossRefGoogle Scholar
  2. Anagnostopoulos CNE, Anagnostopoulos IE, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans Intell Transp Syst 7(3):377–392CrossRefGoogle Scholar
  3. Ashtari AH, Nordin MdJ, Fathy M (2014) An Iranian license plate recognition system based on color features. IEEE Trans Intell Transp Syst 15(4):1690–1705CrossRefGoogle Scholar
  4. Bai H, Liu C (2003) A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of intelligent transportation systems, pp 985-987Google Scholar
  5. Cabido R, Montemayor AS, Pantrigo JJ (2012) High performance memetic algorithm particle filter for multiple object tracking on modern GPUs. Soft Comput 16(2):217–230CrossRefGoogle Scholar
  6. Chang CC, Lin D (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27. Software available at
  7. Chang SL, Chen LS, Chung YC, Chen SW (2004) Automatic license plate recognition. IEEE Trans Intell Transp Syst 5(1):42–53CrossRefGoogle Scholar
  8. Cho BK, Ryu SH, Shin DR, Jung JI (2011) License plate extraction method for identification of vehicle violations at a railway level crossing. Int J Automot Technol 12(2):281–289CrossRefGoogle Scholar
  9. Dashtban MH, Dashtban Z, Bevrani H (2011) A novel approach for vehicle license plate localization and recognition. Int J Comput Appl 26(11):22–30Google Scholar
  10. Du S, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325CrossRefGoogle Scholar
  11. EI-said SA (2015) Shadow aware license plate recognition system. Soft Comput 19(1):225–235CrossRefGoogle Scholar
  12. Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of international conference on artificial intelligence and statistics, vol 9, pp 249–256Google Scholar
  13. Guo JM, Liu YF (2008) License plate localization and character segmentation with feedback self-learning and hybrid binarization techniques. IEEE Trans Veh Technol 57(3):1417–1424CrossRefGoogle Scholar
  14. Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580
  15. Hsu GS, Chen JC, Chung YZ (2013) Application-oriented license plate recognition. IEEE Trans Veh Technol 62(2):552–561CrossRefGoogle Scholar
  16. Huang J, Li J, Yu D, Deng L, Gong Y (2013) Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In: Proceedings of international conference on acoustics, speech and signal processing, pp 7304–7308Google Scholar
  17. Jiao J, Ye Q, Huang Q (2009) A configurable method for multi-style license plate recognition. Pattern Recognit 42(3):358–369CrossRefzbMATHGoogle Scholar
  18. Jia W, Zhang H, He X, Piccardi M (2005) Mean shift for accurate license plate localization. In: Proceedings of the 8th international IEEE conference on intelligent transportation systems, pp 566–571Google Scholar
  19. Jin L, Xian H, Bie J (2012) License plate recognition algorithm for passenger cars in Chinese residential areas. Sensors 12(6):8355–8370CrossRefGoogle Scholar
  20. Jung K (2001) Neural network-based text location in color images. Pattern Recognit Lett 22(14):1503–1515CrossRefzbMATHGoogle Scholar
  21. Kanayama K, Fujikawa Y, Fujimoto K, Horino M (1991) Development of vehicle-license number recognition system using real-time image processing and its application to travel-time measurement. In: Proceedings of IEEE vehicle technology conference, pp 798–804Google Scholar
  22. Kasaei SH, Kasaei SM, Kasaei SA (2010) New morphology based method for robust Iranian car plate detection and recognition. Int J Comput Theory Eng 2(2):264–268CrossRefzbMATHGoogle Scholar
  23. Kim K-B, Cho J-H (2007) Recognition of identifiers from shipping container images using fuzzy binarization and enhanced fuzzy RBF network. Soft Comput 11:213–220CrossRefGoogle Scholar
  24. Kim I, Xie X (2015) Handwritten Hangul recognition using deep convolutional neural networks. Int J Doc Anal Recognit 18:1–13CrossRefGoogle Scholar
  25. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRefGoogle Scholar
  26. Li W, Liang D, Wang X, Yu D (2004) Character segmentation for degraded license plate. J Computer-aided Des Comput Graph 16(5):698–703Google Scholar
  27. Liu Y, Huang H (2015) Car plate character recognition using a convolutional neural network with shared hidden layers. In: Proceedings of the 2015 Chinese automation congress, pp 638–643Google Scholar
  28. Moon H-M, Seo CH, Pan SB (2016) A face recognition system based on convolution neural network using multiple distance face. Soft Comput. doi: 10.1007/s00500-016-2095-0 Google Scholar
  29. Moreira-Matias L, Cats O, Gama J, Mendes-Moreira J, de Sousa JF (2016) An online learning approach to eliminate Bus Bunching in real-time. Appl Soft Comput 47:460–482CrossRefGoogle Scholar
  30. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern SMC 9(1):62–66MathSciNetCrossRefGoogle Scholar
  31. Rasooli M, Branch T, Ghofrani S, Fatemizadeh E (2011) Farsi license plate detection based on element analysis and characters recognition. Int J Signal Process Image Process Pattern Recognit 4(1):65–80Google Scholar
  32. Rouhani M, Javan DS (2016) Two fast and accurate heuristic RBF learning rules for data classification. Neural Netw 75:150–161CrossRefGoogle Scholar
  33. Sulehria HK, Zhang Y, Irfan D, Sulehria AK (2008) Vehicle number plate recognition using mathematical morphology and neural networks. WSEAS Trans Comput 7(6):781–790Google Scholar
  34. Wang F, Man L, Wang B, Xiao Y, Pan W, Lu X (2008) Fuzzy-based algorithm for color recognition of license plates. Pattern Recognit Lett 29(7):1007–1020CrossRefGoogle Scholar
  35. Wang M, Chen Y, Wang X (2014) Recognition of handwritten characters in Chinese legal amounts by stacked autoencoders. In: Proceedings of international conference on pattern recognition, pp 3002–3007Google Scholar
  36. Wen Y, Lu Y, Shi PF (2007) Handwritten Bangla numeral recognition system and its application to postal automation. Pattern Recognit 40(1):99–107CrossRefzbMATHGoogle Scholar
  37. Wen Y, Lu Y, Yan J, Zhou Z, von Deneen KM, Shi PF (2011) An algorithm for license plate recognition applied to intelligent transportation system. IEEE Trans Intell Transp Syst 12(3):830–835CrossRefGoogle Scholar
  38. Wu C, Fan W, He Y, Sun J, Naoi S (2014) Handwritten character recognition by alternately trained relaxation convolutional neural network. In: Proceedings of international conference on frontiers in handwriting recognition, pp 291–296Google Scholar
  39. Yao Y, Rosasco L, Caponnetto A (2007) On early stopping in gradient descent learning. Constr Approx 26(2):289–315MathSciNetCrossRefzbMATHGoogle Scholar
  40. Zhang Y, Zhang C (2003) A new algorithm for character segmentation of license plate. In: IEEE intelligent vehicles symposium, pp 106–109Google Scholar
  41. Zheng D, Zhao Y, Wang J (2005) An efficient method of license plate location. Pattern Recognit Lett 26:2431–2438CrossRefGoogle Scholar
  42. Zhou W, Li H, Lu Y, Tian Q (2012) Principal visual word discovery for automatic license plate detection. IEEE Trans Image Process 21(9):4269–4279MathSciNetCrossRefzbMATHGoogle Scholar
  43. Zunino R, Rovetta S (2000) Vector quantization for license-plate location and image coding. IEEE Trans Ind Electron 47(1):159–167CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.School of Electronics and Information EngineeringSoochow UniversitySuzhouPeople’s Republic of China
  2. 2.School of MathematicsSoutheast UniversityNanjingPeople’s Republic of China
  3. 3.Department of MathematicsKing Abdulaziz UniversityJeddahSaudi Arabia
  4. 4.Texas A&M University at QatarDohaQatar

Personalised recommendations