Convolutional neural networks-based intelligent recognition of Chinese license plates
- 924 Downloads
License plate recognition has gained extensive applications in many fields. Some interesting algorithms and models have been developed to deal with the issues in the location, segmentation and recognition processes. This paper focuses on the intelligent recognition of Chinese license plates with daily life backgrounds by designing new convolutional neural networks. Firstly, to extract Chinese license plates from the images subject to daily life backgrounds, which is more difficult than from those with fixed background, a color edge algorithm is proposed to detect specific edges of input image. A color-depressed grayscale conversion method is presented to preprocess plate samples with poor quality, and an improved relocation method is given to eliminate plate frames. Then a combination of connected component analysis and projection analysis is implemented for the segmentation. Finally, simplified and recurrent convolutional neural networks are designed to automatically recognize the characters (the first one is Chinese character, which is followed by six alphanumeric characters). A total of 2189 images containing Chinese license plates are collected manually with different backgrounds. Tested on these samples, the location rate of \(98.95\%\), segmentation rate of \(96.58\%\) and recognition rate of \(98.09\%\) are, respectively, achieved by our algorithms. The accuracy rate of recognition of Chinese license plates reaches \(93.74\%\), and it averagely takes 318 ms to complete the recognition of a license plate, which meets the real-time processing requirement.
KeywordsChinese license plate recognition Color edge Connected component analysis Simplified convolutional neural network Recurrent convolutional neural network
This study was funded by the Qing Lan Project of Jiangsu Province, the National Natural Science Foundation of China under Grant Nos. 61273122 and 61573106, and the National Priority Research Project NPRP 8-274-2-107.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
- Bai H, Liu C (2003) A hybrid license plate extraction method based on edge statistics and morphology. In: Proceedings of intelligent transportation systems, pp 985-987Google Scholar
- Chang CC, Lin D (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
- Dashtban MH, Dashtban Z, Bevrani H (2011) A novel approach for vehicle license plate localization and recognition. Int J Comput Appl 26(11):22–30Google Scholar
- Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of international conference on artificial intelligence and statistics, vol 9, pp 249–256Google Scholar
- Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580
- Huang J, Li J, Yu D, Deng L, Gong Y (2013) Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. In: Proceedings of international conference on acoustics, speech and signal processing, pp 7304–7308Google Scholar
- Jia W, Zhang H, He X, Piccardi M (2005) Mean shift for accurate license plate localization. In: Proceedings of the 8th international IEEE conference on intelligent transportation systems, pp 566–571Google Scholar
- Kanayama K, Fujikawa Y, Fujimoto K, Horino M (1991) Development of vehicle-license number recognition system using real-time image processing and its application to travel-time measurement. In: Proceedings of IEEE vehicle technology conference, pp 798–804Google Scholar
- Li W, Liang D, Wang X, Yu D (2004) Character segmentation for degraded license plate. J Computer-aided Des Comput Graph 16(5):698–703Google Scholar
- Liu Y, Huang H (2015) Car plate character recognition using a convolutional neural network with shared hidden layers. In: Proceedings of the 2015 Chinese automation congress, pp 638–643Google Scholar
- Rasooli M, Branch T, Ghofrani S, Fatemizadeh E (2011) Farsi license plate detection based on element analysis and characters recognition. Int J Signal Process Image Process Pattern Recognit 4(1):65–80Google Scholar
- Sulehria HK, Zhang Y, Irfan D, Sulehria AK (2008) Vehicle number plate recognition using mathematical morphology and neural networks. WSEAS Trans Comput 7(6):781–790Google Scholar
- Wang M, Chen Y, Wang X (2014) Recognition of handwritten characters in Chinese legal amounts by stacked autoencoders. In: Proceedings of international conference on pattern recognition, pp 3002–3007Google Scholar
- Wu C, Fan W, He Y, Sun J, Naoi S (2014) Handwritten character recognition by alternately trained relaxation convolutional neural network. In: Proceedings of international conference on frontiers in handwriting recognition, pp 291–296Google Scholar
- Zhang Y, Zhang C (2003) A new algorithm for character segmentation of license plate. In: IEEE intelligent vehicles symposium, pp 106–109Google Scholar