Abstract
Despite their initial success in operating autonomously, self-driving cars are still unable to navigate under severe weather conditions. In the proposed system, a multi-layer perceptron (MLP) performs initial traffic sign classification. The classification is input as an observation into a partially observable Markov decision process (POMDP) in order to determine whether taking another picture of the sign, or accepting the classification determined by the MLP is the more optimal action. The synergistic combination of the MLP with the POMDP was shown to have a greater functionality than the sum of the MLP and POMDP operating in isolation. The results demonstrate the MLP-POMDP system is capable of training faster and more accurately classifying traffic sign images obscured by fog than a MLP. With further development of this model, one of the greatest shortcomings of autonomous driving may be overcome by accurately classifying signs despite obstruction by weather.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Baró, X., Escalera, S., Vitrià, J., Pujol, O., Radeva, P.: Traffic sign recognition using evolutionary adaboost detection and forest-ECOC classification. IEEE Trans. Intell. Transp. Syst. 10(1), 113–126 (2009)
Cireşan, D., Meier, U., Masci, J., Schmidhuber, J.: Multi-column deep neural network for traffic sign classification. Neural Netw. 32, 333–338 (2012)
Daugman, J.G.: Uncertainity relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. J. Opt. Soc. Am. 2(7), 1160–1169 (1985)
De la Escalera, A., Armingol, J.M., Mata, M.: Traffic sign recognition and analysis for intelligent vehicles. Image Vis. Comput. 21, 247–258 (2003)
La Escalera, D., Moreno, L.E., Salichs, M.A., Armingol, J.M.: Road traffic sign detection and classification. IEEE Trans. Ind. Electron 44(6), 848–859 (1997)
Egmont-Petersen, M., de Ridder, D., Handels, H.: Image processing with neural networks—a review. Pattern Recogn. 35(10), 2279–2301 (2002)
Gomes, L.: Hidden Obstacles for Google’s Self-Driving Cars, 28 August 2014. http://www.technologyreview.com/news/530276/hidden-obstacles-for-googles-self-driving-cars/. Accessed 4 May 2015
Lawrence, S., Giles, C.L., Tsoi, A.C., Back, A.D.: Face recognition: a convolutional neural-network approach. IEEE Trans. Neural Netw. 8(1), 98–113 (1997)
LeCun, Y., Bengio, Y.: Convolutional networks for images, speech, and time series. In: The handbook of Brain Theory and Neural Networks, 3361, 310 (1995)
Marčelja, S.: Mathematical description of the responses of simple cortical cells. J. Opt. Soc. Am. 70(11), 1297–1300 (1980)
Paclık, P., Novovičová, J., Pudil, P., Somol, P.: Road sign classification using Laplace kernel classifier. Pattern Recogn. Lett. 21(13), 1165–1173 (2000)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Pearson, New York (2010)
Urmson, C.: The latest chapter for the self-driving car: Mastering city street driving, 28 April 2008. http://googleblog.blogspot.com/2014/04/the-latest-chapter-for-self-driving-car.html. Accessed 4 May 2015
Zaklouta, F., Stanciulescu, B., Hamdoun, O.: Traffic sign classification using K-d trees and random forests. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 2151–2155. IEEE, July 2011
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Shahryari, S., Hamilton, C. (2016). Neural Network-POMDP-Based Traffic Sign Classification Under Weather Conditions. In: Khoury, R., Drummond, C. (eds) Advances in Artificial Intelligence. Canadian AI 2016. Lecture Notes in Computer Science(), vol 9673. Springer, Cham. https://doi.org/10.1007/978-3-319-34111-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-34111-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-34110-1
Online ISBN: 978-3-319-34111-8
eBook Packages: Computer ScienceComputer Science (R0)