Advertisement

Simplified Neural Networks with Smart Detection for Road Traffic Sign Recognition

  • Wei-Jong Yang
  • Chia-Chun Luo
  • Pau-Choo Chung
  • Jar-Ferr YangEmail author
Conference paper
First Online:
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 69)

Abstract

Improving driver’s safety is the main goal of the advanced driver assistance system, which has been widely deployed for proactive driving security in recent years. For road driving, the advanced driver assistance system should visually recognize circular prohibition and triangular warning traffic signs to help drivers to grab complete traffic conditions. In this paper, we proposed a low-computation neural assistance system for traffic sign recognition. First, we proposed shaped-based detection algorithms to detect the regions, which are with circle and triangular traffic signs in designated regions of interest. For classification to those detected regions, we then suggest a convolutional neural network to achieve about 5% improvement of top 1 accuracy compared with LeNet model in German traffic sign recognition benchmarks dataset. For real applications, we also establish a Taiwanese traffic sign database to train the proposed neural network. The simulation results on self-collect driving videos demonstrate that the proposed traffic sign recognition system achieved above 97% recognition rate can be effectively adopted in ADAS applications.

Keywords

Advanced driver assistance system Traffic sign detection Traffic sign recognition Convolutional neural network 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

This work was supported by the Ministry of Science and Technology, Taiwan, under Grant MOST 105-2221-E-006-065-MY3.

References

  1. 1.
    Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012)CrossRefGoogle Scholar
  2. 2.
    Sermanet, P., LeCun, Y.: Traffic sign recognition with multi-scale convolutional networks. In: International Joint Conference on Neural Networks, pp. 2809–2813 (2011)Google Scholar
  3. 3.
    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)Google Scholar
  4. 4.
    Fleyeh, H.: Color detection and segmentation for road and traffic signs. In: IEEE Conference on Cybernetics and Intelligent Systems, vol. 2, pp. 809–814 (2004)Google Scholar
  5. 5.
    Bahlmann, C., Zhu, Y., Ramesh, V., Pellkofer, M., Koehler, T.: A system for traffic sign detection, tracking, and recognition using color, shape, and motion information. In: Proceedings of the Intelligent Vehicles Symposium, pp. 255–260 (2005)Google Scholar
  6. 6.
    Maldonado-Bascón, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gómez-Moreno, H., López-Ferreras, F.: Road-sign detection and recognition based on support vector machines. IEEE Trans. Intell. Transp. Syst. 8(2), 264–278 (2007)CrossRefGoogle Scholar
  7. 7.
    Shadeed, W., Abu-Al-Nadi, D.I., Mismar, M.J.: Road traffic sign detection in color images. In: 2003 Proceedings of the IEEE International Conference on Electronics, Circuits and Systems, vol. 2, pp. 890–893 (2003)Google Scholar
  8. 8.
    Loy, G., Barnes, N.: Fast shape-based road sign detection for a driver assistance system. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, pp. 70–75 (2004)Google Scholar
  9. 9.
    Barnes, N., Zelinsky, A., Fletcher, L.S.: Real-time speed sign detection using the radial symmetry detector. IEEE Trans. Intell. Transp. Syst. 9(2), 322–332 (2008)CrossRefGoogle Scholar
  10. 10.
    Kim, S., Kim, S., Uh, Y., Byun, H.: Color and shape feature-based detection of speed sign in real-time. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp. 663–666 (2012)Google Scholar
  11. 11.
    Adam, A., Ioannidis, C.: Automatic road sign detection and classification based on support vector machines and HOG descriptorsGoogle Scholar
  12. 12.
    Overett, G., Petersson, L.: Large scale sign detection using HOG feature variants. In: IEEE Intelligent Vehicles Symposium IV, pp. 326–331 (2011)Google Scholar
  13. 13.
    Greenhalgh, J., Mirmehdi, M.: Real-time detection and recognition of road traffic signs. IEEE Trans. Intell. Transp. Syst. 13(4), 1498–1506 (2012)CrossRefGoogle Scholar
  14. 14.
    Xiao, Z., Yang, Z., Geng, L., Zhang, F.: Traffic sign detection based on histograms of oriented gradients and Boolean convolutional neural networks. In: International Conference on Machine Vision and Information Technology, pp. 111–115 (2017)Google Scholar
  15. 15.
    Zaklouta, F., Stanciulescu, B.: Real-time traffic-sign recognition using tree classifiers. IEEE Trans. Intell. Transp. Syst. 13(4), 1507–1514 (2012)CrossRefGoogle Scholar
  16. 16.
    Zaklouta, F., Stanciulescu, B., Hamdoun, O.: Traffic sign classification using k-d trees and random forests. In: International Joint Conference on Neural Networks, pp. 2151–2155 (2011)Google Scholar
  17. 17.
    Greenhalgh, J., Mirmehdi, M.: Traffic sign recognition using MSER and random forests. In: Proceedings of the European Signal Processing Conference (EUSIPCO), pp. 1935–1939 (2012)Google Scholar
  18. 18.
    Xu, Y., Wang, Q., Wei, Z., Ma, S.: Traffic sign recognition based on weighted ELM and AdaBoost. Electron. Lett. 52(24), 1988–1990 (2016)CrossRefGoogle Scholar
  19. 19.
    Kouzani, A.Z.: Road-sign identification using ensemble learning. In: IEEE Intelligent Vehicles Symposium, pp. 438–443 (2007)Google Scholar
  20. 20.
    Yang, Y., Luo, H., Xu, H., Wu, F.: Towards real-time traffic sign detection and classification. IEEE Trans. Intell. Transp. Syst. 17(7), 2022–2031 (2016)CrossRefGoogle Scholar
  21. 21.
    Hu, W., Zhuo, Q., Zhang, C., Li, J.: Fast branch convolutional neural network for traffic sign recognition. IEEE Intell. Transp. Syst. Mag. 9(3), 114–126 (2017)CrossRefGoogle Scholar
  22. 22.
    NVIDIA, Deep Learning GPU Training System NVIDIA DIGITS. https://github.com/NVIDIA/DIGITS
  23. 23.
    Caffe: a fast open framework for deep learning. https://github.com/BVLC/caffe
  24. 24.
    Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: The German traffic sign recognition benchmark: a multi-class classification competition. In: International Joint Conference on Neural Networks, pp. 1453–1460 (2011)Google Scholar
  25. 25.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
  26. 26.
    Qian, R., Yue, Y., Coenen, F., Zhang, B.: Traffic sign recognition with convolutional neural network based on max pooling positions. In: International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, pp. 578–582 (2016)Google Scholar
  27. 27.
    Jin, J., Fu, K., Zhang, C.: Traffic sign recognition with hinge loss trained convolutional neural networks. IEEE Trans. Intell. Transp. Syst. 15(5), 1991–2000 (2014)CrossRefGoogle Scholar
  28. 28.
    Abedin, Z., Dhar, P., Hossenand, M.K., Deb, K.: Traffic sign detection and recognition using fuzzy segmentation approach and artificial neural network classifier respectively. In: International Conference on Electrical, Computer and Communication Engineering, pp. 518–523 (2017)Google Scholar
  29. 29.
    Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., Hu, S.: Traffic-sign detection and classification in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2110–2118 (2016)Google Scholar
  30. 30.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Computer Vision and Pattern Recognition, vol. 1, pp. 886–893 (2005)Google Scholar
  31. 31.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  32. 32.
    Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Wei-Jong Yang
    • 1
  • Chia-Chun Luo
    • 1
  • Pau-Choo Chung
    • 1
  • Jar-Ferr Yang
    • 1
    Email author
  1. 1.Department of Electrical Engineering, Institute of Computer and Communication EngineeringNational Cheng Kung UniversityTainanTaiwan

Personalised recommendations

Cite paper

Buy options