Multiple thresholding and subspace based approach for detection and recognition of traffic sign

Abstract

Automatic detection and recognition of traffic sign has been a topic of great interest in advanced driver assistance system. It enhances vehicle and driver safety by providing the condition and state of the road to the drivers. However, visual occlusion and ambiguities in the real-world scenario make the traffic sign recognition a challenging task. This paper presents an Automatic Traffic Sign Detection and Recognition (ATSDR) system, involving three modules: segmentation, detection, and recognition. Region of Interest (ROI) is extracted using multiple thresholding schemes with a novel environmental selection strategy. Then, the traffic sign detection is carried out using correlation computation between log-polar mapped inner regions and the reference template. Finally, recognition is performed using Support Vector Machine (SVM) classifier. Our proposed system achieved a recognition accuracy of 98.3 % and the experimental results demonstrates the robustness of traffic sign detection and recognition in real-world scenario.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

References

  1. 1.

    Alsibai M, Hirai Y (2010) Real-time recognition of blue traffic signs designating directions. Int J Intell Transp Syst Res 8(2):96–105

    Google Scholar 

  2. 2.

    Barnes N, Zelinsky A, Fletcher L (2008) Real-time speed sign detection using the radial symmetry detector. IEEE Trans Intell Transp Syst 9(2):322–332

    Article  Google Scholar 

  3. 3.

    Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396

    Article  MATH  Google Scholar 

  4. 4.

    Boumediene M, Cudel C, Basset M, Ouamri A (2013) Triangular traffic signs detection based on rsld algorithm. Mach Vis Appl 24(8):1721–1732

    Article  Google Scholar 

  5. 5.

    Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167

    Article  Google Scholar 

  6. 6.

    Cai D, He X, Zhou K, Han J Bao H (2007) Locality sensitive discriminant analysis. In: Proceedings of the 20th international joint conference on artifical intelligence. Hyderabad, India, pp 708–713

  7. 7.

    Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27:1–27:27. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm

    Article  Google Scholar 

  8. 8.

    Ciresan D, Meier U, Masci J, Schmidhuber J (2011) A committee of neural networks for traffic sign classification. In: The 2011 international joint conference on neural networks, San Jose, pp 1918–1921

  9. 9.

    Duda RO, Hart PE, Stork DG (2000) Pattern classification, 2nd edn. Wiley-Interscience

  10. 10.

    Escalera S, Pujol O, Radeva P (2010) Traffic sign recognition system with ß -correction. Mach Vis Appl 21(2):99–111

    Article  Google Scholar 

  11. 11.

    Fang X, Xu Y, Li X, Fan Z, Liu H, Chen Y (2014) Locality and similarity preserving embedding for feature selection. Neurocomputing 128:304–315

    Article  Google Scholar 

  12. 12.

    Fleyeh H, Davami E (2011) Eigen-based traffic sign recognition. IET Intell Transp Syst 5(3):190–196

    Article  Google Scholar 

  13. 13.

    Gamec J, Urdzík D, Gamcová M (2012) Algorithm of traffic signs recognition based on the rapid transform. Cent Eur J Comput Sci 2(3):236–244

    Google Scholar 

  14. 14.

    Gao XW, Podladchikova L, Shaposhnikov D, Hong K, Shevtsova N (2006) Recognition of traffic signs based on their colour and shape features extracted using human vision models. J Vis Commun Image Represent 17(4):675–685

    Article  Google Scholar 

  15. 15.

    Gil Jiménez P, Bascón SM, Moreno HG, Arroyo SL, Ferreras FL (2008) Traffic sign shape classification and localization based on the normalized fft of the signature of blobs and 2d homographies. Signal Process 88(12):2943–2955

    Article  MATH  Google Scholar 

  16. 16.

    Gómez-Moreno H, Maldonado-Bascón S, Gil-Jiménez P, Lafuente-Arroyo S (2010) Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans Intell Transp Syst 11(4):917–930

    Article  Google Scholar 

  17. 17.

    Greenhalgh J, Mirmehdi M (2012) Real-time detection and recognition of road traffic signs. IEEE Trans Intell Transp Syst 13(4):1498–1506

    Article  Google Scholar 

  18. 18.

    Gu Y, Yendo T, Tehrani M, Fujii T Tanimoto M (2011) Traffic sign detection in dual-focal active camera system. In: Intelligent vehicles symposium (IV), Germany, pp 1054–1059

  19. 19.

    Gudigar A, Jagadale B,Mahesh P K, Raghavendra U (2012) Kernel based automatic traffic sign detection and recognition using svm. In: Eco-friendly computing and communication systems, vol 305, India, pp 153–161

  20. 20.

    Gudigar A, Chokkadi S, Raghavendra U (2016) A review on automatic detection and recognition of traffic sign. Multimed Tools Appl 75(1):333–364

    Article  Google Scholar 

  21. 21.

    Han PY, Jin ATB, Abas FS (2009) Neighbourhood preserving discriminant embedding in face recognition. J Vis Commun Image Represent 20(8):532–542

  22. 22.

    He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Proceedings of the 10th IEEE international conference on computer vision, vol 2, Beijing, pp 1208–1213

  23. 23.

    Houben S, Stallkamp J, Salmen J, Schlipsing M, Igel C (2013) Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: Proceedings of IEEE international joint conference on neural networks, USA, p 1288

  24. 24.

    Jalba AC, Roerdink JBTM, Wilkinson MHF (2003) Morphological hat-transform scale spaces and their use in texture classification. Pattern Recogn 37:901–915

    Article  Google Scholar 

  25. 25.

    Javier Traver V, Bernardino A (2010) A review of log-polar imaging for visual perception in robotics. Robot Auton Syst 58(4):378–398

  26. 26.

    Kehtarnavaz N, Ahmad A (1995) Traffic sign recognition in noisy outdoor scenes. In: Proceedings of the intelligent vehicles ’95 symposium, Detroit, pp 460–465

  27. 27.

    Khan JF, Bhuiyan SMA, Adhami RR (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96

    Article  Google Scholar 

  28. 28.

    Kuo WJ, Lin CC (2007) Two-stage road sign detection and recognition. In: IEEE international conference on multimedia and expo, China, pp 1427–1430

  29. 29.

    Lafuente-Arroyo S, Salcedo-Sanz S, Maldonado-Bascón S, Portilla-Figueras J, López-Sastre R (2010) A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems. Expert Syst Appl 37(1):767–773

    Article  Google Scholar 

  30. 30.

    Liu H, Liu Y, Sun F (2014) Traffic sign recognition using group sparse coding. Inform Sci 266:75– 89

    Article  Google Scholar 

  31. 31.

    Lu K, Ding Z, Ge S (2012) Sparse-representation-based graph embedding for traffic sign recognition. IEEE Trans Intell Transp Syst 13(4):1515–1524

    Article  Google Scholar 

  32. 32.

    Maldonado-Bascón S, Lafuente-Arroyo S, Gil-Jiménez P, Gómez-Moreno H, López-Ferreras F (2007) Road-sign detection and recognition based on support vector machines. IEEE Trans Intell Transp Syst 8(2):264–278

    Article  MATH  Google Scholar 

  33. 33.

    Mathias M, Timofte R, Benenson R, Van Gool L (2013) Traffic sign recognition - how far are we from the solution?. In: The 2013 international joint conference on neural networks, USA, pp 1–8

  34. 34.

    Mazinan A, Sarikhani M (2014) Providing an efficient intelligent transportation system through detection, tracking and recognition of the region of interest in traffic signs by using non-linear svm classifier in line with histogram oriented gradient and kalman filter approach. Sadhana 39(1):27–37

    Article  Google Scholar 

  35. 35.

    Miura J, Kanda T, Shirai Y (2000) An active vision system for real-time traffic sign recognition. In: Proceedings of intelligent transportation systems, USA, pp 52–57

  36. 36.

    Nguwi YY, Cho SY (2010) Emergent self-organizing feature map for recognizing road sign images. Neural Comput & Applic 19(4):601–615

    Article  Google Scholar 

  37. 37.

    Nguwi YY, Kouzani AZ (2008) Detection and classification of road signs in natural environments. Neural Comput & Applic 17(3):265–289

    Article  Google Scholar 

  38. 38.

    Park JG, Kim K (2013) Design of a visual perception model with edge-adaptive gabor filter and support vector machine for traffic sign detection. Expert Syst Appl 40 (9):3679–3687

    Article  Google Scholar 

  39. 39.

    Pazhoumand-dar H, Yaghoobi M (2013) A new approach in road sign recognition based on fast fractal coding. Neural Comput & Applic 22(3-4):615–625

    Article  Google Scholar 

  40. 40.

    Raghavendra U, Makkithaya K, Karunakar AK (2013) Anchor-diagonal-based shape adaptive local support region for efficient stereo matching. SIViP 9(4):893–901

    Article  Google Scholar 

  41. 41.

    Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326

    Article  Google Scholar 

  42. 42.

    Ruta A, Li Y, Liu X (2010) Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recogn 43(1):416–430

    Article  MATH  Google Scholar 

  43. 43.

    Segu M, Prieto Allen AR (2009) Using self-organising maps in the detection and recognition of road signs. Image Vis Comput 27(6):673–683

    Article  Google Scholar 

  44. 44.

    Sermanet P, LeCun Y (2011) Traffic sign recognition with multi-scale convolutional networks. In: The 2011 international joint conference on neural networks, San Jose, pp 2809–2813

  45. 45.

    Souani C, Faiedh H, Besbes K (2014) Efficient algorithm for automatic road sign recognition and its hardware implementation. J Real-Time Image Proc 9(1):79–93

    Article  Google Scholar 

  46. 46.

    Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw 32:323–332

    Article  Google Scholar 

  47. 47.

    Sun ZL, Wang H, Lau WS, Seet G, Wang D (2014) Application of bw-elm model on traffic sign recognition. Neurocomputing 128:153–159

    Article  Google Scholar 

  48. 48.

    Tenenbaum JB, Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323

  49. 49.

    Timofte R, Zimmermann K, Van Gool L (2014) Multi-view traffic sign detection, recognition, and 3d localisation. Mach Vis Appl 25(3):633–647

    Article  Google Scholar 

  50. 50.

    Violence WHO, Prevention I, Organization WH (2013) Global status report on road safety 2013: supporting a decade of action. World Health Organization

  51. 51.

    Wang G, Ren G, Jiang L, Quan T (2014) Hole-based traffic sign detection method for traffic signs with red rim. Vis Comput 30(5):539–551

    Article  Google Scholar 

  52. 52.

    Xu Y, Zhu Q, Fan Z, Qiu M, Chen Y, Liu H (2013) Coarse to fine k nearest neighbor classifier. Pattern Recogn Lett 34(9):980–986

    Article  Google Scholar 

  53. 53.

    Zaklouta F, Stanciulescu B (2014) Real-time traffic sign recognition in three stages. Robot Auton Syst 62(1):16–24

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Anjan Gudigar.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gudigar, A., Chokkadi, S., Raghavendra, U. et al. Multiple thresholding and subspace based approach for detection and recognition of traffic sign. Multimed Tools Appl 76, 6973–6991 (2017). https://doi.org/10.1007/s11042-016-3321-6

Download citation

Keywords

  • Advanced driver assistance system
  • Computer vision
  • Multiple thresholds
  • Support vector machine
  • Traffic sign recognition