Multimedia Tools and Applications

, Volume 76, Issue 5, pp 6973–6991 | Cite as

Multiple thresholding and subspace based approach for detection and recognition of traffic sign

  • Anjan Gudigar
  • Shreesha Chokkadi
  • U Raghavendra
  • U Rajendra Acharya
Article

Abstract

Automatic detection and recognition of traffic sign has been a topic of great interest in advanced driver assistance system. It enhances vehicle and driver safety by providing the condition and state of the road to the drivers. However, visual occlusion and ambiguities in the real-world scenario make the traffic sign recognition a challenging task. This paper presents an Automatic Traffic Sign Detection and Recognition (ATSDR) system, involving three modules: segmentation, detection, and recognition. Region of Interest (ROI) is extracted using multiple thresholding schemes with a novel environmental selection strategy. Then, the traffic sign detection is carried out using correlation computation between log-polar mapped inner regions and the reference template. Finally, recognition is performed using Support Vector Machine (SVM) classifier. Our proposed system achieved a recognition accuracy of 98.3 % and the experimental results demonstrates the robustness of traffic sign detection and recognition in real-world scenario.

Keywords

Advanced driver assistance system Computer vision Multiple thresholds Support vector machine Traffic sign recognition 

References

  1. 1.
    Alsibai M, Hirai Y (2010) Real-time recognition of blue traffic signs designating directions. Int J Intell Transp Syst Res 8(2):96–105Google Scholar
  2. 2.
    Barnes N, Zelinsky A, Fletcher L (2008) Real-time speed sign detection using the radial symmetry detector. IEEE Trans Intell Transp Syst 9(2):322–332CrossRefGoogle Scholar
  3. 3.
    Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATHGoogle Scholar
  4. 4.
    Boumediene M, Cudel C, Basset M, Ouamri A (2013) Triangular traffic signs detection based on rsld algorithm. Mach Vis Appl 24(8):1721–1732CrossRefGoogle Scholar
  5. 5.
    Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167CrossRefGoogle Scholar
  6. 6.
    Cai D, He X, Zhou K, Han J Bao H (2007) Locality sensitive discriminant analysis. In: Proceedings of the 20th international joint conference on artifical intelligence. Hyderabad, India, pp 708–713Google Scholar
  7. 7.
    Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27:1–27:27. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm CrossRefGoogle Scholar
  8. 8.
    Ciresan D, Meier U, Masci J, Schmidhuber J (2011) A committee of neural networks for traffic sign classification. In: The 2011 international joint conference on neural networks, San Jose, pp 1918–1921Google Scholar
  9. 9.
    Duda RO, Hart PE, Stork DG (2000) Pattern classification, 2nd edn. Wiley-InterscienceGoogle Scholar
  10. 10.
    Escalera S, Pujol O, Radeva P (2010) Traffic sign recognition system with ß -correction. Mach Vis Appl 21(2):99–111CrossRefGoogle Scholar
  11. 11.
    Fang X, Xu Y, Li X, Fan Z, Liu H, Chen Y (2014) Locality and similarity preserving embedding for feature selection. Neurocomputing 128:304–315CrossRefGoogle Scholar
  12. 12.
    Fleyeh H, Davami E (2011) Eigen-based traffic sign recognition. IET Intell Transp Syst 5(3):190–196CrossRefGoogle Scholar
  13. 13.
    Gamec J, Urdzík D, Gamcová M (2012) Algorithm of traffic signs recognition based on the rapid transform. Cent Eur J Comput Sci 2(3):236–244Google Scholar
  14. 14.
    Gao XW, Podladchikova L, Shaposhnikov D, Hong K, Shevtsova N (2006) Recognition of traffic signs based on their colour and shape features extracted using human vision models. J Vis Commun Image Represent 17(4):675–685CrossRefGoogle Scholar
  15. 15.
    Gil Jiménez P, Bascón SM, Moreno HG, Arroyo SL, Ferreras FL (2008) Traffic sign shape classification and localization based on the normalized fft of the signature of blobs and 2d homographies. Signal Process 88(12):2943–2955CrossRefMATHGoogle Scholar
  16. 16.
    Gómez-Moreno H, Maldonado-Bascón S, Gil-Jiménez P, Lafuente-Arroyo S (2010) Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans Intell Transp Syst 11(4):917–930CrossRefGoogle Scholar
  17. 17.
    Greenhalgh J, Mirmehdi M (2012) Real-time detection and recognition of road traffic signs. IEEE Trans Intell Transp Syst 13(4):1498–1506CrossRefGoogle Scholar
  18. 18.
    Gu Y, Yendo T, Tehrani M, Fujii T Tanimoto M (2011) Traffic sign detection in dual-focal active camera system. In: Intelligent vehicles symposium (IV), Germany, pp 1054–1059Google Scholar
  19. 19.
    Gudigar A, Jagadale B,Mahesh P K, Raghavendra U (2012) Kernel based automatic traffic sign detection and recognition using svm. In: Eco-friendly computing and communication systems, vol 305, India, pp 153–161Google Scholar
  20. 20.
    Gudigar A, Chokkadi S, Raghavendra U (2016) A review on automatic detection and recognition of traffic sign. Multimed Tools Appl 75(1):333–364CrossRefGoogle Scholar
  21. 21.
    Han PY, Jin ATB, Abas FS (2009) Neighbourhood preserving discriminant embedding in face recognition. J Vis Commun Image Represent 20(8):532–542Google Scholar
  22. 22.
    He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Proceedings of the 10th IEEE international conference on computer vision, vol 2, Beijing, pp 1208–1213Google Scholar
  23. 23.
    Houben S, Stallkamp J, Salmen J, Schlipsing M, Igel C (2013) Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: Proceedings of IEEE international joint conference on neural networks, USA, p 1288Google Scholar
  24. 24.
    Jalba AC, Roerdink JBTM, Wilkinson MHF (2003) Morphological hat-transform scale spaces and their use in texture classification. Pattern Recogn 37:901–915CrossRefGoogle Scholar
  25. 25.
    Javier Traver V, Bernardino A (2010) A review of log-polar imaging for visual perception in robotics. Robot Auton Syst 58(4):378–398Google Scholar
  26. 26.
    Kehtarnavaz N, Ahmad A (1995) Traffic sign recognition in noisy outdoor scenes. In: Proceedings of the intelligent vehicles ’95 symposium, Detroit, pp 460–465Google Scholar
  27. 27.
    Khan JF, Bhuiyan SMA, Adhami RR (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96CrossRefGoogle Scholar
  28. 28.
    Kuo WJ, Lin CC (2007) Two-stage road sign detection and recognition. In: IEEE international conference on multimedia and expo, China, pp 1427–1430Google Scholar
  29. 29.
    Lafuente-Arroyo S, Salcedo-Sanz S, Maldonado-Bascón S, Portilla-Figueras J, López-Sastre R (2010) A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems. Expert Syst Appl 37(1):767–773CrossRefGoogle Scholar
  30. 30.
    Liu H, Liu Y, Sun F (2014) Traffic sign recognition using group sparse coding. Inform Sci 266:75– 89CrossRefGoogle Scholar
  31. 31.
    Lu K, Ding Z, Ge S (2012) Sparse-representation-based graph embedding for traffic sign recognition. IEEE Trans Intell Transp Syst 13(4):1515–1524CrossRefGoogle Scholar
  32. 32.
    Maldonado-Bascón S, Lafuente-Arroyo S, Gil-Jiménez P, Gómez-Moreno H, López-Ferreras F (2007) Road-sign detection and recognition based on support vector machines. IEEE Trans Intell Transp Syst 8(2):264–278CrossRefMATHGoogle Scholar
  33. 33.
    Mathias M, Timofte R, Benenson R, Van Gool L (2013) Traffic sign recognition - how far are we from the solution?. In: The 2013 international joint conference on neural networks, USA, pp 1–8Google Scholar
  34. 34.
    Mazinan A, Sarikhani M (2014) Providing an efficient intelligent transportation system through detection, tracking and recognition of the region of interest in traffic signs by using non-linear svm classifier in line with histogram oriented gradient and kalman filter approach. Sadhana 39(1):27–37CrossRefGoogle Scholar
  35. 35.
    Miura J, Kanda T, Shirai Y (2000) An active vision system for real-time traffic sign recognition. In: Proceedings of intelligent transportation systems, USA, pp 52–57Google Scholar
  36. 36.
    Nguwi YY, Cho SY (2010) Emergent self-organizing feature map for recognizing road sign images. Neural Comput & Applic 19(4):601–615CrossRefGoogle Scholar
  37. 37.
    Nguwi YY, Kouzani AZ (2008) Detection and classification of road signs in natural environments. Neural Comput & Applic 17(3):265–289CrossRefGoogle Scholar
  38. 38.
    Park JG, Kim K (2013) Design of a visual perception model with edge-adaptive gabor filter and support vector machine for traffic sign detection. Expert Syst Appl 40 (9):3679–3687CrossRefGoogle Scholar
  39. 39.
    Pazhoumand-dar H, Yaghoobi M (2013) A new approach in road sign recognition based on fast fractal coding. Neural Comput & Applic 22(3-4):615–625CrossRefGoogle Scholar
  40. 40.
    Raghavendra U, Makkithaya K, Karunakar AK (2013) Anchor-diagonal-based shape adaptive local support region for efficient stereo matching. SIViP 9(4):893–901CrossRefGoogle Scholar
  41. 41.
    Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRefGoogle Scholar
  42. 42.
    Ruta A, Li Y, Liu X (2010) Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recogn 43(1):416–430CrossRefMATHGoogle Scholar
  43. 43.
    Segu M, Prieto Allen AR (2009) Using self-organising maps in the detection and recognition of road signs. Image Vis Comput 27(6):673–683CrossRefGoogle Scholar
  44. 44.
    Sermanet P, LeCun Y (2011) Traffic sign recognition with multi-scale convolutional networks. In: The 2011 international joint conference on neural networks, San Jose, pp 2809–2813Google Scholar
  45. 45.
    Souani C, Faiedh H, Besbes K (2014) Efficient algorithm for automatic road sign recognition and its hardware implementation. J Real-Time Image Proc 9(1):79–93CrossRefGoogle Scholar
  46. 46.
    Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw 32:323–332CrossRefGoogle Scholar
  47. 47.
    Sun ZL, Wang H, Lau WS, Seet G, Wang D (2014) Application of bw-elm model on traffic sign recognition. Neurocomputing 128:153–159CrossRefGoogle Scholar
  48. 48.
    Tenenbaum JB, Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323Google Scholar
  49. 49.
    Timofte R, Zimmermann K, Van Gool L (2014) Multi-view traffic sign detection, recognition, and 3d localisation. Mach Vis Appl 25(3):633–647CrossRefGoogle Scholar
  50. 50.
    Violence WHO, Prevention I, Organization WH (2013) Global status report on road safety 2013: supporting a decade of action. World Health OrganizationGoogle Scholar
  51. 51.
    Wang G, Ren G, Jiang L, Quan T (2014) Hole-based traffic sign detection method for traffic signs with red rim. Vis Comput 30(5):539–551CrossRefGoogle Scholar
  52. 52.
    Xu Y, Zhu Q, Fan Z, Qiu M, Chen Y, Liu H (2013) Coarse to fine k nearest neighbor classifier. Pattern Recogn Lett 34(9):980–986CrossRefGoogle Scholar
  53. 53.
    Zaklouta F, Stanciulescu B (2014) Real-time traffic sign recognition in three stages. Robot Auton Syst 62(1):16–24CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Anjan Gudigar
    • 1
  • Shreesha Chokkadi
    • 1
  • U Raghavendra
    • 1
  • U Rajendra Acharya
    • 2
    • 3
  1. 1.Department of Instrumentation and Control Engineering, Manipal Institute of TechnologyManipal UniversityManipalIndia
  2. 2.Department of Electronics and Computer Engineering, Ngee Ann PolytechnicSIM UniversitySingaporeSingapore
  3. 3.Department of Biomedical Engineering, Faculty of EngineeringUniversity of MalayaKuala LumpurMalaysia

Personalised recommendations