Skip to main content
SpringerLink
Log in

Spatially Enhanced Bags of Visual Words Representation to Improve Traffic Signs Recognition

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Traffic signs play a very vital role in safe driving and in avoiding accidents by informing the driver about the speed limits or possible dangers such as icy roads, imminent road works or pedestrian crossings. Considering the processing time and classification accuracy as a whole, a novel approach for visual words construction was presented, which takes the spatial information of keypoints into account in order to enhance the quality of visual words generated from extracted keypoints using the distance and angle information in the Bags of Visual Words (BoVW) representation. In this paper, we proposed a new computationally efficient method to model global spatial distribution of visual words by taking into consideration the spatial relationships of its visual words. In the first step, the region of interest is extracted using a scanning window with a Haar cascade detector and an AdaBoost classifier to reduce the computational region in the hypothesis generation step. Second, the regions are represented with BoVW and spatial information for classification. Experimental results show that the suggested method could reach comparable performance of the state-of-the-art approaches with less computational complexity and shorter training time. It clearly demonstrates the complementarity of the additional relative spatial information provided by our approach to improve accuracy while maintaining short retrieval time, and can obtain a better traffic sign recognition accuracy than the methods based on the traditional BoVW model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5

Similar content being viewed by others

Notes

  1. The leading cause of death among young people aged 15–29 years

References

  1. Abdi, L., Meddeb, A., & Abdallah, F.B. (2015). Augmented reality based traffic sign recognition for improved driving safety. In Communication technologies for vehicles (pp. 94–102). Berlin: Springer.

    Google Scholar 

  2. Azad, R., Azad, B., & Kazerooni, I.T. (2014). Optimized method for iranian road signs detection and recognition system. arXiv:1407.5324.

  3. Chuan, L., Shenghui, P., Fan, Z., Menghe, L., & Baozhong, K. (2011). A method of traffic sign detecting based on color similarity. In 2011 Third international conference on Measuring technology and mechatronics automation (ICMTMA), (Vol. 1 pp. 123–126). Piscataway: IEEE.

  4. Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012). Multi-column deep neural network for traffic sign classification. Neural Networks, 32, 333–338.

    Article  Google Scholar 

  5. Danelakis, A., Theoharis, T., & Pratikakis, I. (2015). A robust spatio-temporal scheme for dynamic 3d facial expression retrieval. The Visual Computer, 1–13.

  6. Dawn, D.D., & Shaikh, S.H. (2015). A comprehensive survey of human action recognition with spatio-temporal interest point (stip) detector. The Visual Computer, 1–18.

  7. Geronimo, D., Lopez, A.M., Sappa, A.D., & Graf, T. (2010). Survey of pedestrian detection for advanced driver assistance systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(7), 1239–1258.

    Article  Google Scholar 

  8. Gonzalez-Reyna, S.E., Avina-Cervantes, J.G., Ledesma-Orozco, S.E., & Cruz-Aceves, I. (2013). Eigen-gradients for traffic sign recognition. Mathematical Problems in Engineering, 2013.

  9. Greenhalgh, J., & Mirmehdi, M. (2012). Real-time detection and recognition of road traffic signs. IEEE Transactions on Intelligent Transportation Systems, 13(4), 1498–1506.

    Article  Google Scholar 

  10. Guo, L., Ge, P.S., Zhang, M.H., Li, L.H., & Zhao, Y.B. (2012). Pedestrian detection for intelligent transportation systems combining adaboost algorithm and support vector machine. Expert Systems with Applications, 39(4), 4274–4286.

    Article  Google Scholar 

  11. Haloi, M. (2015). A novel plsa based traffic signs classification system. arXiv:1503.06643.

  12. Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., & Igel, C. (2013). Detection of traffic signs in real-world images: The german traffic sign detection benchmark. In The 2013 international joint conference on neural networks (IJCNN) (pp. 1–8). Piscataway: IEEE.

  13. Jeon, W.J., Sanchez, G.A.R., Lee, T., Choi, Y., Woo, B., Lim, K., & Byun, H. (2014). Real-time detection of speed-limit traffic signs on the real road using haar-like features and boosted cascade. In Proceedings of the 8th international conference on ubiquitous information management and communication (p. 93). New York: ACM.

  14. Jin, J., Fu, K., & Zhang, C. (2014). Traffic sign recognition with hinge loss trained convolutional neural networks. IEEE Transactions on Intelligent Transportation Systems, 15(5), 1991–2000.

    Article  Google Scholar 

  15. Khan, R., Barat, C., Muselet, D., & Ducottet, C. (2015). Spatial histograms of soft pairwise similar patches to improve the bag-of-visual-words model. Computer Vision and Image Understanding, 132, 102–112.

    Article  Google Scholar 

  16. Kun, Z., Wenpeng, W., & Guangmin, S. (2014). An effective recognition method for road information based on mobile terminal. Mathematical Problems in Engineering, 2014.

  17. Lan, J., Jiang, Y., Fan, G., Yu, D., & Zhang, Q. (2015). Real-time automatic obstacle detection method for traffic surveillance in urban traffic. Journal of Signal Processing Systems, 1–15.

  18. Li, Y., Xu, J., Zhang, Y., Zhang, C., Yin, H., & Lu, H. (2016). Image classification using spatial difference descriptor under spatial pyramid matching framework. In Multimedia modeling (pp. 527–539). Berlin: Springer.

    Chapter  Google Scholar 

  19. Li, Y., Ye, J., Wang, T., & Huang, S. (2015). Augmenting bag-of-words: a robust contextual representation of spatiotemporal interest points for action recognition. The Visual Computer, 31(10), 1383–1394.

    Article  Google Scholar 

  20. Liang, M., Yuan, M., Hu, X., Li, J., & Liu, H. (2013). Traffic sign detection by roi extraction and histogram features-based recognition. In The 2013 international joint conference on Neural networks (IJCNN) (pp. 1–8). Piscataway: IEEE.

  21. Mathias, M., Timofte, R., Benenson, R., & Van Gool, L. (2013). Traffic sign recognition—how far are we from the solution?. In The 2013 international joint conference on Neural networks (IJCNN) (pp. 1–8). Piscataway: IEEE.

  22. McCall, J.C., & Trivedi, M.M. (2006). Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Transactions on Intelligent Transportation Systems, 7(1), 20–37.

    Article  Google Scholar 

  23. Mogelmose, A., Trivedi, M.M., & Moeslund, T.B. (2012). Vision-based traffic sign detection and analysis for intelligent driver assistance systems: perspectives and survey. IEEE Transactions on Intelligent Transportation Systems, 13(4), 1484–1497.

    Article  Google Scholar 

  24. Nguyen, B.V., Pham, D., Ngo, T.D., Le, D.D., & Duong, D.A. (2014). Integrating spatial information into inverted index for large-scale image retrieval. In 2014 IEEE international symposium on Multimedia (ISM) (pp. 102–105). Piscataway: IEEE.

  25. Nguyen, K.D., Le, D.D., & Duong, D.A. (2013). Efficient traffic sign detection using bag of visual words and multi-scales sift. In Neural information processing (pp. 433–441). Berlin: Springer.

    Chapter  Google Scholar 

  26. Park, J.G., & Kim, K.J. (2013). Design of a visual perception model with edge-adaptive gabor filter and support vector machine for traffic sign detection. Expert Systems with Applications, 40(9), 3679–3687.

    Article  Google Scholar 

  27. Pedrosa, G.V., & Traina, A.J. (2015). Compact and discriminative approach for encoding spatial-relationship of visual words. In Proceedings of the 30th annual ACM symposium on applied computing (pp. 92–95). New York: ACM.

  28. Richter, P. (2015). Road traffic injuries http://www.who.int/mediacentre/factsheets/fs358/en/.

  29. Sermanet, P., & LeCun, Y. (2011). Traffic sign recognition with multi-scale convolutional networks. In The 2011 international joint conference on Neural networks (IJCNN) (pp. 2809–2813). Piscataway: IEEE.

  30. Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2011). The german traffic sign recognition benchmark: a multi-class classification competition. In The 2011 international joint conference on neural networks (IJCNN) (pp. 1453–1460). Piscataway: IEEE.

  31. Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2012). Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural networks, 32, 323–332.

    Article  Google Scholar 

  32. Tang, S., & Huang, L.L. (2013). Traffic sign recognition using complementary features. In 2013 2nd IAPR asian conference on Pattern recognition (ACPR) (pp. 210–214). Piscataway: IEEE.

  33. Timofte, R. Kul belgium traffic signs and classification benchmark datasets. http://btsd.ethz.ch/shareddata.

  34. Viola, P., & Jones, M.J. (2004). Robust real-time face detection. International journal of computer vision, 57(2), 137–154.

    Article  Google Scholar 

  35. Virupakshappa, K., Han, Y., & Oruklu, E. (2015). Traffic sign recognition based on prevailing bag of visual words representation on feature descriptors. In 2015 IEEE international conference on Electro/information technology (EIT) (pp. 489–493). Piscataway: IEEE.

  36. Wang, J.G., Lin, C.J., & Chen, S.M. (2010). Applying fuzzy method to vision-based lane detection and departure warning system. Expert Systems with Applications, 37(1), 113–126.

    Article  Google Scholar 

  37. Yin, S., Ouyang, P., Liu, L., Guo, Y., & Wei, S. (2015). Fast traffic sign recognition with a rotation invariant binary pattern based feature. Sensors, 15(1), 2161–2180.

    Article  Google Scholar 

  38. Yu, Y., Li, J., Guan, H., Wang, C., & Wen, C. Bag of contextual-visual words for road scene object detection from mobile laser scanning data.

  39. Zagoris, K., Pratikakis, I., Antonacopoulos, A., Gatos, B., & Papamarkos, N. (2014). Distinction between handwritten and machine-printed text based on the bag of visual words model. Pattern Recognition, 47(3), 1051–1062.

    Article  Google Scholar 

  40. Zaklouta, F., & Stanciulescu, B. (2012). Real-time traffic-sign recognition using tree classifiers. IEEE Transactions on Intelligent Transportation Systems, 13(4), 1507–1514.

    Article  Google Scholar 

  41. Zaklouta, F., Stanciulescu, B., & Hamdoun, O. (2011). Traffic sign classification using kd trees and random forests. In The 2011 international joint conference on neural networks (IJCNN) (pp. 2151–2155). Piscataway: IEEE.

  42. Zhang, E., & Mayo, M. (2010). Enhanced spatial pyramid matching using log-polar-based image subdivision and representation. In 2010 international conference on digital image computing: techniques and applications (DICTA) (pp. 208–213). Piscataway: IEEE.

  43. Zhou, W., Li, H., Lu, Y., & Tian, Q. (2012). Principal visual word discovery for automatic license plate detection. IEEE Transactions on Image Processing, 21(9), 4269–4279.

    Article  MathSciNet  Google Scholar 

  44. Zhu, Q., Zhong, Y., Zhao, B., Xia, G.S., & Zhang, L. (2016). Bag-of-visual-words scene classifier with local and global features for high spatial resolution remote sensing imagery. IEEE Geoscience and Remote Sensing Letters, 13(6), 747–751.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Engineering School of Tunis, University of Tunis El Manar, Tunis, Tunisia

    Lotfi Abdi

  2. Networked Objects Control and Communication Systems Laboratory, Tunis, Tunisia

    Lotfi Abdi & Aref Meddeb

  3. National Engineering School Of Sousse, University of Sousse, Sousse, Tunisia

    Aref Meddeb

Authors
  1. Lotfi Abdi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aref Meddeb
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lotfi Abdi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdi, L., Meddeb, A. Spatially Enhanced Bags of Visual Words Representation to Improve Traffic Signs Recognition. J Sign Process Syst 90, 1729–1741 (2018). https://doi.org/10.1007/s11265-017-1324-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-017-1324-9

Keywords

Search

Navigation