Skip to main content
Log in

Traffic lights detection and recognition based on multi-feature fusion

Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Many traffic accidents occurred at intersections are caused by drivers who miss or ignore the traffic signals. In this paper, we present a method dealing with automatic detection of traffic lights that integrates both image processing and support vector machine techniques. Firstly, based on the color characteristics of traffic lights, the paper proposes a method of traffic light segmentation in RGB and HSV color space. And then, according to the geometric features and backplane color information of traffic lights, we design an algorithm to remove false targets in images. Moreover, in order to solve traffic lights diffusion problem, we apply a strategy that we first map the candidate regions onto the original image, then using Otsu algorithm re-extract the target region. Finally, HOG features are extracted from the target regions, and recognized by the trained SVM classifier. Experimental results show that the proposed method has relatively high detection rate and recognition accuracy in different natural scenarios, and is able to meet real-time requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Barbu T (2014) Pedestrian detection and tracking using temporal differencing and HOG features. Comput Electr Eng 40(4):1072–1079

    Article  Google Scholar 

  2. Chen X, Li Y, Harrison R et al (2008) Type-2 fuzzy logic based classifier fusion for support vector machine. Appl Soft Comput 8(3):1222–1231

    Article  Google Scholar 

  3. Chen Z, Shi Q, Huang X (2015) Automatic detection of traffic lights using support vector machine. IEEE Intelligent Vehicles Symposium 1:37–40

    Google Scholar 

  4. Chiang CC, Ho MC, Liao HS et al (2011) Detecting and recognizing traffic lights by genetic approximate ellipse detection and spatial texture layouts. Int J Innov Comput Inf Control 7(12):6919–6934

    Google Scholar 

  5. Chunhe YU, Bai Y (2012) A Traffic Light Detection Method, Advanced Technology in Teaching, pp 745–751

  6. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection, 2005 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, pp 886–893

  7. de Charette R, Nashashibi F (2009a) Traffic light recognition using image processing compared to learning process. 2009 I.E. International conference on Intelligent Robots and Systems, pp 333–338

  8. de Charette R, Nashashibi F (2009b) Real time visual traffic lights recognition based on spot light detection and adaptive traffic lights templates. 2009 I.E. International conference on Intelligent Vehicles Symposium, pp 358–363

  9. Dollár P, Belongie S, and Perona P (2010) The fastest pedestrian detector in the west, Proceedings of British Machine Vision Conference, pp: 1–11

  10. Enzweiler M, Gavrila DM (2009) Monocular pedestrian detection: survey and experiments. IEEE Trans Pattern Anal Mach Intell 31:2179–2195

    Article  Google Scholar 

  11. iaz-Cabrera M, Cerri P, Medici P (2015) Robust real-time traffic light detection and distance estimation using a single camera. Expert Syst Appl 42(8):3911–3923

    Article  Google Scholar 

  12. Jang C, Kim C, Kim D., et al (2014), Multiple exposure images based traffic light recognition, 2014 I.E. Intelligent Vehicles Symposium Proceedings, pp 1313-1318

  13. Jie Y, Xiaoming C, Penfei G, et al, (2013) A new Traffic light detection and recognition algorithm for electronic travel aid, 2013 Fourth International Conference on Intelligent Control and Information Processing, pp 644–648

  14. Omachi M, Omachi S, (2010) Detection of traffic light using structural information, 2010 I.E. 10th International Conference on Signal Processing (ICSP), pp: 809–812

  15. Sermanet P, Kavukcuoglu K, Chintala S et al., (2013) Pedestrian detection with unsupervised multi-stage feature learning, 2013 I.E. Conference on Computer Vision and Pattern Recognition, pp:3626–3633

  16. Sooksatra S, Kondo T, (2014) Red traffic light detection using fast radial symmetry Transform, 2014 11th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), pp:1–6

Download references

Acknowledgment

This work was supported in part by the National Natural Science Foundation of China under Grant 61403060, and the Natural Science Foundation of the Jiangsu Higher Education Institutions under Grant 15KJA460003. The authors would like to thank the anonymous reviewers and the editors for their many helpful suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wenhao Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, W., Sun, S., Jiang, M. et al. Traffic lights detection and recognition based on multi-feature fusion. Multimed Tools Appl 76, 14829–14846 (2017). https://doi.org/10.1007/s11042-016-4051-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4051-5

Keywords

Navigation