Hierarchical Scheme of Vehicle Detection and Tracking in Nighttime Urban Environment

  • Hyug Jae Lee
  • Byeungjun Moon
  • Gyeonghwan Kim


In this paper, we propose a novel hierarchical scheme for detection and tracking of vehicles using a vehicle-mounted camera in nighttime under urban environment, where a vehicle can be represented by a pair of taillights and various types of lights are commonplace. The proposed scheme, therefore, mainly focuses on devising robust detection and pairing of taillights in spite of their inherent diversity and continuous transformation in appearance. Thus the appearance symmetry, which many conventional methods rely on, for paring is not guaranteed to be available all the times. Each of the three layers in the scheme is devised to identify a vehicle from individual lights and clutters detected in a hierarchical manner. Robust detection of a pair of taillights, which can be regarded as a vehicle, is sought by successive groupings of the components in a layer and checking not only the intra-layer but the inter-layer relations between them. A structural Kalman filter is employed to maintain the temporal consistency in the motion of the components and their relations as well. Exploiting such relational information increases accuracy in tracking of individual components by reducing effects from fluctuation in positions and shapes, and eventually compensating possible failures in detection of them. As a result, the proposed scheme achieves enhancement in detection and tracking of vehicles in nighttime as proven by experiments on videos including crowded urban traffic scenes.

Key Words

Vehicle detection Nighttime vehicle detection Detection and tracking Taillight detection ADAS 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bernardin, K. and Stiefelhagen, R. (2008). Evaluating multiple object tracking performance: The CLEAR MOT metric. J. Image Video Process, 2008, 1–10.CrossRefGoogle Scholar
  2. Chien, C. L., Hang, H. M., Tseng, D. C. and Chen, Y. S. (2016). An image based overexposed taillight detection method for frontal vehicle detection in night vision. Asia-Pacific Signal and Information Processing Association Annual Summit and Conf., 1–9.Google Scholar
  3. Choi, H. C., Park, J. M., Choi. W. S. and Oh, S. Y. (2012). Vision-based fusion of robust lane tracking and forward vehicle detection in a real driving environment. Int. J. Automotive Technology 13, 4, 653–669.CrossRefGoogle Scholar
  4. Fossati, A., Schömann, P. and Fua, P. (2010). Real-time vehicle tracking for driving assistance. Machine Vision and Applications 22, 2, 439–448.CrossRefGoogle Scholar
  5. Guo, J., Wang, J., Guo, X., Yu, C. and Sun, X. (2014). Preceding vehicle detection and tracking adaptive to illumination variation in night traffic scenes based on relevance analysis. Sensors 14, 8, 15325–15347.CrossRefGoogle Scholar
  6. Han, J., Heo, O., Park, M., Kee, S. and Sunwoo, M. (2016). Vehicle distance estimation using a mono-camera for FCW/AEB systems. Int. J. Automotive Technology 17, 3, 483–491.CrossRefGoogle Scholar
  7. Jang, D. S., Jang, S. W. and Choi, H. I. (2002). 2D human body tracking with structural Kalman filter. Pattern Recognition 35, 10, 2041–2049.CrossRefzbMATHGoogle Scholar
  8. Maulik, U. and Bandyopadhyay, S. (2002). Performance evaluation of some clustering algorithms and validity indices. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 12, 1650–1654.CrossRefGoogle Scholar
  9. O’Malley, R., Jones, E. and Glavin, M. (2010). Rear-lamp vehicle detection and tracking in low-exposure color video for night conditions. IEEE Trans. Intelligent Transportation Systems 11, 2, 453–462.CrossRefGoogle Scholar
  10. Pal, N. R., Pal, K., Keller, J. M. and Bezdek, J. C. (2005). A possibilistic fuzzy c-mean clustering algorithm. IEEE Trans. Fuzzy Systems 13, 4, 517–530.CrossRefGoogle Scholar
  11. Sivaraman, S. and Trivedi, M. M. (2013). Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis. IEEE Trans. Intelligent Transportation Systems 14, 4, 1773–1795.CrossRefGoogle Scholar
  12. Sun, J., Wu, X., Yan, S., Cheong, L. F., Chua, T. S. and Li, J. (2009). Hierarchical spatio-temporal context modeling for action recognition. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004–2011.Google Scholar
  13. Sun, W. and Guo, B. I. (2008). Robust object tracking via hierarchical particle filter. Proc. IEEE Int. Conf. Intelligent Systems Design and Applications, 482–486.Google Scholar
  14. Wang, W., Shen, C., Zhang, J. and Paisitkriangkrai, S. (2009). A two-layer night-time vehicle detector. Digital Image Computing: Techniques and Applications, 162–167.Google Scholar
  15. Zou, Q., Ling, H., Luo, S., Huang, Y. and Tian, M. (2015). Robust nighttime vehicle detection by tracking and grouping headlights. IEEE Trans. Intelligent Transportation Systems 16, 5, 2838–2849.CrossRefGoogle Scholar

Copyright information

© The Korean Society of Automotive Engineers and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Electronic EngineeringSogang UniversitySeoulKorea

Personalised recommendations