Real-Time Video Surveillance Based on Combining Foreground Extraction and Human Detection

  • Hui-Chi Zeng
  • Szu-Hao Huang
  • Shang-Hong Lai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4903)


In this paper, we present an adaptive foreground object extraction algorithm for real-time video surveillance, in conjunction with a human detection technique applied in the extracted foreground regions by using AdaBoost learning algorithm and Histograms of Oriented Gradient (HOG) descriptors. Furthermore, a RANSAC-based temporal tracking algorithm is also applied to refine and trace the detected human windows in order to increase the detection accuracy and reduce the false alarm rate. The traditional background subtraction technique usually cannot work well for situations with lighting variations in the scene. The proposed algorithm employs a two-stage foreground/background classification procedure to perform background subtraction and remove the undesirable subtraction results due to shadow, automatic white balance, and sudden illumination change. Experimental results on some real surveillance video are shown to demonstrate the good performance of the proposed adaptive foreground extraction algorithm under a variety of different environments with lighting variations and human detection system.


Surveillance background subtraction foreground extraction lighting variation human detection RANSAC 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. CVRP II, 246–252 (1999) Google Scholar
  2. 2.
    Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. ECCV II, 751–767 (2000) Google Scholar
  3. 3.
    Tuzel, O., Porikli, F., Meer, P.: A bayesian approach to background modeling. MVIV III, 58 (2005) Google Scholar
  4. 4.
    Tian, Y.L., Lu, M., Hampapur, A.: Robust and efficient foreground analysis for real-time video surveillance. CVPR I, 1182–1187 (2005) Google Scholar
  5. 5.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Computational Learning Theory, Eurocolt, pp. 23–37 (1995) Google Scholar
  6. 6.
    Viola, P., Jones, M.: Roust real-time face detection. IJCV 57, 137–154 (2004) Google Scholar
  7. 7.
    Viola, P., Jones, M.J., Snow, D.: Detecting pedestrians using patterns of motion and appearance. In: Proc. ICCV, vol. 1, pp. 734–741 (2003) Google Scholar
  8. 8.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 886–893 (2005) Google Scholar
  9. 9.
    Zhou, J., Hoang, J.: Real time robust human detection and tracking system. In: Proc. IEEE Conf. Computer Vision Pattern Recognition, p. 149. Google Scholar
  10. 10.
    Hussein, M., Almageed, W.A., Ran, Y., Davis, L.: Real-time human detection, tracking, and verification in uncontrolled camera motion environments. In: Proc. ICVS, p. 56 (2006) Google Scholar
  11. 11.
    Zeng, H.C., Lai, S.H.: Adaptive foreground object extraction for real-time video surveillance with lighting variations. In: Proc. ICASSP (2007) Google Scholar
  12. 12.
    Haralick, R., Shapiro, L.: Computer and robot vision 1. Addison Wesley, Reading (1992)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Hui-Chi Zeng
    • 1
  • Szu-Hao Huang
    • 1
  • Shang-Hong Lai
    • 1
  1. 1.Department of Computer Science, National Tsing Hua University, HsinchuTaiwan

Personalised recommendations