Skip to main content
SpringerLink
Log in

Background-Subtraction in Thermal Imagery Using Contour Saliency

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

We present a new contour-based background-subtraction technique to extract foreground objects in widely varying thermal imagery. Statistical background-subtraction is first used to identify local regions-of-interest. Within each region, input and background gradient information are combined to form a Contour Saliency Map. After thinning, an A ∗ path-constrained search along watershed boundaries is used to complete and close any broken contour segments. Lastly, the contour image is flood-filled to produce silhouettes. Results of our approach are presented for several difficult thermal sequences and compared to alternate approaches. We quantify the results using manually segmented thermal imagery to demonstrate the robustness of the approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bhanu, B. and Han, J. 2002. Kinematic-based human motion analysis in infrared sequences. In Proc. Wkshp. Applications of Comp. Vis., pp. 208–212.

  • Bhanu, B. and Holben, R. 1990. Model-based segmentation of FLIR images. IEEE Trans. Aero. and Elect. Sys., 26(1):2–11.

    Article  Google Scholar 

  • Bobick, A. and Davis, J. 2001. The recognition of human movement using temporal templates. IEEE Trans. Patt. Analy. and Mach. Intell., 23(3):257–267.

    Article  Google Scholar 

  • Couprie, M. and Bertrand, G. 1997. Topological grayscale watershed transformation. In Vision Geometry V, Vol. 3168, SPIE, pp. 136–146.

  • Cutler, R. and Davis, L. 1999. Real-time periodic motion detection, analysis, and applications. In Proc. Comp. Vis. and Pattern Rec., IEEE, pp. 326–332.

  • Danker, A. and Rosenfeld, A. 1981. Blob detection by relaxation. IEEE Trans. Patt. Analy. and Mach. Intell., 3(1):79–92.

    Article  Google Scholar 

  • Davis, J. and Keck, M. 2005. A two-stage template approach to person detection in thermal imagery. In Proc. Wkshp. Applications of Comp. Vis.

  • Davis, J. and Sharma, V. 2004a. Robust background-subtraction for person detection in thermal imagery. In IEEE Int. Wkshp. on Object Tracking and Class. Beyond the Vis. Spect.

  • Davis, J. and Sharma, V. 2004b. Robust detection of people in thermal imagery. In Proc. Int. Conf. Pat. Rec., pp. 713–716.

  • Elgammal, A., Harwood, D., and Davis, L. 2000. Non-parametric model for background subtraction. In Proc. European Conf. Comp. Vis., pp. 751–767.

  • Gavrila, D. 2000. Pedestrian detection from a moving vehicle. In Proc. European Conf. Comp. Vis., pp. 37–49.

  • Haritaoglu, I., Harwood, D., and Davis, L. 1998. W4: Who? When? Where? What? A real time system for detecting and tracking people. In Proc. Int. Conf. Auto. Face and Gesture Recog., pp. 222–227.

  • Harville, M. 2002. A framework for high-level feedback to adaptive, per-pixel, mixture-of-gaussian background models. In Proc. European Conf. Comp. Vis., pp. 543–560.

  • Hoist, G. 2000. Common Sense Approach to Thermal Imaging. SPIE Press, Bellingham, Washington.

    Google Scholar 

  • Iwasawa, S., Ebihara, K., Ohya, J., and Morishima, S. 1997. Real-time estimation of human body posture from monocular thermal images. In Proc. Comp. Vis. and Pattern Rec., IEEE, pp. 15–20.

  • Javed, O., Shafique, K., and Shah, M. 2002. A hierarchical approach to robust background subtraction using color and gradient information. In Wkshp. on Motion and Video Computing, pp. 22–27. IEEE.

  • Kummer, S. 2003. The eye of the law. OE Magazine, 3(10):22–25.

    Google Scholar 

  • Lemaréchal, C. and Fjørtoft, R. 1998. Comments on geodesic saliency of watershed contours and hierarchical segmentation. IEEE Trans. Patt. Analy. and Mach. Intell., 20(7):762–763.

    Article  Google Scholar 

  • Lipton, A., Fujiyoshi, H., and Patil, R. 1998. Moving target classification and tracking from real-time video. In Proc. Wkshp. Applications of Comp. Vis.

  • Masoud, O. and Papanikolopoulos, N. 2001. A novel method for tracking and counting pedestrians in real-time using a single camera. IEEE Trans. on Vehicular Tech., 50(5):1267–1278.

    Article  Google Scholar 

  • Mittal, A. and Paragios, N. 2004. Motion-based background subtraction using adaptive kernel density estimation. In Proc. Comp. Vis. and Pattern Rec., pp. 302–309.

  • Monnet, A., Mittal, A., Paragios, N., and Ramesh, V. 2003. Background modeling and subtraction of dynamic scenes. In Proc. Int. Conf. Comp. Vis., pp. 1305–1312.

  • Najman, L. and Schmitt, M. 1996. Geodesic saliency of watershed contours and hierarchical segmentation. IEEE Trans. Patt. Analy. and Mach. Intell., 18(12):1163–1173.

    Article  Google Scholar 

  • Nanda, H. and Davis, L. 2002. Probabilistic template based pedestrian detection in infrared videos. In Proc. Intell. Vehicles Symp. IEEE.

  • Oren, M., Papageorgiour, C., Sinha, P., Osuma, E., and Poggio, T. 1997. Pedestrian detection using wavelet templates. In Proc. Comp. Vis. and Pattern Rec., IEEE, pp. 193–199.

  • Pandya, N. and Anda, J. 2004. Across the spectrum. OE Magazine, 4(9):28–31.

    Google Scholar 

  • Russell, S. and Norvig, P. 2003, (eds.) Artificial Intelligence: A Modern Approach. Prentice Hall.

  • Stauffer, C. and Grimson, W.E.L. 1999. Adaptive background mixture models for real-time tracking. In Proc. Comp. Vis. and Pattern Rec., IEEE, pp. 246–252.

  • Toyama, K., Brumitt, B., Krumm, J., and Meyers, B. 1999. Wallflower: principals and practice of background maintenance. In Proc. Int. Conf. Comp. Vis., pp. 49–54.

  • Vincent, L. and Soille, P. 1991. Watershed in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Patt. Analy. and Mach. Intell., 13(6):583–598.

    Article  Google Scholar 

  • Viola, P., Jones, M., and Snow, D. 2003. Detecting pedestrians using patterns of motion and appearance. In Proc. Int. Conf. Comp. Vis., pp. 734–741.

  • Wren, C., Azarbayejani, A. Darrell, T., and Pentland, A. 1997. Pfinder: real-time tracking of the human body. IEEE Trans. Patt. Analy. and Mach. Intell., 19(7):780–785.

    Article  Google Scholar 

  • Xu, F. and Fujimura, K. 2002. Pedestrian detection and tracking with night vision. In Proc. Intell. Vehicles Symp, IEEE.

  • Yilmaz, A., Shafique, K., and Shah, M. 2003. Target tracking in airborne forward looking infrared imagery. Image and Vision Comp., 21(7):623–635.

    Article  Google Scholar 

  • Zhong, J. and Sclaroff, S. 2003. Segmenting foreground objects from a dynamic, textured background via a robust kalman filter. In Proc. Int. Conf. Comp. Vis., pp. 44–50.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Ohio State University, Columbus, OH, 43210, USA

    James W. Davis & Vinay Sharma

Authors
  1. James W. Davis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vinay Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to James W. Davis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Davis, J.W., Sharma, V. Background-Subtraction in Thermal Imagery Using Contour Saliency. Int J Comput Vision 71, 161–181 (2007). https://doi.org/10.1007/s11263-006-4121-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-4121-7

Keywords

Search

Navigation