Making Background Subtraction Robust to Sudden Illumination Changes

  • Julien Pilet
  • Christoph Strecha
  • Pascal Fua
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5305)


Modern background subtraction techniques can handle gradual illumination changes but can easily be confused by rapid ones. We propose a technique that overcomes this limitation by relying on a statistical model, not of the pixel intensities, but of the illumination effects. Because they tend to affect whole areas of the image as opposed to individual pixels, low-dimensional models are appropriate for this purpose and make our method extremely robust to illumination changes, whether slow or fast.

We will demonstrate its performance by comparing it to two representative implementations of state-of-the-art methods, and by showing its effectiveness for occlusion handling in a real-time Augmented Reality context.


Input Image Augmented Reality Gaussian Mixture Model Background Subtraction Background Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Zivkovic, Z., van der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recognition Letters 27(7), 773–780 (2006)CrossRefGoogle Scholar
  2. 2.
    Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-time tracking of the human body. In: Photonics East, SPIE, vol. 2615 (1995)Google Scholar
  3. 3.
    Friedman, N., Russell, S.: Image segmentation in video sequences: A probabilistic approach. In: Annual Conference on Uncertainty in Artificial Intelligence, pp. 175–181 (1997)Google Scholar
  4. 4.
    Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: CVPR, pp. 246–252 (1999)Google Scholar
  5. 5.
    Bishop, C.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2006)zbMATHGoogle Scholar
  6. 6.
    Elgammal, A., Duraiswami, R., Harwood, D., Davis, L.: Background and foreground modeling using nonparametric kernel density for visual surveillance. Proceedings of the IEEE 90, 1151–1163 (2002)CrossRefGoogle Scholar
  7. 7.
    Sheikh, Y., Shah, M.: Bayesian modeling of dynamic scenes for object detection. PAMI 27, 1778–1792 (2005)Google Scholar
  8. 8.
    Prati, A., Mikic, I., Trivedi, M., Cucchiara, R.: Detecting moving shadows: Algorithms and evaluation. PAMI 25, 918–923 (2003)Google Scholar
  9. 9.
    Stauder, J., Mech, R., Ostermann, J.: Detection of moving cast shadows for object segmentation. IEEE Transactions on Multimedia 1(1), 65–76 (1999)CrossRefGoogle Scholar
  10. 10.
    Jabri, S., Duric, Z., Wechsler, H., Rosenfeld, A.: Detection and location of people in video images using adaptive fusion of color and edge information. In: International Conference on Pattern Recognition, vol. 4, pp. 627–630 (2000)Google Scholar
  11. 11.
    Heikkila, M., Pietikainen, M.: A texture-based method for modeling the background and detecting moving objects. PAMI 28(4), 657–662 (2006)Google Scholar
  12. 12.
    Criminisi, A., Cross, G., Blake, A., Kolmogorov, V.: Bilayer segmentation of live video. In: CVPR, pp. 53–60 (2006)Google Scholar
  13. 13.
    Lepetit, V., Pilet, J., Geiger, A., Mazzoni, A., Oezuysal, M., Fua, P.: Bazar,
  14. 14.
    Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM SIGGRAPH (2004)Google Scholar
  15. 15.
    Fransens, R., Strecha, C., Van Gool, L.: A mean field EM-algorithm for coherent occlusion handling in map-estimation problems. In: CVPR (2006)Google Scholar
  16. 16.
    Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: principles and practice of background maintenance. In: International Conference on Computer Vision, vol. 1, pp. 255–261 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Julien Pilet
    • 1
  • Christoph Strecha
    • 1
  • Pascal Fua
    • 1
  1. 1.École Polytechnique Fédérale de LausanneSwitzerland

Personalised recommendations