Segmentation of Scenes of Mobile Objects and Demonstrable Backgrounds

  • Frederic Maire
  • Timothy Morris
  • Andry Rakotonirainy


In this paper we present a real-time foreground-background segmentation algorithm that exploits the following observation (very often satisfied by a static camera positioned high in its environment). If a blob moves on a pixel p that had not changed its colour significantly for a few frames, then p was probably part of the background when its colour was static. With this information we are able to update differentially pixels believed to be background. This work is relevant to autonomous minirobots, as they often navigate in buildings where smart surveillance cameras could communicate wirelessly with them. A by-product of the proposed system is a mask of the image regions which are demonstrably background. Statistically significant tests show that the proposed method has a better precision and recall rates than the state of the art foreground/background segmentation algorithm of the OpenCV computer vision library.


Mobile Robot Local Binary Pattern Background Model Foreground Object Mobile Object 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cheung, S.-C.S., Kamath, C.: Robust techniques for background subtraction in urban traffic video. In: Panchanathan, S. (ed.) Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Presented at the Society of Photo-Optical Instrumentation Engineers (SPIE) Conference, vol. 5308, pp. 881–892 (January 2004)Google Scholar
  2. 2.
    Heikkilä, M., Pietikainen, M.: A texture-based method for modeling the background and detecting moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(4), 657–662 (2006)CrossRefGoogle Scholar
  3. 3.
    Huwer, S., Niemann, H.: Adaptive change detection for real-time surveillance applications. In: Proceedings. Third IEEE International Workshop on Visual Surveillance, pp. 37–46 (2000)Google Scholar
  4. 4.
    Kim, H., Sakamoto, R., Kitahara, I., Toriyama, T., Kogure, K.: Robust foreground extraction technique using background subtraction with multiple thresholds. In: Optical Engineering, vol. 46, SPIE (September 2007)Google Scholar
  5. 5.
    Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground-background segmentation using codebook model. Real-Time Imaging 11(3), 167–256 (2005), Special Issue on Video Object Processing CrossRefGoogle Scholar
  6. 6.
    Lai, A.-N., Yoon, H., Lee, G.: Robust background extraction scheme using histogram-wise for real-time tracking in urban traffic video. In: 8th IEEE International Conference on Computer and Information Technology, CIT 2008, July 2008, pp. 845–850 (2008)Google Scholar
  7. 7.
    Lee, D.-S.: Effective gaussian mixture learning for video background subtraction. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(5), 827–832 (2005)CrossRefGoogle Scholar
  8. 8.
    Li, L., Huang, W., Gu, I.Y.H., Tian, Q.: Foreground object detection from videos containing complex background. In: MULTIMEDIA 2003: Proceedings of the Eleventh ACM International Conference on Multimedia, pp. 2–10. ACM Press (2003)Google Scholar
  9. 9.
    Losada, C., Mazo, M., Palazuelos, S., Redondo, F.: Adaptive threshold for robust segmentation of mobile robots from visual information of their own movement. In: IEEE International Symposium on Intelligent Signal Processing, WISP 2009, August 2009, pp. 293–298 (2009)Google Scholar
  10. 10.
    Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 246–252 (1999)Google Scholar
  11. 11.
    Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: principles and practice of background maintenance. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, pp. 255–261 (1999)Google Scholar
  12. 12.
    Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997)CrossRefGoogle Scholar
  13. 13.
    Zivkovic, Z.: Improved adaptive gaussian mixture model for background subtraction, vol. 2, pp. 28–31(August 2004)Google Scholar

Copyright information

© Springer-Verlag GmbH Berlin Heidelberg 2012

Authors and Affiliations

  • Frederic Maire
    • 1
  • Timothy Morris
    • 2
  • Andry Rakotonirainy
    • 3
  1. 1.FaST QUT and NICTA QRLBrisbaneAustralia
  2. 2.FaST QUTBrisbaneAustralia
  3. 3.CARRS-Q QUTBrisbaneAustralia

Personalised recommendations