Tracking without Background Model for Time-of-Flight Cameras

  • Luca Bianchi
  • Riccardo Gatti
  • Luca Lombardi
  • Paolo Lombardi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


Time-of-flight (TOF) cameras are relatively new sensors that provide a 3D measurement of a scene. By means of the distance signal, objects can be separated from the background on the basis of their distance from the sensor. For virtual studios applications, this feature can represent a revolution as virtual videos can be produced without a studio. When TOF cameras become available to the consumer market, everybody may come to be a virtual studio director. We study real-time fast algorithms to enable unprofessional virtual studio applications by TOF cameras. In this paper we present our approach to foreground segmentation, based on smart-seeded region growing and Kalman tracking. With respect to other published work, this method allows for working with a non-stationary camera and with multiple actors or moving objects in the foreground providing high accuracy for real-time computation.


Time-of-flight cameras region growing tracking virtual studio 


  1. 1.
    Shimoda, S., Hayashi, M., Kantsugu, Y.: New chroma-key imaging technique. IEEE Trans. On Broadcasting 35(4), 110–234 (1989)CrossRefGoogle Scholar
  2. 2.
    Gibbs, S., Arapis, C., Breiteneder, C., Lalioti, V., Mostafawy, S., Speier, J.: Virtual Studios: an overview. IEEE Multimedia 5(1), 18–35 (1998)CrossRefGoogle Scholar
  3. 3.
    Kolb, A., Barth, E., Koch, R.: ToF-Sensors: New Dimensions for Realism and Interactivity. In: CVPR 2008 Workshop On Time of Flight Camera based Computer Vision (TOF-CV) (accessed on July 23rd),
  4. 4.
    Gvili, R., Kaplan, A., Ofek, E., Yahav, G.: Depth Key. In: SPIE Electronic Imaging 2003 Conference, Santa Clara, CA (2003)Google Scholar
  5. 5.
    Oggier, T., Lehmann, M., Kaufmann, R., Schweizer, M., Richter, M., Metzler, P., Lang, G., Lustenberger, F., Blanc, N.: An all-solid-state optical range camera for 3D real-time imaging with sub-centimeter depth resolution (SwissRanger). In: Mazuray, L., Rogers, P.J., Wartmann, R. (eds.) Optical Design and Engineering, Proceedings of the SPIE, vol. 5249, pp. 534–545 (2004)Google Scholar
  6. 6.
    Felder, J., Weiss, S.: Time-of-Flight Imaging for Industrial Applications, Master Thesis, ETH Swiss Federal Institute of Technology Zurich (2007)Google Scholar
  7. 7.
    Witzner, D., Mads, H., Hansen, S., Kirschmeyer, M., Larsen, R., Silvestre, D.: Cluster Tracking with Time-of-Flight Cameras. In: CVPR 2008 Workshop On Time of Flight Camera based Computer Vision (TOF-CV),
  8. 8.
    Guðmundsson, S.A., Larsen, R., Aanæs, H., Pardàs, M., Casas, J.R.: TOF Imaging in Smart Room Environments towards Improved People Tracking. In: CVPR 2008 Workshop On Time of Flight Camera based Computer Vision (accessed 23/7/2008),
  9. 9.
    Bevilacqua, A., Di Stefano, L., Azzari, P.: People tracking using a time-of-flight depth sensor. In: IEEE Int. Conference on Video and Signal Based Surveillance, p. 89(2006)Google Scholar
  10. 10.
    Adams, R., Bischof, L.: Seeded Region Growing. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(6), 641–647 (1994)CrossRefGoogle Scholar
  11. 11.
    Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise, pp. 226–231. AAAI Press, Menlo Park (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Luca Bianchi
    • 1
  • Riccardo Gatti
    • 1
  • Luca Lombardi
    • 1
  • Paolo Lombardi
    • 1
  1. 1.Dept. of Computer Engineering and Systems ScienceUniversity of PaviaPaviaItaly

Personalised recommendations