Multi-object Tracking Based on a Modular Knowledge Hierarchy

  • Martin Spengler
  • Bernt Schiele
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2626)


An important goal of research in computer vision systems is to develop architectures which are general and robust and at the same time transparent and easily transferable from one domain to another. To this extent this paper discusses and demonstrates the versatility of a multi-object tracking framework based on the so called knowledge hierarchy. The systematic description and analysis of a priori knowledge provides means not only for reducing the complexity of the multi-object tracking problem but also for building modular systems for solving it. The modularity of the framework, an essential ingredient for versatility, allows to replace individual parts of an existing system without altering the rest of the system or the overall architecture. The paper presents the modular framework including the knowledge hierarchy for multi object tracking. In order to demonstrate the transferability of the proposed approach the tracking framework is then applied to three different tracking scenarios (parking lot surveillance, people interaction monitoring, and dining table setup).


Computer Vision System Dine Table Foreground Segmentation Tracking Framework Shape Template 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Spengler, M., Schiele, B.: Multi-object tracking: Explicit knowledge representation and implementation for complexity reduction. In: Cognitive Vision Workshop, Zurich, Switzerland (2002)Google Scholar
  2. 2.
    Fablet, R., Black, M.J.: Automatic detection and tracking of human motion with a view-based representation. In: European Conference on Computer Vision. (2002) 476–491Google Scholar
  3. 3.
    Isard, M., Blake, A.: ICondensation: Unifying low-level and high-level tracking in a stochastic framework. Lecture Notes in Computer Science 1406 (1998) 893-??Google Scholar
  4. 4.
    Vermaak, J., Pérez, P., Gangnet, M., Blake, A.: Towards improved observation models for visual tracking: Selective adaptation. In: European Conference on Computer Vision. (2002) 645–660Google Scholar
  5. 5.
    Spengler, M., Schiele, B.: Towards robust multi-cue integration for visual tracking. In: International Workshop on Computer Vision Systems. (2001) 94–107Google Scholar
  6. 6.
    Koller-Meier, E., Ade, F.: Tracking multiple objects using the condensation algorithm. Journal of Robotics and Autonomous Systems 34 (2001) 93–105zbMATHCrossRefGoogle Scholar
  7. 7.
    Maskell, S., Rollason, M., Salmond, D., Gordon, N.: Efficient particle filtering for multiple target tracking with application to tracking in structured images. In: SPIE Vol 4728, Signal and Data Processing of Small Targets. (2002)Google Scholar
  8. 8.
    Isard, M., MacCormick, J.: BraMBLe: A bayesian multiple-blob tracker. In: Internation Conference on Computer Vision ICCV. (2001)Google Scholar
  9. 9.
    Hue, C., Le Cadre, J.P., Pérez, P.: Sequential monte carlo methods for multiple target tracking and data fusion. IEEE Transactions on Signal Processing 50 (2002) 309–325CrossRefGoogle Scholar
  10. 10.
    Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: European Conference on Computer Vision. (2002) 661–675Google Scholar
  11. 11.
    Tao, H., Sawhney, H.S., Kumar, R.: A sampling algorithm for tracking multiple objects. In: Workshop on Vision Algorithms. (1999) 53–68Google Scholar
  12. 12.
    Doucet, A., de Freitas, N., Gordon, N., eds.: Sequential Monte Carlo Methods in Practice. Statistics for Engineering and Information Science. Springer (2001)Google Scholar
  13. 13.
    Buxton, H., Gong, S.: Visual surveillance in a dynamic and uncertain world. Artificial Intelligence 78 (1995) 431–459CrossRefGoogle Scholar
  14. 14.
    Buxton, H.: Generative models for learning and understanding dynamic scene activity. In: 1st International Workshop on Generative-Model-Based Vision, Copenhagen, Denmark (2002)Google Scholar
  15. 15.
    Blake, A., Isard, M.: Active Contours. Springer Verlag (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Martin Spengler
    • 1
  • Bernt Schiele
    • 1
  1. 1.Perceptual Computing and Computer Vision Group, Computer Science DepartmentETH ZurichSwitzerland

Personalised recommendations