Real-Time Multi-view 3D Object Tracking in Cluttered Scenes

  • Huan Jin
  • Gang Qian
  • Stjepan Rajko
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4292)


This paper presents an approach to real-time 3D object tracking in cluttered scenes using multiple synchronized and calibrated cameras. The goal is to accurately track targets over a long period of time in the presence of complete occlusion in some of the camera views. In the proposed system, color histogram was used to represent object appearance. Tracked 3D object locations were smoothed and new locations predicted using a Kalman filter. The predicted object 3D location was then projected onto all camera views to provide a search region for robust 2D object tracking and occlusion detection. The experimental results were validated using ground-truth data obtained from a marker-based motion capture system. The results illustrate that the proposed approach is capable of effective and robust 3D tracking of multiple objects in cluttered scenes.


Color Histogram Camera View Search Region Color Segmentation Diamond Search 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kang, J., Cohen, I., Medioni, G.: Tracking people in crowded scenes across multiple cameras. In: Asian Conference on Computer Vision (2004)Google Scholar
  2. 2.
    Mittal, A., Davis, L.S.: M2tracker: A multi-view approach to segmenting and tracking people in a cluttered scene using region-based stereo. International Journal of Computer Vision (IJCV) 3, 189–203 (2003)CrossRefGoogle Scholar
  3. 3.
    Javed, O., Rasheed, Z., Alatas, O., Shah, M.: Knight: A real time surveillance system for multiple overlapping and non-overlapping cameras. In: 4th International Conference on Multimedia and Expo (2003)Google Scholar
  4. 4.
    Yue, Z., Zhou, S., Chellappa, R.: Robust two-camera tracking using homography. In: Proc. of IEEE Intl. Conf. on Acoustics, Speech and Signal Processing, pp. 1–4 (2004)Google Scholar
  5. 5.
    Black, J., Ellis, T., Rosin, P.: Multi view image surveillance and tracking. In: IEEE Workshop on Motion and Video Computing (2002)Google Scholar
  6. 6.
    Berclaz, J., Fleuret, F., Fua, P.: Robust people tracking with global trajectory optimization. In: IEEE Conf. on Computer Vision and Pattern Recognition (2006)Google Scholar
  7. 7.
    Nummiaro, K., Koller-Meier, E., Svoboda, T., Roth, D., Van Gool, L.: Color-based object tracking in multi-camera environments. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 591–599. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  8. 8.
    Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)MATHGoogle Scholar
  9. 9.
    Zhu, S., Ma, K.K.: A new diamond search algorithm for fast block-matching motion estimation. IEEE Trans. on Image Processing 9, 287–290 (2000)CrossRefGoogle Scholar
  10. 10.
    Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: IEEE Conf. on Computer Vision and Pattern Recognition, Hilton Head Island, South Carolina, USA, vol. 2, pp. 142–149 (2000)Google Scholar
  11. 11.
    Svoboda, T., Martinec, D., Pajdla, T.: A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments 14, 407–422 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Huan Jin
    • 1
    • 3
  • Gang Qian
    • 2
    • 3
  • Stjepan Rajko
    • 1
    • 3
  1. 1.Dept. of Computer Science and Engineering 
  2. 2.Dept. of Electrical Engineering 
  3. 3.Arts, Media and Engineering ProgramArizona State UniversityTempeUSA

Personalised recommendations