Particle Filter-Based Object Tracking and Handover in Disjoint View Multi-Cameras

  • Xiaoyan Sun
  • Faliang Chang
  • Wenhui Dong
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 215)


In intelligent video surveillance, multiple cameras, even a distributed network of video sensors, have to be employed to monitor activities over a complex area nowadays. Hence, the continuous object tracking across multiple cameras and object handover between adjacent cameras is urgently needed, in which many appearance cues and spatial–temporal information can be employed. This paper fuses the spatial–temporal cues with appearance cues into a particle filter to handle the camera handover with multiple cameras having non-overlapping view. The spatial–temporal cues, including source and sink regions, their transition probabilities, and transition time among adjacent regions, are learned offline. Then a spatial–temporal progressive matching scheme using particle filter is proposed to deal with camera handover among adjacent cameras. In particle filter matching course, the commonly used appearance cue, i.e. the histogram in HSV color space is used. Once an object enters into sink region, we first continuously scatter particles in source regions related to this sink region according spatial–temporal information until the object emergence detected, and secondly, based on the particle weights of every source region, adjust their particle numbers till the camera handover is successfully completed. Encouraging experiment results show the efficiency of this scheme.


Multi-camera surveillance Camera handover Particle filter Spatial–temporal information 



We would like to acknowledge the support from China Natural Science Foundation Committee (No. 60975025, No. 61273277), the Scientific Research Foundation for the Returned Overseas Chinese Scholars, State Education Ministry (20101174), Shandong province Natural Science Foundation Committee (No. ZR2011FM032), and the University Innovation Program from Jinan Science and Technology Bureau (No. 201004002).


  1. 1.
    Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Compu Surv 38(4):45Google Scholar
  2. 2.
    Wang X (2012) Intelligent multi-camera video surveillance: a review. Pattern Recogn Lett pp 1–25Google Scholar
  3. 3.
    Cai Y, Chen W, Huang K, Tan T (2007) Continuously tracking objects across multiple widely separated cameras ACCV. LNCS 4843:843–852Google Scholar
  4. 4.
    Focken D, Stiefelhagen R (2002) towards vision-based 3d people tracking in a smart room. In: Proceddings of IEEE international conference multimodal interfacesGoogle Scholar
  5. 5.
    Chang T-H, Gong S (2001) Tracking multiple people with a multi-camera system. In: Proceedings of IEEE workshop on multi-object trackingGoogle Scholar
  6. 6.
    Khan SM, Shah M (2006) A multiview approach to tracking people in crowded scenes using a planar homography constraint. ECCV 2006Google Scholar
  7. 7.
    Omar J, Sohaib K, Zeeshan R, Mubarak S (2000) Camera handoff: tracking in multiple uncalibrated stationary cameras. In: Proceedings workshop on human motion 2000Google Scholar
  8. 8.
    Nicholas J, Redding J, Fabian O, Judd K, Tristrom C (2008) Cross-matching via feature matching for camera handover with non-overlapping fields of view. In: Proceedings of digital image computing: techniques and applicationsGoogle Scholar
  9. 9.
    Omar J, Khurram S, Mubarak S (2005) Appearance modeling for tracking in multiple non-overlapping cameras. In: Proceddings of IEEE international conference computer vision and pattern recognition (CVPR)Google Scholar
  10. 10.
    Doretto G, Thomas S, Peter T, Jens R (2011) Appearance-based person reidentification in camera networks: problem overview and current approaches. J Ambient Intell Humaniz Comput 2:127–151Google Scholar
  11. 11.
    Zhou Q, Aggarwal JK (2006) Object tracking in an outdoor environment using fusion of features and cameras. Image Vis Comput 4(11):1244–1255CrossRefGoogle Scholar
  12. 12.
    Kuo C-H, Huang C, Nevatia R (2010) Inter-camera association of multi-target tracks by on-line learned appearance affinity models. ECCV 2010 Part I, LNCS 6311Google Scholar
  13. 13.
    Chen K-W, Lai C-C, Lee P-J, Chen C-S, Hung Y-P (2011) Adaptive learning for target tracking and true linking discovering across multiple non-overlapping cameras. IEEE Trans Multimed 13(4):625–638Google Scholar
  14. 14.
    Lim FL, Leoputra W, Tan T (2007) Non-overlapping distributed tracking system utilizing particle filter. J VLSI Sig Proc 49:343–362CrossRefGoogle Scholar
  15. 15.
    Cheng M-Y, Wang C-K (2007) Dynamic visual tracking based on multi-cue matching. In: Proceedings of international conference on mechatronicsGoogle Scholar
  16. 16.
    Weijer Jvd, Schmid C, Verbeek J (2007) Learning color names from real-world images. In: Proceddings of IEEE international conference computer vision and pattern recognition (CVPR)Google Scholar
  17. 17.
    Bolic M (2004) Architectures for efficient implementation of particle filters. Ph.D. thesis, electrical engineering, Stony Brook University, August 2004.
  18. 18.
    Isard M, Blake A (1998) Condensation-conditional density propagation for visual tracking. Int J Comput Vision 29(1):5–28CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.School of Control Science and EngineeringShandong UniversityShandongChina
  2. 2.School of Computer Science and TechnologyShandong Jianzhu UniversityJinanChina

Personalised recommendations