Skip to main content
SpringerLink
Log in

People tracking using a network-based PTZ camera

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

In this paper, we propose a method for online upper body tracking using an IP PTZ camera. This type of camera uses a built-in Web server resulting in variable response times when sending control commands. Furthermore, communicating with a Web server involves network delays. Thus, because the camera is inside a control loop, the effective frame rate that can be processed by a computer vision method is irregular and in general low (2–6 fps). Our tracking method has been specifically designed to perform in such conditions. It detects, at every frame, candidate blobs using motion detection, region sampling, and region color appearance. The target is detected among candidate blobs using a fuzzy classifier. Then, a movement command is sent to the camera using the target position and speed. The proposed method can cope with low frame rate, and thus with large motion of the target, even in the case of a fast walk. Results show that our system has a good target detection precision (>88%) and low track fragmentation, and the target is almost always localized within 1/6th of the image diagonal from the image center.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahmed J., Jafri M., Shah M., Akbar M.: Real-time edge-enhanced dynamic correlation and predictive open-loop car-following control for robust tracking. J. Mach. Vis. Appl. 19(1), 1–25 (2008)

    Article  Google Scholar 

  2. Araki S., Matsuoka N., Yokoya N., Takemura H.: Realtime tracking of multiple moving object contours in a moving camera image sequences. IEICE Trans. Inf. Syst. E83-D(7), 1581–1591 (2000)

    Google Scholar 

  3. Bagdanov, A.D., del Bimbo, A., Nunziati, W.: Improving evidential quality of surveillance imagery through active face tracking. In: Proceedings of International Conference on Pattern Recognition (ICPR), pp. 1200–1203 (2006)

  4. Bellotto, N., Huosheng, H.: People tracking and identification with a mobile robot. In: IEEE International Conference on Mechatronics and Automation (ICMA) (2007)

  5. Bellotto, N., Sommerlade, E., Benfold, B., Bibby, C., Reid, I., Roth, D., Fernández, C., Gool, L.V., Gonzàlez, J.: A distributed camera system for multi-resolution surveillance. In: Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC) (2009)

  6. Bernardin, K., Camp, F., Stiefelhagen, R.: Automatic person detection and tracking using fuzzy controlled active cameras. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2007)

  7. Boufama, B., Ali, M.: Tracking multiple people in the context of video surveillance. In: International Conference on Image Analysis and Recognition (ICIAR) (2007)

  8. Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Microcomputer Research Lab, Santa Cla (1998)

  9. Cha S.H., Srihari S.N.: On measuring the distance between histograms. Pattern Recognit. 35(6), 1355–1370 (2002)

    Article  MATH  Google Scholar 

  10. Chan, C., Oe, S., Lin, C.: Active eye-tracking system by using quad PTZ cameras. In: IEEE Conference on Industrial Electronics Society (IECON), vol. 5 (2007)

  11. Chen C., Yao Y.C. Jr., Abidi B., Koschan A., Abidi M.: Heterogeneous fusion of omnidirectional and PTZ cameras for multiple object tracking. IEEE Trans. Circuits Syst. Video Technol. 18(8), 1052–1063 (2008)

    Article  Google Scholar 

  12. Cindy X., Collange F., Jurie F., Martinet P.: Object tracking with a pan-tilt-zoom camera: application to car driving assistance. IEEE Int. Conf. Robot. Autom. 2, 1653–1658 (2001)

    Google Scholar 

  13. Collins, R., Lipton, A., Kanade, T.: A system for video surveillance and monitoring. In: Proceedings of the American Nuclear Society (ANS) Eighth International Topical Meeting on Robotics and Remote Systems (1999)

  14. Comaniciu, D., Ramesh, V.: Robust detection and tracking of human faces with an active camera. In: Proceedings of the Third IEEE International Workshop on Visual Surveillance, pp. 11–18 (2000)

  15. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 886–893 (2005)

  16. Elder J.H., Prince S., Hou Y., Sizintsev M., Olevsky E.: Pre-attentive and attentive detection of humans in wide-field scenes. Int. J. Comput. Vis. 72(1), 47–66 (2007)

    Article  Google Scholar 

  17. Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: IEEE Workshop on FRAME-RATE, pp. 751–767 (2000)

  18. Everts, I., Sebe, N., Jones, G.: Cooperative object tracking with multiple PTZ cameras. In: International Conference on Image Analysis and Processing (ICIAP), pp. 323–330 (2007)

  19. Funahashi T., Fujiwara T., Koshimizu H.: Hierarchical tracking of face, facial parts and their contours with PTZ camera. IEEE Int. Conf. Ind. Technol. (ICIT) 1, 198–203 (2004)

    Google Scholar 

  20. Funahashi, T., Tominaga, M., Fujiwara, T., Koshimizu, H.: Hierarchical face tracking by using ptz camera. In: IEEE International Conference on Automatic Face and Gesture Recognition (FGR), pp. 427–432 (2004)

  21. Intel Corporation: Camshift tracker (2001). http://worldlibrary.net/eBooks/Give-Away/Technical_eBooks/OpenCVReferenceManual.pdf. Accessed 21 May 2010

  22. Isard M., Blake A.: Condensation: conditional density propagation for visual tracking. Int. J. Comput. Vis. 29, 5–28 (1998)

    Article  Google Scholar 

  23. Kakumanu P., Makrogiannis S., Bourbakis N.: A survey of skin-color modeling and detection methods. Pattern Recognit. 40(3), 1106–1122 (2007)

    Article  MATH  Google Scholar 

  24. Kang, S., Abidi, B., Abidi, M.: integration of color and shape for detecting and tracking security breaches in airports. In: International Carnahan Conference on Security Technology, pp. 289–294 (2004)

  25. Kang, S., Paik, J., Koschan, A., Abidi, B., Abidi, M.: Real-time video tracking using PTZ cameras. In: 6th International Conference on Quality Control by Artificial Vision (2003)

  26. Krahnstoever N., Mendonca P.: Bayesian autocalibration for surveillance. IEEE Int. Conf. Comput. Vis. (ICCV) 2, 1858–1865 (2005)

    Google Scholar 

  27. Krahnstoever, N., Tu, P., Sebastian, T., Perera, A., Collins, R.: multi-view detection and tracking of travelers and luggage in mass transit environments. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance and CVPR (2006)

  28. Krahnstoever, N., Yu, T., Lim, S.: Collaborative real-time control of active cameras in large scale surveillance systems. In: European Conference on Computer Vision (ECCV) (2008)

  29. Lu, Y., Payandeh, S.: Cooperative hybrid multi-camera tracking for people surveillance. In: Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1365–1368 (2008)

  30. Leichter I., Lindenbaum M., Rivlin E.: Bittracker—a bitmap tracker for visual tracking under very general conditions. IEEE T-PAMI 30(9), 1572–1588 (2008)

    Article  Google Scholar 

  31. Li Y., Ai H., Yamashita T., Lao S., Kawade M.: Tracking in low frame rate video: a cascade particle filter with discriminative observers of different life spans. IEEE T-PAMI 30(10), 1728–1740 (2008)

    Article  Google Scholar 

  32. Lim, S.N., Elgammal, A., Davis, L.: Image-based pan-tilt camera control in a multi-camera surveillance environment. In: Proceedings on International Conference on Multimedia and Expo (ICME), vol. 1, pp. 645–648 (2003)

  33. Math Forum: Points within an ellipse (2003). http://mathforum.org/library/drmath/view/63045.html. Accessed 1 April 2009

  34. Math Open Reference: Foci of an ellipse (2008). http://www.mathopenref.com/ellipsefoci.html. Accessed 1 April 2009

  35. Matsuyam, T., Hiura, S., Wada, T., Muease, K., Toshioka, A.: Dynamic memory: architecture for real time integration of visualperception, camera action, and network communication. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 728–735 (2000)

  36. Murray D., Basu A.: Motion tracking with an active camera. IEEE Trans. Pattern Anal. Mach. Intell. 14, 449–459 (1994)

    Article  Google Scholar 

  37. Roha M., Kima T., Park J., Lee S.: Accurate object contour tracking based on boundary edge selection. Pattern Recognit. 40(3), 931–943 (2007)

    Article  Google Scholar 

  38. Schreiber D.: Generalizing the lucas-kanade algorithm for histogram-based tracking. Pattern Recognit. Lett. 29(7), 852–861 (2008)

    Article  Google Scholar 

  39. Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 593–600 (1994)

  40. Sommerlade, E., Reid, I.: Information-theoretic active scene exploration. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7 (2008)

  41. Sony Corporation: Snc-rz25n/p CGI Command Manual, Version 1.0 (2005)

  42. Tomasi, C., Kanade, T.: detection and tracking of point features. Carnegie Mellon University Technical Report CMU-CS, 91–132 (1991)

  43. Venkatesh Babu R., Perez P., Bouthemy P.: Robust tracking with motion estimation and local kernel-based color modeling. Image Vis. Comput. 25(8), 1205–1216 (2007)

    Article  Google Scholar 

  44. Viola P., Jones J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  45. Yao, Y., Abidi, B., Abidi, M.: 3D target scale estimation and motion segmentation for size preserving tracking in ptz video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), pp. 130–136 (2006)

  46. Yilmaz A., Li X., Shah M.: Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)

    Article  Google Scholar 

  47. Yin, F., Makris, D., Velastin, S.: Performance evaluation of object tracking algorithms. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS) (2007)

  48. Zhu, Q., Avidan, S., Yeh, M., Cheng, K.: Fast human detection using a cascade of histograms of oriented gradients. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1491–1498 (2006)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering and Software Engineering, École Polytechnique de Montréal, P. O. Box 6079, Station Centre-ville, Montreal, QC, H3C 3A7, Canada

    Parisa Darvish Zadeh Varcheie & Guillaume-Alexandre Bilodeau

Authors
  1. Parisa Darvish Zadeh Varcheie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guillaume-Alexandre Bilodeau
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Parisa Darvish Zadeh Varcheie.

Electronic Supplementary Material

The Below are the Electronic Supplementary Material.

ESM 1 (AVI 1,807 KB)

ESM 2 (AVI 1,484 KB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Varcheie, P.D.Z., Bilodeau, GA. People tracking using a network-based PTZ camera. Machine Vision and Applications 22, 671–690 (2011). https://doi.org/10.1007/s00138-010-0300-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-010-0300-1

Keywords

Search

Navigation