Skip to main content
Log in

Motion priors for multiple target visual tracking

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This article describes an original strategy for enhancing current state-of-the-art trackers through the use of motion priors, built as data-driven probabilistic motion models for moving targets. Our priors have a simple form and can replace advantageously more traditional models, such as the constant velocity or constant acceleration models, that are of common use in visual tracking systems, but that are also prone to fail in handling critical scene-related constraints on the targets motion. These priors are learned based on local motion observed in the video stream(s) and, given that the obtained representation may be incomplete and noisy, we regularize it in a second phase. The hybrid discrete–continuous motion priors are then used within two classical target tracking approaches: (1) as a sampling distribution in a particle filter framework and (2) as a weighting prior in a detection-based framework. For both tracking schemes, we present promising results with our motion prior approach, on classical benchmark datasets from the visual surveillance tracking literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Open source computer vision (opencv). URL http://opencv.willowgarage.com

  2. IEEE international workshop on performance evaluation of tracking and surveillance (PETS’2006). URL http://www.cvg.rdg.ac.uk/PETS2006/data.html (2006)

  3. IEEE international workshop on performance evaluation of tracking and surveillance (PETS’2009). URL http://www.pets2009.net (2009)

  4. Ali, S., Shah, M.: Floor fields for tracking in high density crowd scenes. In: Proceedings of the European conference on computer vision (ECCV), pp. 1–14 (2008)

  5. Ben Shitrit, H., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global appearance constraints. In: IEEE international conference on computer vision (ICCV), pp. 137–144 (2011)

  6. Bennewitz, M., Burgard, W., Cielniak, G., Thrun, S.: Learning motion patterns of people for compliant robot motion. Int. J. Robotics Res. 24, 31–48 (2005)

    Article  Google Scholar 

  7. Berclaz, J., Fleuret, F., Fua, P.: Multi-camera tracking and atypical motion detection with behavioral maps. In: Proceedings of the European conference on computer vision (ECCV), pp. 112–125 (2008)

  8. Berclaz, J., Fleuret, F., Turetken, E., Fua, P.: Multiple object tracking using K-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33(9), 1806–1819 (2011)

    Article  Google Scholar 

  9. Bouguet, J.: Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm. Intel Corporation Microprocessor Research Labs. Technical report (1999)

  10. Butt, A.A., Collins, R.T.: Multi-target Tracking by Lagrangian Relaxation to Min-cost Network Flow. In: IEEE conference on computer vision and pattern recognition (CVPR), pp. 1846–1853 (2013)

  11. Collins, R.T.: Multitarget data association with higher-order motion models. In: IEEE conference on computer vision and pattern recognition (CVPR), pp. 1744–1751 (2012)

  12. Ferryman, J., Ellis, A.L.: Performance evaluation of crowd image analysis using the PETS2009 dataset. Pattern Recognit. Lett. 44, 3–15 (2014)

    Article  Google Scholar 

  13. Fleuret, F., Berclaz, J., Lengagne, R., Fua, P.: Multicamera people tracking with a probabilistic occupancy map. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 267–282 (2008)

    Article  Google Scholar 

  14. Hernandez-Lopez, F., Rivera, M.: Binary segmentation of video sequences in real time. In: Proceedings of the international conference on Mexican international conference on artificial intelligence (MICAI), pp. 163–168 (2010)

  15. Hu, W.M., Hu, M., Zhou, X., Tan, T.N., Lou, J., Maybank, S.J.: Principal axis-based correspondence between multiple cameras for people tracking. IEEE Trans. Pattern Anal. Mach. Intell. 27(4), 663–671 (2006)

    Google Scholar 

  16. Isard, M., Blake, A.: Condensation—conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(2), 5–28 (1998)

  17. Joshi, K.A., Thakore, D.G.: A survey on moving object detection and tracking in video surveillance system. Int. J. Soft Comput. Eng. 2(3), 44–48 (2012)

    Google Scholar 

  18. Kang, J., Cohen, I., Medioni, G.: Tracking people in crowded scenes across multiple cameras. Asian Conf. Comput. Vis. (ACCV) 1, 390–395 (2004)

    Google Scholar 

  19. Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Garofolo, J., Bowers, R., Boonstra, M., Korzhova, V., Zhang, J.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 319–336 (2009)

    Article  Google Scholar 

  20. Kuo, C.H., Huang, C., Nevatia, R.: Multi-target tracking by on-line learned discriminative appearance models. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 685–692 (2010)

  21. Leibe, B., Schindler, K., Gool, L.V.: Coupled detection and trajectory estimation for multi-object tracking. In: Proceedings of the international conference on computer vision (ICCV), pp. 1–8 (2007)

  22. Li, X., Hu, W., Shen, C., Zhang, Z., Dick, A., van den Hengel, A.: A survey of appearance models in visual object tracking. ACM Trans. Intell. Syst. Technol. 4(4), 1–48 (2013). doi:10.1145/2508037.2508039

  23. Madrigal, F., Hayet, J.B.: Multiple view, multiple target tracking with principal axis-based. In: IEEE international conference on advanced video and signal-based surveillance (AVSS), pp. 185–190 (2011)

  24. Madrigal, F., Rivera, M., Hayet, J.: Learning and regularizing motion models for enhancing particle filter-based target tracking. In: Proceedings of Pacific-Rim symposium image and video technology (PSIVT), vol. 2, pp. 287–298 (2011)

  25. Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, NY (2006)

  26. Nummiaro, K., Koller-Meier, E., Svoboda, T., Roth, D., Van Gool, L.: Color-based object tracking in multi-cameras environment. In: DAGM-symposium, pp. 591–599 (2003)

  27. Odobez, J., Gatica-Perez, D.: Embedding motion in model-based stochastic tracking. In: Proceedings of the international conference on pattern recognition (ICPR), pp. 1–14 (2004)

  28. Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: European conference on computer vision (ECCV), pp. 661–675 (2002)

  29. Perez, P., Vermaak, J., Blake, A.: Data fusion for visual tracking with particles. Proc. IEEE 92(3), 495–513 (2004)

    Article  Google Scholar 

  30. Rivera, M., Dalmau, O., Mio, W., Ramirez-Manzanares, A.: Spatial sampling for image segmentation. Comput. J. 55(3), 313–324 (2012)

    Article  Google Scholar 

  31. Shi, J., Tomasi, C.: Good features to track. In: International conference on computer vision and pattern recognition (CVPR), pp. 593–600 (1994)

  32. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38(4), 45 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Francisco Madrigal.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Madrigal, F., Hayet, JB. & Rivera, M. Motion priors for multiple target visual tracking. Machine Vision and Applications 26, 141–160 (2015). https://doi.org/10.1007/s00138-015-0662-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0662-5

Keywords

Navigation