Skip to main content

Advertisement

Log in

Motion priors based on goals hierarchies in pedestrian tracking applications

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

In this paper, the problem of automated scene understanding by tracking and predicting paths for multiple humans is tackled, with a new methodology using data from a single, fixed camera monitoring the environment. Our main idea is to build goal-oriented prior motion models that could drive both the tracking and path prediction algorithms, based on a coarse-to-fine modeling of the target goal. To implement this idea, we use a dataset of training video sequences with associated ground-truth trajectories and from which we extract hierarchically a set of key locations. These key locations may correspond to exit/entrance zones in the observed scene, or to crossroads where trajectories have often abrupt changes of direction. A simple heuristic allows us to make piecewise associations of the ground-truth trajectories to the key locations, and we use these data to learn one statistical motion model per key location, based on the variations of the trajectories in the training data and on a regularizing prior over the models spatial variations. We illustrate how to use these motion priors within an interacting multiple model scheme for target tracking and path prediction, and we finally evaluate this methodology with experiments on common datasets for tracking algorithms comparison.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Alahi, A., Ramanathan, V., Fei-Fei, L.: Socially-aware large-scale crowd forecasting. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (2014)

  2. Ali, S., Shah, M.: Floor fields for tracking in high density crowd scenes. In: Proceedings of the European Conference on Computer Vision, pp. 1–14 (2008)

  3. Andriyenko, A., Schindler, K., Roth, S.: Discrete-continuous optimization for multi-target tracking. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1926–1933 (2012)

  4. Arechavaleta, G., Laumond, J.P., Hicheur, H., Berthoz, A.: An optimality principle governing human walking trajectories. IEEE Trans. Robot. 24, 5–14 (2008)

    Article  Google Scholar 

  5. Bascetta, L., Ferretti, G., Rocco, P., Ardo, H., Bruyninckx, H., Demeester, E., Di Lello, E.: Towards safe human–robot interaction in robotic cells: an approach based on visual tracking and intention estimation. In: Proceedings of the IEEE International Conference on Intelligent Robots and Systems, pp. 2971–2978 (2011)

  6. Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3457–3464 (2011)

  7. Bennewitz, M., Burgard, W., Cielniak, G., Thrun, S.: Learning motion patterns of people for compliant robot motion. Int. J. Robot. Res. 24, 31–48 (2005)

    Article  Google Scholar 

  8. Berclaz, J., Fleuret, F., Fua, P.: Multi-camera tracking and atypical motion detection with behavioral maps. In: Proceedings of the European Conference on Computer Vision, pp. 112–125 (2008)

  9. Bouguet, J.: Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm. In: Technical Report Intel Corporation Microprocessor Research Labs (1999)

  10. Bruce, A., Gordon, G.: Better motion prediction for people-tracking. In: Proceedings of the International Conference on Robotics and Automation (2004)

  11. Chen, C., Heili, A., Odobez, J.: Combined estimation of location and body pose in surveillance video. In: Proceedings of the IEEE Interenational Conference on Advanced Video and Signal-Based Surveillance, pp. 5–10 (2011)

  12. Dehghan, A., Assari, S.M.: Gmmcp tracker: Globally optimal generalized maximum multi clique problem for multiple object tracking. In: Proceedings of the IEEE Interenational Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4091–4099 (2015)

  13. Dehghan, A., Kalayeh, M.M.: Understanding crowd collectivity: a meta-tracking approach. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 1–9 (2015)

  14. Dehghan, A., Tian, Y., Torr, P.H.S., Shah, M.: Target identity-aware network flow for online multiple target tracking. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1146–1154 (2015)

  15. Ellis, A., Ferryman, J.: PETS2010 and PETS2009 evaluation of results using individual ground truth single views. In: Proceedings of the IEEE Interenational Conference on Advanced Video and Signal-Based Surveillance, pp. 135–142 (2010)

  16. Ferryman, J., Ellis, A.L.: Performance evaluation of crowd image analysis using the PETS2009 dataset. Pattern Recognit. Lett. 44, 3–15 (2014)

    Article  Google Scholar 

  17. Hicheur, H., Pham, Q.C., Arechavaleta, G., Laumond, J.P., Berthoz, A.: The formation of trajectories during goal-oriented locomotion in humans. Eur. J. Neurosci. 26, 2376–2390 (2007)

  18. Ikeda, T., Chigodo, Y., Rea, D., Zanlungo, F., Shiomi, M., Kanda, T.: Modeling and prediction of pedestrian behavior based on the sub-goal concept. In: Proceedings of the International Conference on Robotics: Science and Systems (2012)

  19. Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice-Hall, Inc, Upper Saddle River (1988)

    MATH  Google Scholar 

  20. Jiang, H., Wang, J., Gong, Y., Rong, N., Chai, Z., Zheng, N.: Online multi-target tracking with unified handling of complex scenarios. IEEE Trans. Image Process. 24(11), 3464–3477 (2015)

    Article  MathSciNet  Google Scholar 

  21. Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Garofolo, J., Bowers, R., Boonstra, M., Korzhova, V., Zhang, J.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 319–336 (2009)

    Article  Google Scholar 

  22. Leal-Taixe, L., Fenzi, M., Kuznetsova, A., Rosenhahn, B., Savarese, S.: Learning an image-based motion context for multiple people tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2014)

  23. Leal-Taixé, L., Pons-Moll, G., Rosenhahn, B.: Everybody needs somebody: modeling social and grouping behavior on a linear programming multiple people tracker. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops (2011)

  24. Lee, D., Hwang, I., Oh, S.: Optimus:online persistent tracking and identification of many users for smart spaces. Mach. Vis. Appl. 25(4), 901–917 (2014)

    Article  Google Scholar 

  25. Luber, M., Stork, J.A., Tipaldi, G.D., Arras, K.O.: People tracking with human motion predictions from social forces. In: Proceedings of the International Conference on Robotics and Automation, pp. 464–469 (2010)

  26. Luber, M., Tipaldi, G.D., Arras, K.O.: Place-dependent people tracking. Int. J. Robot. Res. 30(3), 0278364910393538 (2011)

    Article  MATH  Google Scholar 

  27. Madrigal, F., Hayet, J.B.: Evaluation of multiple motion models for multiple pedestrian visual tracking. In: Proceedings of the IEEE International Conference on Advanced Video and Signal-Based Surveillance (2013)

  28. Madrigal, F., Hayet, J.B.: Goal-oriented visual tracking of pedestrians with motion priors in semi-crowded scenes. In: Proceedings of the IEEE International Conference on Robotics and Automation (2015)

  29. Madrigal, F., Rivera, M., Hayet, J.: Learning and regularizing motion models for enhancing particle filter-based target tracking. In: Proceedings of Pacific-Rim Symposium Image and Video Technology, vol. 2, pp. 287–298 (2011)

  30. Milan, A., Schindler, K., Roth, S.: Challenges of ground truth evaluation of multi-target tracking. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) (2013)

  31. Perez, P., Vermaak, J., Blake, A.: Data fusion for visual tracking with particles. Proc. IEEE 92(3), 495–513 (2004)

    Article  Google Scholar 

  32. Sugar, C.A., James, G.M.: Finding the number of clusters in a dataset: an information theoretic approach. J. Am. Stat. Assoc. 98(463), 750–763 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  33. Vasquez, D., Fraichard, T., Aycard, O., Laugier, C.: Intentional motion on-line learning and prediction. Mach. Vis. Appl. 19(5–6), 411–425 (2008)

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge Intel and Conacyt for partially funding this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Francisco Madrigal.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (avi 14596 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Madrigal, F., Hayet, JB. Motion priors based on goals hierarchies in pedestrian tracking applications. Machine Vision and Applications 28, 341–359 (2017). https://doi.org/10.1007/s00138-017-0832-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-017-0832-8

Keywords

Navigation