Skip to main content
SpringerLink
Log in

Adaptive Crowd Segmentation Based on Coherent Motion Detection

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

In order to obtain effective crowd relationships for crowd behavior analysis, an adaptive crowd segmentation method based on coherent motion detection is proposed. This method can improve the accuracy of segmentation results and be adaptively applied to various collective scenes that have different distributions at different scales. Firstly, an orientation clustering algorithm and a spatial joint strategy are proposed to preliminarily profile all agents into several partitions with different motion orientations. Then, the Natural Nearest Neighbor algorithm is introduced to construct the adaptive crowd motion networks combining with the profiling results, which can describe the neighborhood relationships of agents with stronger coherence. Finally, the improved Coherent Neighbor Invariance optimized by fusing motion information of neighbors is proposed to segment crowds with coherent motions from the crowd motion networks. The experiment results on videos depicting real-world crowd scenes indicate that the proposed method is effective and adaptive to various scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13

Similar content being viewed by others

References

  1. Shao, J., Kang, K., Chen, C.L., et al. (2015). Deeply Learned Attributes for Crowded Scene Understanding. In Proceedings of IEEE International Conference on Computer Vision (pp. 4657–4666).

  2. Jing, S., Chen, C.L., Kang, K., et al. (2017). Crowded Scene Understanding by Deeply Learned Volumetric Slices. IEEE Transactions on Circuits and Systems for Video Technology, 27(3), 613–623.

    Article  Google Scholar 

  3. Yi, S., Li, H.S., Wang, X.G. (2015). Understanding pedestrian behaviors from stationary crowd groups. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (pp. 3488–3496).

  4. Fradi, H., Luvison, B., Pham, Q.C. (2017). Crowd Behavior Analysis Using Local Mid-Level Visual Descriptors. IEEE Transactions on Circuits and Systems for Video Technology, 27(3), 589–602.

    Article  Google Scholar 

  5. Rao, A.S., Gubbi, J., Marusic, S., et al. (2016). Crowd Event Detection on Optical Flow Manifolds. IEEE Transactions on Cybernetics, 46(7), 1524–1537.

    Article  Google Scholar 

  6. Wang, J., & Xu, Z. (2016). Spatio-temporal texture modelling for real-time crowd anomaly detection. Computer Vision and Image Understanding, 144(C), 177–187.

    Article  Google Scholar 

  7. Yu, Y., Shen, W., Huang, H., et al. (2017). Abnormal event detection in crowded scenes using two sparse dictionaries with saliency. Journal of Electronic Imaging, 26(3), 033013.

    Article  Google Scholar 

  8. Benabbas, Y., Ihaddadene, N., Djeraba, C. (2011). Motion pattern extraction and event detection for automatic visual surveillance. EURASIP Journal on Image and Video Processing, 2011, 1–15.

    Article  Google Scholar 

  9. Solmaz, B., Moore, B.E., Shah, M. (2012). Identify behaviours in crowd scenes using stability analysis for dynamical systems. IEEE Transaction on Pattern Analysis and Machine Intelligence, 34(10), 2064–2070.

    Article  Google Scholar 

  10. Zhou, B.L., Tang, X.O., Wang, X.G. (2015). Learning collective crowd behaviors with dynamic pedestrian-agents. International Journal of Computer Vision, 111(1), 50–68.

    Article  Google Scholar 

  11. Han, T.T., Yao, H.G., Sun, X.S., et al. (2016). Unsupervised discovery of crowd activities by saliency-based clustering. Neurocomputing, 171, 347–361.

    Article  Google Scholar 

  12. Li, T., Chang, H., Wang, M., et al. (2014). Crowded scene analysis: a survey. IEEE Transactions on Circuits and Systems for Video Technology, 25(3), 367–386.

    Article  Google Scholar 

  13. Ali, S., & Shah, M. (2007). A lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. (pp. 1-6).

  14. Mehran, R., Moore, B.E., Shah, M. (2010). A streakline representation of flow in crowded scenes. In Proceedings of European Conference on Computer Vision (pp. 439–452).

    Chapter  Google Scholar 

  15. Wu, S., & San, W.H. (2012). Crowd motion partitioning in a scattered motion field. IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics, 42(5), 1443–1454.

    Article  Google Scholar 

  16. Song, L., Jiang, F., Shi, Z., Katsaggelos, A.K. (2011). Understanding dynamic scenes by hierarchical motion pattern mining. In Proceedings of IEEE International Conference Multimedia and Expo (pp. 1–6).

  17. Zhou, B.L., Wang, X.G., Tang, X.O. (2011). Random field topic model for semantic region analysis in crowded scenes from tracklets. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (pp. 3441–3448).

  18. Fu, W., Wang, J., Li, Z., et al. (2012). Learning semantic motion patterns for dynamic scenes by improved sparse topical coding. In Proceedings of IEEE International Conference Multimedia and Expo (pp. 296–301).

  19. Cheriyadat, A.M., & Radke, R.J. (2008). Detecting dominant motions in dense crowds. IEEE Journal of Selected Topics in Signal Processing, 2(4), 568–581.

    Article  Google Scholar 

  20. Jodoin, P.M., Benezeth, Y., Wang, Y. (2013). Meta-tracking for video scene understanding. In Proceedings of IEEE International Conference on Advanced Video and Signal Based Surveillance (pp. 1–6).

  21. Zhou, B.L., Zhang, H., Wang, X.G. (2014). Measuring crowd collectiveness. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(8), 1586–1599.

    Article  Google Scholar 

  22. Zhao, X., & Medioni, G. (2011). Robust unsupervised motion pattern inference from video and applications. In Proceedings of IEEE International Conference on Computer Vision (pp. 715–722).

  23. Gnana, P., & Babu, R. (2014). Crowd flow segmentation based on motion vectors in H.264 compressed domain. In Proceedings of IEEE International Conference on Electronics, Computing and Communication Technologies (pp. 1–5).

  24. Zhou, B.L., Tang, X.o., Wang, X.G. (2012). Coherent filtering: detecting coherent motions from crowd clutters. In Proceedings of European Conference on Computer Vision (pp. 857–871).

    Chapter  Google Scholar 

  25. Zhu, F., Wang, X.G., Yu, N.H. (2014). Crowd tracking with dynamic evolution of group structures. In Proceedings of European Conference on Computer Vision (pp. 139–154).

    Google Scholar 

  26. Wang, X.G. (2014). Profiling stationary crowd groups. In Proceedings of IEEE International Conference on Multimedia and Expo (pp. 1–6).

  27. Shandilya, S.G., & Timme, M. (2011). Inferring network topology from complex dynamics. New Journal of Physics, 13(1), 1–12.

    Article  Google Scholar 

  28. Jiang, J., Wu, X.H., He, X.H., et al. (2015). Measuring crowd collectiveness via compressive sensing. IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, 98(11), 2263–2266.

    Article  Google Scholar 

  29. Shao, J., Loy, C.C., Wang, X.G. (2014). Scene-independent group profiling in crowd. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (pp. 2227–2234).

  30. Lin, W.Y., Mi, Y., Wang, W.Y., et al. (2016). A Diffusion and Clustering-based Approach for Finding Coherent Motions and Understanding Crowd Scenes. IEEE Transactions on Image Processing, 25(4), 1674–1687.

    Article  MathSciNet  Google Scholar 

  31. Baker, S., & Matthews, I. (2004). Lucas-Kanade 20 years on: a unifying framework. International Journal of Computer Vision, 56(3), 221–255.

    Article  Google Scholar 

  32. Ozturk, O., Yamasaki, T., Aizawa, K. (2010). Detecting dominant motion flows in unstructured/structured crowd scenes. In Proceedings of International Conference on Pattern Recognition (pp. 3533–3536).

  33. Shao, J., Dong, N., Zhao, Q. (2015). An adaptive clustering approach for group detection in the crowd. In Proceedings of IEEE International Conference on Systems, Signals and Image Processing (pp. 77–80).

  34. Lim, M.K., Kok, V.J., Loy, C.C., Chan, C.S. (2014). Crowd saliency detection via global similarity structure. In Proceedings of International Conference on Pattern Recognition (pp. 3957–3962).

  35. Huang, J.L., & Zhu, Q.S. (2014). A clustering algorithm based on natural nearest neighbor. Journal of Computational Information Systems, 10(13), 1–8.

    Google Scholar 

  36. Zou, X.L., Zhu, Q.S., Yang, R.L. (2011). Natural nearest neighbor for isomap algorithm without free-parameter. Advanced Materials Research, 219-220, 994–998.

    Article  Google Scholar 

  37. Zhang, S., Mouhoub, M., Sadaoui, S. (2014). 3N-Q: natural nearest neighbor with quality. Computer and Information Science, 7(1), 94–102.

    Article  Google Scholar 

  38. Strehl, A., & Ghosh, J. (2003). Cluster ensembles: a knowledge reuse framework for combining multiple partitions. The Journal of Machine Learning Research, 3, 583–617.

    MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work is funded by National Natural Science Foundation of China(NO.61701029).

Author information

Authors and Affiliations

  1. School of Information and Electronics, Beijing Institute of Technology, 5 South Zhongguancun Street, Haidian District, Beijing, 100081, China

    Zheyi Fan, Jiao Jiang, Shuqin Weng, Zhonghang He & Zhiwen Liu

Authors
  1. Zheyi Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiao Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shuqin Weng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhonghang He
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhiwen Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zheyi Fan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, Z., Jiang, J., Weng, S. et al. Adaptive Crowd Segmentation Based on Coherent Motion Detection. J Sign Process Syst 90, 1651–1666 (2018). https://doi.org/10.1007/s11265-017-1309-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-017-1309-8

Keywords

Search

Navigation