Skip to main content
Log in

Hybrid tracking model and GSLM based neural network for crowd behavior recognition

  • Published:
Journal of Central South University Aims and scope Submit manuscript

Abstract

Crowd behaviors analysis is the ‘state of art’ research topic in the field of computer vision which provides applications in video surveillance to crowd safety, event detection, security, etc. Literature presents some of the works related to crowd behavior detection and analysis. In crowd behavior detection, varying density of crowds and motion patterns appears to be complex occlusions for the researchers. This work presents a novel crowd behavior detection system to improve these restrictions. The proposed crowd behavior detection system is developed using hybrid tracking model and integrated features enabled neural network. The object movement and activity in the proposed crowded behavior detection system is assessed using proposed GSLM-based neural network. GSLM based neural network is developed by integrating the gravitational search algorithm with LM algorithm of the neural network to increase the learning process of the network. The performance of the proposed crowd behavior detection system is validated over five different videos and analyzed using accuracy. The experimentation results in the crowd behavior detection with a maximum accuracy of 93% which proves the efficacy of the proposed system in video surveillance with security concerns.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. HOFMANN M, HAAG M, RIGOLL G. Unified hierarchical multi-object tracking using global data association [J]. IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), 2013: 22–28.

    Chapter  Google Scholar 

  2. PÄTZOLD M, SIKORA T. Real-time person counting by propagating networks flows [C]// IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS). Klagenfurt, Austria, 2011: 66–70.

    Google Scholar 

  3. BREITENSTEIN M D, REICHLIN F, LEIBE B, MEIER E K, GOOL L V. Robust tracking-by-detection using a detector confidence particle filter [C]// IEEE International Conference on Computer Vision. Kyoto, Japan, 2009: 1515–1522.

    Google Scholar 

  4. EISELEIN V, ARP D, PÄTZOLD M, SIKORA T. Real-time multi-human tracking using a probability hypothesis density filter and multiple detectors [C]// IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance (AVSS). Beijing, China, 2012: 325–330.

    Google Scholar 

  5. WU Z, HRISTOV N, HEDRICK T, KUNZ T, BETKE M. Tracking a large number of objects from multiple views [C]// IEEE 12th International Conference on Computer Vision. Kyoto, Japan, 2009: 1546–1553.

    Google Scholar 

  6. SONG X, SHAO X, ZHAO H, CUI J, SHIBASAKI R, ZHA H. An online approach: Learning-semantic-scene-by-tracking and trackingby- learning-semantic-scene [C]// IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, CA, USA, 2010: 739–746.

    Google Scholar 

  7. ZHAN B B, MONEKOSSO D N, PAOLO R, SERGIO A V, XU L Q. Crowd analysis: A survey [J]. Machine Vision and Applications, 2008, 19(5): 345–357.

    Article  Google Scholar 

  8. SAXENA S, BREMOND F, THONNAT M, MA R. Crowd behavior recognition for video surveillance [J]. Proceedings of 10th International Conference on Advanced Concepts for Intelligent Vision Systems, 2008, 5259: 970–981.

    Article  Google Scholar 

  9. CHANDOLA V, BANERJEE A, KUMAR V. Anomaly detection: A survey [J]. ACM Computing Surveys, 2009, 41(3): 1–72.

    Article  Google Scholar 

  10. LI Wei-xin, MAHADEVAN V, VASCONCELOS N. Anomaly detection and localization in crowded scenes [J]. IEEE transactions on pattern analysis and machine intelligence, 2014, 36(1): 18–32.

    Article  Google Scholar 

  11. RODRIGUEZ M, SIVIC J, LAPTEV I, AUDIBERT J Y. Data-driven crowd analysis in videos [C]// IEEE International Conference on Computer Vision (ICCV). Barcelona, Spain, 2011: 1235–1242.

    Google Scholar 

  12. FRADI H, EISELEIN V, DUGELAY J L, KELLER I, SIKORA T. Spatio-temporal crowd density model in a human detection and tracking framework [J]. Signal Processing: Image Communication, 2015, 31:100–111.

    Google Scholar 

  13. ALI I, DAILEY M N. Multiple human tracking in high-density crowds [J]. Image and Vision Computing, 2012, 30(12): 966–977.

    Article  Google Scholar 

  14. CAO Li-jun, ZHANG Xu, REN Wei-qiang, HUANG Kai-qi. Large scale crowd analysis based on convolutional neural network [J]. Pattern Recognition, 2015, 48(10): 3016–3024.

    Article  Google Scholar 

  15. LIU Xiao, TAO Da-cheng, SONG Ming-li, ZHANG Lu-ming, BU Jia-jun, CHEN Chun. Learning to track multiple targets [J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 26(5): 1060–1073.

    MathSciNet  Google Scholar 

  16. HU Xing, HU Shi-qiang, ZHANG Xiao-yu, ZHANG Huan-long, LUO Ling-kun. Anomaly detection based on local nearest neighbor distance descriptor in crowded scenes [J]. The Scientific World Journal, 2014, Article ID: 632575.

    Google Scholar 

  17. WU Si, WONG Hau-san, YU Zhi-wen. A bayesian model for crowd escape behavior detection [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(1): 85–98.

    Article  Google Scholar 

  18. CHEN Chun-yu, SHAO Yu, BI Xiao-jun. Detection of anomalous crowd behavior based on the acceleration feature [J]. IEEE Sensors Journal, 2015, 15(12): 7252–7261.

    Article  Google Scholar 

  19. MARTIN T. HAGA N, MOHAMMAD B. MENHA J. Training feedforward networks with the Marquardt algorithm [J]. IEEE Transactions on Neural Networks, 1994, 5(6): 989–993.

    Article  Google Scholar 

  20. KUMAR M, BHATNAGAR C. Zero-stopping constraint-based hybrid tracking model for dynamic and high dense crowd videos [J]. Journal of the Imaging Science, 2017, 65(2): 75–86.

    Article  Google Scholar 

  21. TAHMASEBI P, HEZARKHANI A. A hybrid neural networks-fuzzy logic-genetic algorithm for grade estimation [J]. Computers & Geosciences, 2012, 42: 18–27.

    Article  Google Scholar 

  22. RASHEDI E, NEZAMABADI-POUR H, SARYAZDI S. GSA: A gravitational search algorithm [J]. Information Sciences, 2009, 179(13): 2232–2248.

    Article  MATH  Google Scholar 

  23. CRCV. Tracking in High Density Crowds Data Set [EB/OL]. http://crcv.ucf.edu/data/tracking.php.

  24. UCSD. UCSD Anomaly Detection Dataset [EB/OL]. http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm.

  25. ABERA B, WOLINSKI D, PETTRE J, MANOCHA D. Real-time crowd tracking using parameter optimized mixture of motion models [J]. Computer Vision and Pattern Recognition, Cornell library, 2014.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kumar Manoj.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Manoj, K., Charul, B. Hybrid tracking model and GSLM based neural network for crowd behavior recognition. J. Cent. South Univ. 24, 2071–2081 (2017). https://doi.org/10.1007/s11771-017-3616-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11771-017-3616-4

Key words

Navigation