Advertisement

Abnormal Event Detection by Learning Spatiotemporal Features in Videos

  • Xiaofeng Zhang
  • Rong Wang
  • Jianwei Ding
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 875)

Abstract

Abnormal event detection from video surveillance is a key issue for social security. At present, the challenge lies in the effective feature extraction of video data. In order to solve the problem, a deep learning method based on convolutional autoencoder was proposed in this paper. Firstly, video data are preprocessed to obtain video volumes for subsequent training. Secondly, the video volumes are put into the convolutional autoencoder to learn the spatiotemporal features. Specifically, the model can capture spatial features by performing convolution and learn temporal features by Long Short-Term Memory (LSTM). Finally, abnormal event detection is carried out according to the normalized reconstruction error, which is adopted as the index of anomaly degree. Experimental results show that the proposed method had higher accuracy and generalization ability on the challenging Avenue and UCSD datasets.

Keywords

Abnormal event detection Video surveillance Convolutional autoencoder Long Short-Term Memory 

Notes

Acknowledgments

This work is supported by National Key Research and Development Plan under Grant No. 2016YFC0801005. This work is supported by the National Natural Science Foundation of China under Grant No. 61503388.

References

  1. 1.
    Yogameena, B., Nagananthini, C.: Computer vision based crowd disaster avoidance system: a survey. Int. J. Disaster Risk Reduct. 22, 95–129 (2017)CrossRefGoogle Scholar
  2. 2.
    Luo, W., Liu, W., Gao, S.: A revisit of sparse coding based anomaly detection in stacked RNN framework. In: IEEE International Conference on Computer Vision (ICCV), pp. 341–349. IEEE Computer Society (2017)Google Scholar
  3. 3.
    Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. 32(14), 3449–3456 (2011)Google Scholar
  4. 4.
    Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 FPS in MATLAB. In: IEEE International Conference on Computer Vision (ICCV), pp. 2720–2727. IEEE (2013)Google Scholar
  5. 5.
    Hasan, M., Choi, J., Neumann, J., et al.: Learning temporal regularity in video sequences. In: Computer Vision and Pattern Recognition (CVPR), pp. 733–742. IEEE (2016)Google Scholar
  6. 6.
    Xu, D., Yan, Y., Ricci, E., Sebe, N.: Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput. Vis. Image Underst. 156, 117–127 (2016)CrossRefGoogle Scholar
  7. 7.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back–propagating errors. Nature 323, 533–536 (1986)CrossRefGoogle Scholar
  8. 8.
    Masci, J., Meier, U., Cireşan, D., Schmidhuber, J.: Stacked convolutional auto-encoders for hierarchical feature extraction. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds.) ICANN 2011. LNCS, vol. 6791, pp. 52–59. Springer, Heidelberg (2011).  https://doi.org/10.1007/978-3-642-21735-7_7CrossRefGoogle Scholar
  9. 9.
    Shi, X., Chen, Z., Wang, H., et al.: Convolutional LSTM network. Mach. Learn. Approach Precip. Nowcasting 9199, 802–810 (2015)Google Scholar
  10. 10.
    Ribeiro, M., Lazzaretti, A.E., Lopes, H.S.: A study of deep convolutional auto-encoders for anomaly detection in videos. Pattern Recogn. Lett. 105, 13–22 (2017)CrossRefGoogle Scholar
  11. 11.
    Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 FPS in MATLAB. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 2720–2727 (2013)Google Scholar
  12. 12.
    Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: Computer Vision and Pattern Recognition (CVPR) (2009)Google Scholar
  13. 13.
    Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2921–2928 (2009)Google Scholar
  14. 14.
    Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 935–942 (2009)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.People’s Public Security University of ChinaBeijingChina

Personalised recommendations