Abstract
In this paper, we propose a method to detect abnormal events from videos based on the integral image under Bayesian framework. In our implementation, we consider a regular cube in the videos as one event. Each event is represented as a motion histogram which can be calculated fast from our proposed 3D integral images. Furthermore, we estimate the anomaly probability under the Bayesian framework, where we estimate the prior knowledge from the motion magnitudes and calculate the likelihood based on our maximum histogram templates. Experiments on the public datasets show that our method can effectively and efficiently detect abnormal events in complex scenes.
Similar content being viewed by others
Notes
We keep two significant digits because that the compared methods from different references also have the same significant digits.
References
Abati D, Porrello A, Calderara S, Cucchiara R (2019) Latent space autoregression for novelty detection. In: IEEE conference on computer vision and pattern recognition, CVPR 2019, Long Beach, CA, USA, June 16–20, 2019, Computer Vision Foundation/IEEE, pp 481–490
Antic B, Ommer B (2011) Video parsing for abnormality detection. In: IEEE international conference on computer vision, ICCV 2011, Barcelona, Spain, November 6–13, 2011, pp 2415–2422
Basharat A, Gritai A, Shah M (2008) Learning object motion patterns for anomaly detection and improved object detection. In: 2008 IEEE computer society conference on computer vision and pattern recognition (CVPR 2008), 24–26 June 2008, Anchorage, Alaska, USA
Chatfield K, Simonyan K, Vedaldi A, Zisserman A (2014) Return of the devil in the details: Delving deep into convolutional nets. In: Valstar MF, French AP, Pridmore TP (eds.), British machine vision conference, BMVC 2014, Nottingham, UK, September 1–5, 2014. BMVA Press
Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder. In: Cong F, Leung AC, Wei Q (eds.), Advances in neural networks - ISNN 2017 - 14th international symposium, ISNN 2017, Sapporo, Hakodate, and Muroran, Hokkaido, Japan, June 21–26, 2017, Proceedings, Part II, Lecture Notes in Computer Science, vol 10262, pp 189–196. Springer
Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 3449–3456
Cong Y, Yuan J, Tang Y (2013) Video anomaly search in crowded scenes via spatio-temporal motion context. IEEE Trans Inf Forensics Secur 8(10):1590–1599
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR 2005), 20–26 June 2005, San Diego, CA, USA, pp 886–893. IEEE Computer Society
Dutta JK, Banerjee B (2015) Online detection of abnormal events using incremental coding length. In: Bonet B, Koenig S (eds.), Proceedings of the twenty-ninth AAAI conference on artificial intelligence, January 25–30, 2015, Austin, Texas, USA, pp 3755–3761. AAAI Press
Farnebäck G (2003) Two-frame motion estimation based on polynomial expansion. In: Bigün J, Gustavsson T (eds.), Image Analysis, 13th Scandinavian conference, SCIA 2003, Halmstad, Sweden, June 29–July 2, 2003, Proceedings, Lecture Notes in Computer Science, vol 2749, pp 363–370. Springer
Giorno AD, Bagnell JA, Hebert M (2016) A discriminative framework for anomaly detection in large videos. In: Leibe B, Matas J, Sebe N, Welling M (eds.), Computer vision—ECCV 2016—14th European conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part V, Lecture Notes in Computer Science, vol 9909, pp 334–349. Springer
Girshick RB (2015) Fast R-CNN. In: 2015 IEEE international conference on computer vision, ICCV 2015, Santiago, Chile, December 7–13, 2015, pp 1440–1448. IEEE Computer Society
Gong D, Liu L, Le V, Saha B, Mansour MR, Venkatesh S, van den Hengel A (2019) Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: 2019 IEEE/CVF international conference on computer vision, ICCV 2019, Seoul, Korea (South), October 27–November 2, 2019, pp 1705–1714. IEEE
Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis LS (2016) Learning temporal regularity in video sequences. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, NV, USA, June 27–30, 2016, pp 733–742. IEEE Computer Society
He C, Shao J, Sun J (2018) An anomaly-introduced learning method for abnormal event detection. Multimed. Tools Appl. 77(22):29573–29588
Hinami R, Mei T, Satoh S (2017) Joint detection and recounting of abnormal events by learning deep generic knowledge. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 3639–3647. IEEE Computer Society
Hu Y, Zhang Y, Davis LS (2013) Unsupervised abnormal crowd activity detection using semiparametric scan statistic. In: IEEE conference on computer vision and pattern recognition, CVPR Workshops 2013, Portland, OR, USA, June 23–28, 2013, pp 767–774
Ionescu RT, Khan FS, Georgescu M, Shao L (2019) Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. In: IEEE conference on computer vision and pattern recognition, CVPR 2019, Long Beach, CA, USA, June 16–20, 2019, pp 7842–7851. Computer Vision Foundation/IEEE
Ionescu RT, Smeureanu S, Alexe B, Popescu M (2017) Unmasking the abnormal events in video. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2914–2922. IEEE Computer Society
Kamoona AM, Gostar AK, Bab-Hadiashar A, Hoseinnezhad R (2020) Multiple instance-based video anomaly detection using deep temporal encoding-decoding. CoRR abs/2007.01548
Kratz L, Nishino K (2009) Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: 2009 IEEE computer society conference on computer vision and pattern recognition (CVPR 2009), 20–25 June 2009, Miami, Florida, USA, pp 1446–1453
Li A, Miao Z, Cen Y, Zhang X, Zhang L, Chen S (2020) Abnormal event detection in surveillance videos based on low-rank and compact coefficient dictionary learning. Pattern Recognit. 108:107355
Li S, Liu C, Yang Y (2018) Anomaly detection based on maximum a posteriori. Pattern Recognit. Lett. 107:91–97
Lin T, Dollár P, Girshick RB, He K, Hariharan B, Belongie SJ (2017) Feature pyramid networks for object detection. In: 2017 IEEE conference on computer vision and pattern recognition, CVPR 2017, Honolulu, HI, USA, July 21–26, 2017, pp 936–944. IEEE Computer Society
Liu W, Luo W, Li Z, Zhao P, Gao S (2019) Margin learning embedded prediction for video anomaly detection with A few anomalies. In: Kraus S (ed.), Proceedings of the twenty-eighth international joint conference on artificial intelligence, IJCAI 2019, Macao, China, August 10–16, 2019, pp 3023–3030. ijcai.org
Liu W, Luo W, Lian D, Gao S (2018) Future frame prediction for anomaly detection—a new baseline. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, 2018, IEEE Computer Society, pp 6536–6545
Lu C, Shi J, Jia J (2013) Abnormal event detection at 150 FPS in MATLAB. In: IEEE international conference on computer vision, ICCV 2013, Sydney, Australia, December 1–8, 2013, pp 2720–2727
Luo W, Liu W, Gao S (2017) Remembering history with convolutional LSTM for anomaly detection. In: 2017 IEEE international conference on multimedia and expo, ICME 2017, Hong Kong, China, July 10–14, 2017, IEEE Computer Society, pp 439–444
Luo W, Liu W, Gao S (2017) A revisit of sparse coding based anomaly detection in stacked RNN framework. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, IEEE Computer Society, pp 341–349
Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: The twenty-third IEEE conference on computer vision and pattern recognition, CVPR 2010, San Francisco, CA, USA, 13–18 June 2010, pp 1975–1981
Nguyen T, Meunier J (2019) Anomaly detection in video sequence with appearance-motion correspondence. In: 2019 IEEE/CVF international conference on computer vision, ICCV 2019, Seoul, Korea (South), October 27–November 2, 2019, IEEE, pp 1273–1283
Pang G, Shen C, van den Hengel A (2019) Deep anomaly detection with deviation networks. In: Teredesai A, Kumar V, Li Y, Rosales R, Terzi E, Karypis G (eds.), Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, KDD 2019, Anchorage, AK, USA, August 4–8, 2019, ACM, pp 353–362
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, W.M.W. III, Frangi AF (eds.), Medical image computing and computer-assisted intervention—MICCAI 2015—18th international conference Munich, Germany, October 5–9, 2015, Proceedings, Part III, Lecture Notes in Computer Science. Springer, vol 9351, pp 234–241
Shi X, Chen Z, Wang H, Yeung D, Wong W, Woo W (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds.), Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, December 7–12, 2015, Montreal, Quebec, Canada, pp 802–810
Sultani W, Chen C, Shah M (2018) Real-world anomaly detection in surveillance videos. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, 2018, IEEE Computer Society, pp 6479–6488
Tran, D, Bourdev LD, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: 2015 IEEE international conference on computer vision, ICCV 2015, Santiago, Chile, December 7–13, 2015, IEEE Computer Society, pp 4489–4497
Tran H, Hogg DC (2017) Anomaly detection using a convolutional winner-take-all autoencoder. In: British machine vision conference 2017, BMVC 2017, London, UK, September 4–7, 2017. BMVA Press
Viola PA, Jones MJ (2001) Rapid object detection using a boosted cascade of simple features. In: 2001 IEEE computer society conference on computer vision and pattern recognition (CVPR 2001), with CD-ROM, 8–14 December 2001, Kauai, HI, USA, IEEE Computer Society, pp 511–518
Viola PA, Jones MJ (2004) Robust real-time face detection. Int. J. Comput. Vis. 57(2):137–154
Vu H, Nguyen TD, Le T, Luo W, Phung DQ (2019) Robust anomaly detection in videos using multilevel representations. In: The thirty-third AAAI conference on artificial intelligence, AAAI 2019
Wei J, Zhao J, Zhao Y, Zhao Z (2018) Unsupervised anomaly detection for traffic surveillance based on background modeling. In: 2018 IEEE conference on computer vision and pattern recognition workshops, CVPR workshops 2018, Salt Lake City, UT, USA, June 18–22, 2018, IEEE Computer Society, pp 129–136
Xu J, Denman S, Sridharan S, Fookes C, Rana R (2011) Dynamic texture reconstruction from sparse codes for unusual event detection in crowded scenes. In: Proceedings of the 2011 joint ACM workshop on modeling and representing events, J-MRE’11, pp 25–30
Zhang Y, Lu H, Zhang L, Ruan X (2016) Combining motion and appearance cues for anomaly detection. Pattern Recognit. 51:443–452
Zhao B, Li F, Xing EP (2011) Online detection of unusual events in videos via dynamic sparse coding. In: The 24th IEEE conference on computer vision and pattern recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp 3313–3320
Zhong J, Li N, Kong W, Liu S, Li TH, Li G (2019) Graph convolutional label noise cleaner: train a plug-and-play action classifier for anomaly detection. In: IEEE conference on computer vision and pattern recognition, CVPR 2019, Long Beach, CA, USA, June 16–20, 2019, Computer Vision Foundation/IEEE, pp 1237–1246
Zhou JT, Du J, Zhu H, Peng X, Liu Y, Goh RSM (2019) Anomalynet: an anomaly detection network for video surveillance. IEEE Trans. Inf. Forensics Secur. 14(10):2537–2550
Acknowledgements
This work was jointly supported by the National Natural Science Foundation of China (61402049) and Science and Technology Research Project of the Department of Education of Liaoning Province (LJKZ1019).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, S., Cheng, Y., Liu, Y. et al. Fast Anomaly Detection Based on 3D Integral Images. Neural Process Lett 54, 1465–1479 (2022). https://doi.org/10.1007/s11063-021-10691-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-021-10691-8