Abstract
Accurate and efficient foreground detection is an important task in video surveillance system. The task becomes more critical when the background scene shows more variations, such as water surface, waving trees, varying illumination conditions, etc. Recently, Robust Principal Components Analysis (RPCA) shows a very nice framework for moving object detection. The background sequence is modeled by a low-dimensional subspace called low-rank matrix and sparse error constitutes the foreground objects. But RPCA presents the limitations of computational complexity and memory storage due to batch optimization methods, as a result it is difficult to apply for real-time system. To handle these challenges, this paper presents a robust foreground detection algorithm via Online Robust PCA (OR-PCA) using image decomposition along with continuous constraint such as Markov Random Field (MRF). OR-PCA with good initialization scheme using image decomposition approach improves the accuracy of foreground detection and the computation time as well. Moreover, solving MRF with graph-cuts exploits structural information using spatial neighborhood system and similarities to further improve the foreground segmentation in highly dynamic backgrounds. Experimental results on challenging datasets such as Wallflower, I2R, BMC 2012 and Change Detection 2014 dataset demonstrate that our proposed scheme significantly outperforms the state of the art approaches and works effectively on a wide range of complex background scenes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bouwmans, T., El Baf, F., Vachon, B., et al.: Statistical background modeling for foreground detection: a survey. In: Handbook of Pattern Recognition and Computer Vision, pp. 181–199 (2010)
Bouwmans, T.: Traditional and recent approaches in background modeling for foreground detection: an overview. Comput. Sci. Rev. 11, 31–66 (2014)
Oh, S.H., Javed, S., Jung, S.K.: Foreground object detection and tracking for visual surveillance system: a hybrid approach. In: 2013 11th International Conference on Frontiers of Information Technology (FIT), pp. 13–18 (2013)
Bouwmans, T., Zahzah, E.H.: Robust PCA via principal component pursuit: a review for a comparative evaluation in video surveillance. Comput. Vis. Image Underst. 122, 22–34 (2014)
Home Office Scientific Development Branch: Imagery library for intelligent detection systems I-LIDS. In: The Institution of Engineering and Technology Conference on Crime and Security, pp. 445–448 (2006)
Candès, E.J., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM (JACM) 58, 11–37 (2011)
Guyon, C., Bouwmans, T., Zahzah, E.H.: Robust principal component analysis for background subtraction: systematic evaluation and comparative analysis, pp. 223–228 (2012)
Javed, S., Oh, S.H., Heo, J., Jung, S.K.: Robust background subtraction via online robust PCA using image decomposition. In: Proceedings of the 2014 Research in Adaptive and Convergent Systems, pp. 90–96 (2014)
Zhou, T., Tao, D.: Godec: randomized low-rank & sparse matrix decomposition in noisy case. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 33–40 (2011)
Zhou, X., Yang, C., Yu, W.: Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35, 597–610 (2013)
Rodriguez, P., Wohlberg, B.: Fast principal component pursuit via alternating minimization. In: 20th IEEE International Conference on Image Processing (ICIP), pp. 69–73 (2013)
He, J., Balzano, L., Lui, J.: Online robust subspace tracking from partial information. http://arxiv.org/abs/1109.3827 (2011)
Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online learning for matrix factorization and sparse coding. J. Mach. Learn. Res. 11, 19–60 (2010)
Guan, N., Tao, D., Luo, Z., Yuan, B.: Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans. Neural Netw. Learn. Syst. 23, 1087–1099 (2012)
Feng, J., Xu, H., Yan, S.: Online robust PCA via stochastic optimization. In: Advances in Neural Information Processing Systems, pp. 404–412 (2013)
Kolmogorov, V., Zabin, R.: What energy functions can be minimized via graph cuts? IEEE Trans. Pattern Anal. Mach. Intell. 26, 147–159 (2004)
Goyette, N., Jodoin, P., Porikli, F., Konrad, J., Ishwar, P.: Changedetection.net: a new change detection benchmark dataset. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1–8 (2012)
Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: principles and practice of background maintenance. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, pp. 255–261 (1999)
Li, L., Huang, W., Gu, I.H., Tian, Q.: Statistical modeling of complex backgrounds for foreground object detection. IEEE Trans. Image Process. 13, 1459–1472 (2004)
Vacavant, A., Chateau, T., Wilhelm, A., Lequièvre, L.: A benchmark dataset for outdoor foreground/background extraction. In: Park, J.-I., Kim, J. (eds.) ACCV Workshops 2012, Part I. LNCS, vol. 7728, pp. 291–300. Springer, Heidelberg (2013)
Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE (1999)
Acknowledgments
This work is supported by the World Class 300 project, Development of HD video/network-based video surveillance system(10040370), funded by the Ministry of Trade, Industry, and Energy (MOTIE), Korea.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Javed, S., Oh, S.H., Sobral, A., Bouwmans, T., Jung, S.K. (2015). OR-PCA with MRF for Robust Foreground Detection in Highly Dynamic Backgrounds. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9005. Springer, Cham. https://doi.org/10.1007/978-3-319-16811-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-16811-1_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16810-4
Online ISBN: 978-3-319-16811-1
eBook Packages: Computer ScienceComputer Science (R0)