Skip to main content
SpringerLink
Log in

A parallel computing framework for real-time moving object detection on high resolution videos

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Graphic Processing Units (GPUs) are becoming very important in the present day. Their high computational capabilities with high speed and accuracy are making them a very strong force in communication engineering. In recent times, their need has increased tremendously due to the increasing range of applications. Video surveillance is an important field where very heavy computations are needed to be done on videos to perfectly detect the motion of an object in suspicious situations. The various analyses on video can be used to extract information and process data to generate actionable intelligent conclusions. However, CPUs fail to deliver real time results when it comes to high-resolution videos from a large number of cameras simultaneously. Thankfully, there is a lot of graphic hardware available nowadays, which comprises powerful hardware processors often intended to process data in parallel and so greatly accelerates the processes being done on them. An accelerated algorithm is required for processing petabytes of data from security cameras and video surveillance satellites and that in real time. In this paper, we propose a method of using GPUs in detecting the motion of an object at different junctions in video surveillance. The results show a great gain in performance when the proposed method runs on GPUs and CPUs in terms of speed as well as accuracy. The new parallel processing approaches are developed on each phase of the algorithm to enhance the efficiency of the system. Proposed algorithm achieved an average speed up of 50.094x for lower resolution video frames (320 × 240,720 × 480,1024 × 768) and 38.012x for higher resolution video frames (1360 × 768,1920 × 1080) on GPU, which is superior to CPU processing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  • Allusse, Y., Horain, P., Agarwal, A., & Saipriyadarshan, C. (2008). GpuCV: A GPU-accelerated framework for image processing and computer vision. In Proceedings of advances in visual computing (pp. 430–439). Berlin Heidelberg.

  • Amin, J., Mirzaei, G., Majid, M. W., Ross, J., Jamali, M. M., et al. (2013). A parallel implementation of IR video processing on a GPU. In Proceedings of IEEE 56th international Midwest symposium on circuits and systems (MWSCAS-2013) (pp. 1160–1163).

  • Attard, L., & Farrugia, R. A. (2011). Vision based surveillance system. In Proceedings of IEEE EUROCON-international conference on computer as a tool (EUROCON 2011) (pp. 1–4).

  • Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Media, Inc.

    Google Scholar 

  • Buch, N., Velastin, S. A., & Orwell, J. (2011). A review of computer vision techniques for the analysis of urban traffic. IEEE Transactions on Intelligent Transportation Systems, 12(3), 920–939.

    Article  Google Scholar 

  • Chen, S.-C., Shyu, M.-L., Zhang, C., & Strickrott, J. (2002). A multimedia data mining framework: Mining information from traffic video sequences. Journal of Intelligent Information Systems, 19(1), 61–77.

    Article  Google Scholar 

  • Chen, Y., Wang, J., Zhu, B., Tang, M., & Hanqing, L. (2017). Pixelwise deep sequence learning for moving object detection. IEEE Transactions on Circuits and Systems for Video Technology, 29(9), 2567–2579.

    Article  Google Scholar 

  • Cheng, F. C., & Ruan, S. J. (2012). Accurate motion detection using a self-adaptive background matching framework. IEEE Transactions on Intelligent Transportation Systems, 13(2), 671–679.

    Article  Google Scholar 

  • Chong, Y., Chen, W., Li, Z., Lam, W. H. K., et al. (2013). Integrated real-time vision-based preceding vehicle detection in urban roads. Neurocomputing, 116, 144–149.

    Article  Google Scholar 

  • Domanski, L., Vallotton, P., & Wang, D. (2009). Parallel van Herk/Gil-Werman image morphology on GPUs using CUDA. In Proceedings of conference posters GTC.

  • Eklund, A., Dufort, P., Forsberg, D., & LaConte, S. M. (2013). Medical image processing on the GPU–past, present and future. Medical Image Analysis, 17(8), 1073–1094.

    Article  Google Scholar 

  • Fradi, H., & Dugelay, J. (2012). Robust foreground segmentation using improved Gaussian mixture model and optical flow. In Proceedings of IEEE international conference on informatics, Electronics & Vision (ICIEV-2012) (pp. 248–253).

  • Fukui, S., Iwahori, Y., & Woodham, R. J. (2008). GPU based extraction of moving objects without shadows under intensity changes. In Proceedings of the IEEE congress on evolutionary computation, (CEC-2008), (IEEE world congress on computational intelligence) (pp. 4165–4172).

  • Hashmi, M. F., & Keskar, A. G. (2012). Analysis and monitoring of a high-density traffic flow at T-intersection using statistical computer vision based approach. In Proceedings of 12th IEEE international conference on intelligent systems design and applications (ISDA-2012), Kochi India, 27–29 November (pp. 52–57).

  • Hashmi, M. F., & Keskar, A. G. (2013). Video surveillance for disorganized traffic flow at T –intersections. In Proceedings of Elsevier, Seventh International Conference on Image and Signal Processing (ICISP-2013) (Vol. 4, pp. 51–61). Bangalore India, Book Series Elsevier Science and Technology, Elsevier India.

  • Hashmi, M. F., Pal, R., Saxena, R., & Keskar, A. G. (2016). A new approach for real time object detection and tracking on high resolution and multi-camera surveillance videos using GPU. Journal of Central South University, 23(1), 130–144.

    Article  Google Scholar 

  • Honda, R., Wang, S., Kikuchi, T., & Konishi, O. (2002). Mining of moving objects from time-series images and its application to satellite weather imagery. Journal of Intelligent Information Systems, 19(1), 79–93.

    Article  Google Scholar 

  • Huang, J., Ponce, S. P., Park, S. I., Cao, Y., et al. (2008). GPU-accelerated computation for robust motion tracking using the CUDA framework. In Proceedings of 5th international conference on visual information engineering (VIE 2008) (pp. 437–442).

  • Kumar, P., Singhal, A., Mehta, S., & Mittal, A. (2016). Real-time moving object detection algorithm on high-resolution videos using GPUs. Journal of Real-Time Image Processing, 11(1), 93–109.

    Article  Google Scholar 

  • Li, L., Huang, W., Gu, I. Y. H., & Tian, Q. (2004). Statistical modeling of complex backgrounds for foreground object detection. IEEE Transactions on Image Processing, 13(11), 1459–1472.

    Article  Google Scholar 

  • Mane, S., & Mangale, S. (2018). Moving object detection and tracking using convolutional neural networks. In 2018 second international conference on intelligent computing and control systems (ICICCS) (pp. 1809–1813). IEEE.

  • Payne, B. R., Belkasim, S. O., Owen, G. S., Weeks, M. C., et al. (2005). Accelerated 2D image processing on GPUs. In Proceedings of computational science (ICCS 2005) (Vol. 3515, pp. 256–264). Springer Berlin Heidelberg.

  • Plotnikov, V. A., Akhtyamov, T. R., Kopanev, P. D., & Serebrenny, V. V. (2022). Classical and neural network approaches to object detection in underwater robotics competitions. In AIP conference proceedings (vol. 2383, no. 1, p. 020021). AIP Publishing LLC.

  • Qian, H., Wu, X., & Xu, Y. (2011). Background/foreground detection. In Intelligent Surveillance Systems (pp. 7–21). Springer.

  • Rane, M. A. (2013). Fast morphological image processing on GPU using CUDA. M.Tech Thesis, Department of Computer Engineering and Information Technology, College of Engineering Pune.

  • Roodt, Y., Visser, W., & Clarke, W. (2007). Image processing on the GPU: Implementing the canny edge detection algorithm. In Proceedings of international symposium of the pattern recognition Association of South Africa.

  • Salvo, R. D., & Pino, C. (2013). Image and video processing on GPU: Implementation scheme, applications and future directions. In Proceedings of advances in mechanical and electronic engineering (Vol. 178, pp. 375–382). Springer.

  • Singhal, N., Park, I. K., & Cho, S. (2010). Implementation and optimization of image processing algorithms on handheld GPU. In Proceedings of 17th IEEE international conference on image processing (ICIP-2010) (pp. 4481–4484).

  • Sinha, S. N., Frahm, J. M., Pollefeys, M., & Genc, Y. (2006). GPU-based video feature tracking and matching. In Proceedings of EDGE, workshop on edge computing using new commodity architectures (Vol. 278, p. 4321).

  • Soh, Y., Ashraf, H., Hae, Y., & Kim, I. (2014). Fast parallel connected component labeling algorithms using CUDA based on 8-directional label selection. International Journal of Latest Research in Science and Technology, 3(2), 187–190.

    Google Scholar 

  • Sowa, P., & Izydorczyk, J. (2022). Darknet on OpenCL: A multiplatform tool for object detection and classification. Concurrency and Computation: Practice and Experience, 34(15), e6936.

    Article  Google Scholar 

  • Thurley, M. J., & Danell, V. (2012). Fast morphological image processing open-source extensions for GPU processing with CUDA. IEEE Journal of Selected Topics in Signal Processing, 6(7), 849–855.

    Article  Google Scholar 

  • Wu, K., Otoo, E., & Suzuki, K. (2009). Optimizing two-pass connected component labeling algorithms. Pattern Analysis & Applications, 12(2), 117–135.

    Article  MathSciNet  Google Scholar 

  • Yang, Z., Zhu, Y., & Pu, Y. (2008). Parallel image processing based on CUDA. In Proceedings of IEEE international conference on computer science and software engineering (Vol. 3, pp. 198–201).

  • Yu, Y., Kurnianggoro, L., & Jo, K.-H. (2019). Moving object detection for a moving camera based on global motion compensation and adaptive background model. International Journal of Control, Automation and Systems, 17(7), 1866–1874.

    Article  Google Scholar 

  • Zhang, Y., Wang, S., & Ding, X. (2008). Traffic flow surveillance system for urban intersections. In Proceedings of IEEE international conference on multimedia and information technology (MMIT'08) (pp. 405–408).

Download references

Acknowledgements

We would like to express our deep and sincere gratitude to those who contributed to write this article and give some valuable comments.

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, National Institute of Technology, Warangal, India

    Mohammad Farukh Hashmi & Banoth Thulasya Naik

  2. Department of Electronics Engineering, Defence University College of Engineering, 1041, Bishoftu, Ethiopia

    Eskinder Ayele

  3. Department of Electronics and Communication Engineering, Visvesvaraya National Institute of Technology, Nagpur, India

    Avinash G. Keskar

Authors
  1. Mohammad Farukh Hashmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eskinder Ayele
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Banoth Thulasya Naik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Avinash G. Keskar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad Farukh Hashmi.

Ethics declarations

Conflict of interest

We declare that we have no conflicts of interest to report regarding the present study.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hashmi, M.F., Ayele, E., Naik, B.T. et al. A parallel computing framework for real-time moving object detection on high resolution videos. J Intell Inf Syst (2022). https://doi.org/10.1007/s10844-022-00737-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10844-022-00737-1

Keywords

Search

Navigation