Skip to main content
Log in

A new approach for real time object detection and tracking on high resolution and multi-camera surveillance videos using GPU

  • Published:
Journal of Central South University Aims and scope Submit manuscript

Abstract

High resolution cameras and multi camera systems are being used in areas of video surveillance like security of public places, traffic monitoring, and military and satellite imaging. This leads to a demand for computational algorithms for real time processing of high resolution videos. Motion detection and background separation play a vital role in capturing the object of interest in surveillance videos, but as we move towards high resolution cameras, the time-complexity of the algorithm increases and thus fails to be a part of real time systems. Parallel architecture provides a surpass platform to work efficiently with complex algorithmic solutions. In this work, a method was proposed for identifying the moving objects perfectly in the videos using adaptive background making, motion detection and object estimation. The pre-processing part includes an adaptive block background making model and a dynamically adaptive thresholding technique to estimate the moving objects. The post processing includes a competent parallel connected component labelling algorithm to estimate perfectly the objects of interest. New parallel processing strategies are developed on each stage of the algorithm to reduce the time-complexity of the system. This algorithm has achieved a average speedup of 12.26 times for lower resolution video frames (320×240, 720×480, 1024×768) and 7.30 times for higher resolution video frames (1360×768, 1920×1080, 2560×1440) on GPU, which is superior to CPU processing. Also, this algorithm was tested by changing the number of threads in a thread block and the minimum execution time has been achieved for 16×16 thread block. And this algorithm was tested on a night sequence where the amount of light in the scene is very less and still the algorithm has given a significant speedup and accuracy in determining the object.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. EKLUND A, DUFORT P, FORSBERG D, LACONTE S M. Medical image processing on the GPU–Past, present and future [J]. Medical Image Analysis, 2013, 17(8): 1073–1094.

    Article  Google Scholar 

  2. BUCH N, VELASTIN S A, ORWELL J. A review of computer vision techniques for the analysis of urban traffic [J]. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(3): 920–939.

    Article  Google Scholar 

  3. ATTARD L, FARRUGIA R A. Vision based surveillance system [C]// Proceedings of IEEE EUROCON-International Conference on Computer as a Tool (EUROCON 2011). 2011: 1–4.

    Chapter  Google Scholar 

  4. MOHAMMAD FARUKH HASHMI, KESKAR A G. Analysis and monitoring of a high density traffic flow at t-intersection using statistical computer vision based approach [C]// Proceedings of 12th IEEE International Conference on Intelligent Systems Design and Applications (ISDA-2012). Kochi India, 2012: 52–57.

    Google Scholar 

  5. MOHAMMAD FARUKH HASHMI, KESKAR A G. Video surveillance for disorganized traffic flow at T–intersections [C]// Proceedings of Elsevier, Seventh International Conference on Image and Signal Processing (ICISP-2013). Bangalore India, Book Series Elsevier Science and Technology, Elsevier India, 2013: 51–61.

    Google Scholar 

  6. HUANG Shih-chia. An advanced motion detection algorithm with video quality analysis for video surveillance systems [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(1): 1–14.

    Article  Google Scholar 

  7. FRADI H, DUGELAY J. Robust foreground segmentation using improved Gaussian mixture model and optical flow [C]// Proceedings of IEEE International Conference on Informatics, Electronics & Vision (ICIEV-2012). Dhaka, Bangladesh, 2012: 248–253.

    Chapter  Google Scholar 

  8. CHENG Fan-Chieh, RUAN Shanq-Jang. Accurate motion detection using a self-adaptive background matching framework [J]. IEEE Transactions on Intelligent Transportation Systems, 2012, 13(2): 671–679.

    Article  Google Scholar 

  9. RIHA L, HODA El-Sayed. Real-time motion object tracking using GPU [C]// Proceedings of IEEE 9th IEEE/ACS International Conference on Computer Systems and Applications (AICCSA-2011). Sharm El-Sheikh, Egypt, 2011: 301–304.

    Chapter  Google Scholar 

  10. RANE M A. Fast morphological image processing on GPU using CUDA [D]. Pune: College of Engineering, 2013.

    Google Scholar 

  11. THURLEY M J, DANELL V. Fast morphological image processing open-source extensions for GPU processing with CUDA [J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(7): 849–855.

    Article  Google Scholar 

  12. DOMANSKI L, VALLOTTON P, WANG Da-dong. Parallel van Herk/Gil-Werman image morphology on GPUs using CUDA [C]// Proceedings of Conference Posters GTC. Santa Clara, CA, USA, 2009.

    Google Scholar 

  13. SOH Youngsung, ASHRAF H, HAE Yongsuk, KIM Intaek. Fast parallel connected component labeling algorithms using CUDA based on 8-directional label selection [J]. International Journal of Latest Research in Science and Technology, 2014, 3(2): 187–190.

    Google Scholar 

  14. WU K, OTOO E, SUZUKI K. Optimizing two-pass connected component labelling algorithms [J]. Pattern Analysis & Applications, 2009, 2: 117–135.

    Article  MathSciNet  Google Scholar 

  15. Wen-Mei W Hwu. GPU Computing Gems Emerald Edition [M]. Elsevier Press, 2011: 1–831.

    Google Scholar 

  16. KIRK D B, Wen-mei W H W U. Programming massively parallel processors: A hands-on approach [M]. Elsevier Press, 2012: 1–487.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammad Farukh Hashmi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hashmi, M.F., Pal, R., Saxena, R. et al. A new approach for real time object detection and tracking on high resolution and multi-camera surveillance videos using GPU. J. Cent. South Univ. 23, 130–144 (2016). https://doi.org/10.1007/s11771-016-3056-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11771-016-3056-6

Key words

Navigation