Skip to main content
SpringerLink
Log in

Dynamic strategy to use optimum memory space in real-time video surveillance

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

In present days real-time video surveillance is a very essential aspect of establishing safety, observing traffic, and detecting violence and crimes. Intelligent video surveillance (IVS) is one of the most acknowledged frameworks in a security application. But, video surveillance systems consume huge memory space to store the recorded video, especially in the case of high-resolution recording. However, if we use low-resolution video recording then the video quality will be reduced and the objects/violence cannot be identified clearly. To overcome the stated limitation, this article introduced a smart video surveillance system with a dynamic strategy to use optimum memory space with the best surveillance objective. The proposed system can dynamically record video with high-resolution during suspicious movement of objects/violence as well as low-resolution video at other times. The system is based on the detection of suspicious movement of objects in consecutive frames, saving of suspicious frames with high resolution, and neglecting of less important frames. Finally, the Contrast Limited Adaptive Histogram Equalization (CLAHE) based on Color Channel is applied to all the suspicious frames as a post-processing step for better contract adjustment and to provide a clear view of suspicious objects in frames. The quality of enhanced frames are assessed by two no-reference methods, i.e. NIQMC and BIQME. Multiple visual quality parameters like sharpness, contrast, colorfulness, brightness, and naturalness of frames, etc. are used for assessment Several real-time experiments reveal that the proposed system can detect suspicious objects with 97.65% accuracy. Besides, it consumes 75% less memory space in real-time surveillance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availability

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

References

  • Ahmed I, Jeon G (2021) A real-time person tracking system based on SiamMask network for intelligent video surveillance. J Real-Time Image Proc. https://doi.org/10.1007/s11554-021-01144-5

    Article  Google Scholar 

  • Alsmirat M, Sarhan NJ (2020) Intelligent optimization for automated video surveillance at the edge: $ cross-layer approach. Simul Model Pract Theory 105:102171

    Article  Google Scholar 

  • Chen BH, Huang S-C, Ten J-Y (2018) Counter-propagation artificial neural network-based motion detection algorithm for static-camera surveillance scenarios. Neurocomputing 273:481–493

    Article  Google Scholar 

  • Cheng L, Jiliang Wang. (2018) ViTrack: efficient tracking on the edge for commodity video surveillance systems. In: IEEE conference on computer communications. IEEE

  • Chenggang Yan C, Teng T, Liu Y, Zhang Y, Wang H, Ji X (2021) Precise no-reference image quality evaluation based on distortion identification. ACM Trans Multimed Comput Commun Appl 17:1–21

    Article  Google Scholar 

  • Circo G, McGarrell E (2021) Estimating the impact of an integrated CCTV program on crime. J Exp Criminol. https://doi.org/10.1007/s11292-019-09404-y

    Article  Google Scholar 

  • Cui X, Ruizhe Hu (2021) Application of intelligent edge computing technology for video surveillance in human movement recognition and Taekwondo training. Alex Eng J. https://doi.org/10.1016/j.aej.2021.08.020

    Article  Google Scholar 

  • Cui L, Dongyuan Su, Zhou Y, Zhang L, Yulei Wu, Chen S (2020) Edge learning for surveillance video uploading sharing in public transport systems. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2020.3008420

    Article  Google Scholar 

  • Epsiba P, Kumaratharan N, Suresh G (2018) A novel discrete CURVELET transform and modified WHOG for video surveillance services. J Concurr Comput Pract Exper. https://doi.org/10.1002/cpe.5046

    Article  Google Scholar 

  • Freitas PG, Akamine WYL, Farias MCQ (2018) No-reference image quality assessment using orthogonal color planes patterns. IEEE Trans Multimedia 20:3353–3360

    Article  Google Scholar 

  • Gaba GS, Singh P, Singh G (2012) Implementation of image enhancement techniques (IOSR). J Electron Commun Eng (IOSRJECE) 1(2):20–23

    Article  Google Scholar 

  • Gao J, Yuan Y, Wang Qi (2020) Feature-aware adaptation and density alignment for crowd counting in video surveillance. IEEE Trans Cybern. https://doi.org/10.1109/TCYB.2020.3034316

    Article  Google Scholar 

  • Garcia BG, Bouwmans T, Silva AJR (2020) Background subtraction in real applications: challenges, current models and future directions. Comput Sci Rev 35:100204

    Article  MathSciNet  Google Scholar 

  • Geu et al (2022) Lightweight deep network-enabled real-time low-visibility enhancement for promoting vessel detection in maritime video surveillance. J Navig 75(1):230–250. https://doi.org/10.1017/S0373463321000783

    Article  Google Scholar 

  • Gouranga Mandal G, De P, Bhattacharya D (2020) Real-time fast fog removal approach for assisting drivers during dense fog on hilly roads. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-020-02734-0

    Article  Google Scholar 

  • Grabowski D, Czyzewski A (2020) System for monitoring road slippery based on CCTV cameras and convolutional neural networks. J Intell Inf Syst. https://doi.org/10.1007/s10844-020-00618-5

    Article  Google Scholar 

  • Gu K, Lin W, Zhai G, Yang X, Zhang W, Chen CW (2017) No-reference quality metric of contrast-distorted images based on information maximization. IEEE Trans Cybern 47(12):4559–4565

    Article  Google Scholar 

  • Gu K, Tao D, Qiao J, Lin W (2018) Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans Neural Netw Learn Syst 29(4):1301–1313

    Article  Google Scholar 

  • Hanbin L, Liu J, Fang W, Love PED, QunzhouYu ZL (2020) Real-time smart video surveillance to manage safety: a case study of a transport mega-project. Adv Eng Inform 45:101100

    Article  Google Scholar 

  • Hashemzadeh M, Zademehdi A (2019) Fire detection for video surveillance applications using ICA K-medoids-based color model and efficient spatio-temporal visual features. Expert Syst Appl 130:60–78

    Article  Google Scholar 

  • Herath, Mittal (2022) Adoption of artificial intelligence in smart cities: a comprehensive review. Int J Inf Manag Data Insights. https://doi.org/10.1016/j.jjimei.2022.100076

    Article  Google Scholar 

  • Hossen M K, Sabrina Hoque Tuli. (2016) A surveillance system based on motion detection and motion estimation using optical flow. In: 5th international conference on informatics, electronics and vision (ICIEV). IEEE

  • Isern J, Barranco F, Deniz D, Lesonen J, Hannuksela J, Carrillo RR (2020) Reconfigurable cyber-physical system for critical infrastructure protection in smart cities via smart video-surveillance. Pattern Recogn Lett 140:303–309

    Article  Google Scholar 

  • Jayaraman S, Esakkirajan S, Veerakumar T (2009) Digital image processing. McGraw Hill Education, New Delhi

    Google Scholar 

  • Ko KF, Sim K-B (2018) Deep convolutional framework for abnormal behavior detection in a smart surveillance system. Eng Appl Artif Intell 67:226–234

    Article  Google Scholar 

  • Korhonen J (2019) Two-level approach for no-reference consumer video quality assessment. IEEE Trans Image Process 28:5923–5938

    Article  MathSciNet  MATH  Google Scholar 

  • Kulshrestha T, Saxena D, Niyogi R, Cao J (2019) Real-time crowd monitoring using seamless indoor-outdoor localization. IEEE Trans Mob Comput. https://doi.org/10.1109/TMC.2019.2897561

    Article  Google Scholar 

  • Li Z, Bi DY, He LY (2016) Variational histogram equalization for single color image defogging. Math Probl Eng. https://doi.org/10.1155/2016/9897064

    Article  MathSciNet  MATH  Google Scholar 

  • Lim JY, Jobayer MIA, Baskaran VM, Lim JM, See J, Wong KokSheik (2021) Deep multi-level feature pyramids: application for non-canonical firearm detection in video surveillance. Eng Appl Artif Intell 97:104094

    Article  Google Scholar 

  • Limas et al (2022) Human pose estimation for mitigating false negatives in weapon detection in video-surveillance. Neurocomputing 489:488–503. https://doi.org/10.1016/j.neucom.2021.12.059

    Article  Google Scholar 

  • Liu RW, Yuan W, Chen X, Yuxu Lu (2021) An enhanced CNN-enabled learning method for promoting ship detection in maritime surveillance system. Ocean Eng 253:109435

    Article  Google Scholar 

  • Lyu W, Wei Lu, Ma M (2020) No-reference quality metric for contrast-distorted image based on gradient domain and HSV space. J Vis Commun Image Represent 69:102797

    Article  Google Scholar 

  • Mandal G, De P, Bhattacharya D (2021) Real time vision based overtaking assistance system for drivers at night on two-lane single carriageway. Computacion y Sistemas 25:403–416

    Google Scholar 

  • Manikandana, Rahamathunnisa (2022) A neural network aided attuned scheme for gun detection in video surveillance images. Image Vis Comput. https://doi.org/10.1016/j.imavis.2022.104406

    Article  Google Scholar 

  • Nguyena MT, Truong LH, Tran TT, Chien C-F (2020) Artificial intelligence based data processing algorithm for video surveillance to empower industry 3.5. Comput Ind Eng 148:106671

    Article  Google Scholar 

  • Nikouei SY, Chen Yu, Aved A, Blasch E (2020) I-ViSE: interactive video surveillance as an edge service using unsupervised feature queries. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2020.3016825

    Article  Google Scholar 

  • Noor K, E Alam Siddiquee, Dhiman Sarma, Avijit Nandi, Sharmin Akhter, Sohrab Hossain, Karl Andersson, Mohammad Shahadat Hossain. (2017) Performance analysis of a surveillance system to detect and track vehicles using Haar cascaded classifiers and optical flow method. In: 12th IEEE conference on industrial electronics and applications (ICIEA). IEEE

  • WH Organization (2018) Current state of global road safety: global status report on road safety 2018: supporting a decade of action, Geneve

  • Oszust M, Piorkowski A, Obuchowicz R (2020) No-reference image quality assessment of magnetic resonance images with high-boost filtering and local features. Magn Reson Med 84:1648–1660

    Article  Google Scholar 

  • Pillai MS, Chaudhary G, Khari M, Crespo RG (2021) Real-time image enhancement for automatic automobile accident detection through CCTV using deep learning. J Soft Comput 25:11929–11940

    Article  Google Scholar 

  • Qi F, Li H, Luo X, Ding L, Luo H, Timothy MR, An W (2018) Detecting non-hardhat-use by a deep learning method from far-field surveillance videos. Autom Constr 85:1–9

    Article  Google Scholar 

  • Rajavel R, Ravichandran SK, Harimoorthy K, Nagappan P, Gobichettipalayam KR (2020) IoT-based smart healthcare video surveillance system using edge computing. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-021-03157-1

    Article  Google Scholar 

  • Rajavel et al (2022) Cloud-enabled diabetic retinopathy prediction system using optimized deep belief network classifier. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-022-04114-2

    Article  Google Scholar 

  • Salau J, Krieter J (2020) Analysing the space-usage-pattern of a cow herd using video surveillance and automated motion detection. Biosyst Eng 197:122–134

    Article  Google Scholar 

  • Shen WW, Chen L, Liu S, Zhang Y-D (2021) An image enhancement algorithm of video surveillance scene based on deep learning. IET Image Proc. https://doi.org/10.1049/ipr2.12286

    Article  Google Scholar 

  • Shepelev V, Aliukov S, Nikolskaya K, Das A, Slobodin I (2020) The use of multi-sensor video surveillance system to assess the capacity of the road network. Transp Telecommun 21:15–31

    Google Scholar 

  • Shin W, Seok-Jun Bu, Cho S-B (2020) 3D-convolutional neural network with generative adversarial network and autoencoder for robust anomaly detection in video surveillance. Int J Neural Syst 30:2050034

    Article  Google Scholar 

  • Singla N (2014) Motion detection based on frame difference method. Int J Inf Comput Technol 4:1159–1165

    Google Scholar 

  • Sridhar S (2011) Digital image processing, 2nd edn. Oxford University Press India

  • Statista Organization (2021) Crime worldwide - statistics & facts: crime globally 2021, Statistical Research Department

  • Sultan S, Jensen CD (2021) Metadata based need-to-know view in large-scale video surveillance systems. Comput Secur 111:102452

    Article  Google Scholar 

  • Suresh S, Das D, Lal S, Gupta D (2018) Image quality restoration framework for contrast enhancement of satellite remote sensing images. Remote Sens Appl Soc Environ 10:104–119

    Google Scholar 

  • Thenmozhi T, Kalpana AM (2020) Adaptive motion estimation and sequential outline separation based moving object detection in video surveillance system. Microprocess Microsyst 76:103084

    Article  Google Scholar 

  • Tseng CH, Hsieh C-C, Jwo D-J, Jyh-Horng Wu, Sheu R-K, Chen L-C (2021) Person retrieval in video surveillance using deep learning–based instance segmentation. J Sens. https://doi.org/10.1155/2021/9566628

    Article  Google Scholar 

  • Vishnu VCM, Rajalakshmi M, Nedunchezhian R (2018) Intelligent traffic video surveillance and accident detection system with dynamic traffic signal control. Clust Comput 21:135–147

    Article  Google Scholar 

  • Wang R, Wei-Tek Tsai, Juan He, Can Liu, Qi Li, Enyan Deng. (2019) A video surveillance system based on permissioned blockchains and edge computing. In: 2019 IEEE international conference on big data and smart computing. IEEE

  • Yogameena B, Menaka K, Saravana Perumaal S (2019) Deep learning-based helmet wear analysis of a motorcycle rider for intelligent surveillance system. IET Intel Transport Syst 13:1190–1198

    Article  Google Scholar 

  • Zhang Y, Chao Xu, Hemadeh IA, El-Hajjar M, Hanzo L (2020) Near-instantaneously adaptive multi-set space-time shift keying for UAV-aided video surveillance. IEEE Trans Veh Technol. https://doi.org/10.1109/TVT.2020.3012208

    Article  Google Scholar 

  • Zhang et al (2022) Blockchain-based collaborative edge intelligence for trustworthy and real-time video surveillance. IEEE Trans Industr Inf. https://doi.org/10.1109/TII.2022.3203397

    Article  Google Scholar 

  • Zheng W, Wang K, Wang F-Y (2020) A novel background subtraction algorithm based on parallel vision and Bayesian GANs. Neurocomputing 394:178–200

    Article  Google Scholar 

  • Zhenxiong Xu Z, Danhong Zhang, Lin Du. (2017) Moving object detection based on improved three frame difference and background subtraction. In: International conference on industrial informatics - computing technology, intelligent technology, industrial information integration (ICIICII). IEEE

Download references

Acknowledgements

The authors would like to acknowledge the National Institute of Technology Agartala, Tripura, India for providing a world-class research environment including the research laboratory.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology Agartala, Agartala, Tripura, India

    Tamal Biswas, Diptendu Bhattacharya & Gouranga Mandal

  2. School of Computer Science and Engineering, VIT-AP University, Amaravati, Andhra Pradesh, India

    Gouranga Mandal

Authors
  1. Tamal Biswas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diptendu Bhattacharya
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gouranga Mandal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tamal Biswas.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Biswas, T., Bhattacharya, D. & Mandal, G. Dynamic strategy to use optimum memory space in real-time video surveillance. J Ambient Intell Human Comput 14, 2771–2784 (2023). https://doi.org/10.1007/s12652-023-04521-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-023-04521-z

Keywords

Search

Navigation