Skip to main content
SpringerLink
Log in

Intelligent video surveillance for real time energy savings in smart buildings using HEVC compressed domain features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This work presents a unique approach to utilize the existing video surveillance infrastructure to optimize electricity consumption in large indoor spaces such as library reading halls, waiting rooms, indoor sports complex, large dormitories etc. The proposed method extracts features from the encoder loop of the digital video recorder (DVR) to analyze the foreground activity. High Efficiency Video Coding (HEVC) is chosen as the target video codec, as it is going to be the most widely deployed video codec in the future DVRs. The bit rate efficiency of HEVC is almost double in comparison to H.264/AVC for same video quality [17]. The proposed method utilizes only compressed domain parameters from video stream such as motion vectors clustering information, block partitioning modes etc., which allows to develop algorithms with relatively lower computational complexity and memory requirement than pixel based methods thus achieving real time performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Babu RV, Tom M, Wadekar P (2016) A survey of compressed domain video analysis techniques. In:. Multimedia tools applic 75:1043–1078

    Article  Google Scholar 

  2. Barnich O, Van Droogenbroeck M (2009) Vibe: a powerful random technique to estimate the background in video sequences. In: IEEE international conference on acoustics, speech and signal processing, pp. 945–948

  3. Chan YW, Chen K, Yuan S, Kuo AS (2016) Moving object counting using a tripwire in H.265/ HEVC bitstreams for video surveillance. In:. IEEE Access 4:2529–2541

    Article  Google Scholar 

  4. Dey B, Kundu M (2015) Efficient foreground extraction from HEVC compressed video for application to real time analysis of surveillance big data. In:. IEEE Trans Circuits Syst Video Techno 24(11):3574–3585

    MathSciNet  Google Scholar 

  5. DS-7304/7308/7316HQHI-K4, Turbo HD DVR, Hangzhou Hikvision Digital Technology Co., Ltd

  6. Elgammal A, Hanvood D, Davis LS (2000) Non-parametric model for background subtraction. Proc ECCV 2000:751–767

    Google Scholar 

  7. Goyette N, Jodoin P-M, Porikli F, Konrad J, Ishwar P (2014) A novel video dataset for change detection benchmarking. In:. IEEE Trans Image Process 23(11):4663–4679

    Article  MathSciNet  Google Scholar 

  8. HEVC Test Model version 16.12 https://hevc.hhi.fraunhofer.de/

  9. Hofman M, Tiefenbacher P, Rigoll G (2012) Background segmentation with feedback: the pixel based adaptive segmenter. In: Proc. IEEE computer society conference on computer vision and pattern recognition workshop, pp. 38–43

  10. Huang T, Dong S, Tian Y (2014) Representing visual objects in HEVC coding loop. In:. IEEE J emerging and selected topics in circuits and systems 4(1):5–16

    Article  Google Scholar 

  11. Kim K, Chalidabhongse T, Harwood D, Davis L (2004) Background modeling and subtraction by codebook construction. In: Int. conference on image processing, pp. 3061–3064

  12. Li H, Zhang Y, Yang M, Men Y, Chao H (2014) A rapid abnormal event detection method for surveillance videos based on a novel feature in compressed domain of HEVC. In: IEEE conf. Multimedia Expo

  13. Liang Y, Xu M, Ren J, Wang Z (2015) Learning to segment videos in HEVC compressed domain. In: International conf. wireless comm. signal processing

  14. Maddalena L, Petrosino A (2008) A self organizing approach to background subtraction for visual surveillance applications. In: IEEE trans. Image processing, 1168–1177

    Article  MathSciNet  Google Scholar 

  15. Moriyama M, Minemura K, Wong K (2015) Moving object detection in HEVC video by frame sub sampling. In: International sympo. on intell. signal proces. comm. syst. pp. 48–52

  16. Stauffer C, Grimson E (1999) Adaptive background mixture models for real time tracking. In:. Proc IEEE International conference on computer vision and pattern recognition 2:246–252

    Google Scholar 

  17. Sullivan GJ, Ohm J, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. In:. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  18. Sze V, Budagavi M, Sullivan GJ (2014) High efficiency video coding (HEVC), algorithms and architectures, Springer Switzerland

  19. Wang H, Suter D (2006) Background subtraction based on a robust consensus method. In: Proc. Of 18th international conference on pattern recognition, pp. 223–226

  20. Wang W, Yang J, Gao W (2008) Modelling background and segmenting moving objects from compressed videos. In:. IEEE transactions on circuit & systems for video technology 18(5):670–681

    Article  Google Scholar 

  21. Xu Y, Dong J, Zhang B, Xu D (2016) Background modeling methods in video analysis: A review and comparative evaluation. In: CAAI transactions on intelligent technology, 1

  22. Zhao L, He Z, Cao W, Zhao D (2017) Real time moving object segmentation and classification from HEVC compressed surveillance videos. In: IEEE Trans. Circuits Syst. Video Techno. preprint issue 99

  23. Zivkovic Z (2004) Improved adaptive gaussian mixture model for background subtraction. In: Proc. 17th international conference on pattern recognition, vol. 2, pp. 28–31

Download references

Author information

Authors and Affiliations

  1. Birla Institute of Technology & Science, Pilani, Rajasthan, 333031, India

    Devesh Samaiya & Karunesh Kumar Gupta

Authors
  1. Devesh Samaiya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karunesh Kumar Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Devesh Samaiya.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Samaiya, D., Gupta, K.K. Intelligent video surveillance for real time energy savings in smart buildings using HEVC compressed domain features. Multimed Tools Appl 77, 29059–29076 (2018). https://doi.org/10.1007/s11042-018-6087-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6087-1

Keywords

Search

Navigation