Skip to main content
SpringerLink
Log in

Exposing video inter-frame forgery via histogram of oriented gradients and motion energy image

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

Inter-frame forgery is a common type of video forgery to destroy the video evidence. It occurs in the temporal domain such as frame deletion, frame insertion, frame duplication, and frame shuffling. These forms of forgery are more frequently produced in a surveillance video because the camera position and the scene are relatively stable, where the tampering process is easy to operate and imperceptible. In this paper, we propose an efficient method for inter-frame forgery detection based on histogram of oriented gradients (HOG) and motion energy image (MEI). HOG is obtained from each image as a discriminative feature. In order to detect frame deletion and insertion, the correlation coefficients are used and abnormal points are detected via Grabb’s test. In addition, MEI is applied to edge images of each shot to detect frame duplication and shuffling. Experimental results prove that the proposed method can detect all inter-frame forgeries and achieve higher accuracy with lower execution time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  • Al-Qershi, O. M., & Khoo, B. E. (2019). Enhanced block-based copy-move forgery detection using k-means clustering. Multidimensional Systems and Signal Processing, 30(4), 1671–1695.

  • Bakas, J., Naskar, R., & Dixit, R. (2019). Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between Haralick coded frames. Multimedia Tools and Applications, 78(4), 4905–4935.

  • Baudry, S. (2012). Frame-accurate temporal registration for non-blind video watermarking. In Proceedings of the on multimedia and security (MM&Sec’12) (pp. 19–26). New York, NY: ACM. https://doi.org/10.1145/2361407.2361411.

  • Baudry, S., Chupeau, B., & Lefébvre, F. (2009). A framework for video forensics based on local and temporal fingerprints. In 2009 16th IEEE international conference on image processing (ICIP) (pp. 2889–2892). https://doi.org/10.1109/ICIP.2009.5413438.

  • Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 679–698.

    Article  Google Scholar 

  • Cuevas, C., Yáñez, E. M., & García, N. (2016). Labeled dataset for integral evaluation of moving object detection algorithms: Lasiesta. Computer Vision and Image Understanding, 152(Supplement C), 103–117. https://doi.org/10.1016/j.cviu.2016.08.005.

    Article  Google Scholar 

  • Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In IEEE computer society conference on computer vision and pattern recognition, 2005 (CVPR 2005) (vol. 1, pp. 886–893). IEEE.

  • Fadl, S. M., & Semary, N. A. (2017). Robust copy-move forgery revealing in digital images using polar coordinate system. Neurocomputing, 265, 57–65. https://doi.org/10.1016/j.neucom.2016.11.091.

    Article  Google Scholar 

  • Fadl, S. M., Han, Q., & Li, Q. (2018). Authentication of surveillance videos: Detecting frame duplication based on residual frame. Journal of Forensic Sciences, 63(4), 1099–1109. https://doi.org/10.1111/1556-4029.13658.

    Article  Google Scholar 

  • Grubbs, F. E. (1950). Sample criteria for testing outlying observations. The Annals of Mathematical Statistics, 21(1), 27–58.

    Article  MathSciNet  Google Scholar 

  • Li, H., Luo, W., Qiu, X., & Huang, J. (2017). Image forgery localization via integrating tampering possibility maps. IEEE Transactions on Information Forensics and Security, 12(5), 1240–1252. https://doi.org/10.1109/TIFS.2017.2656823.

    Article  Google Scholar 

  • Lin, G. S., Chang, J. F., & Chuang, C. H. (2011). Detecting frame duplication based on spatial and temporal analyses. In 6th International conference on computer science education (ICCSE) (pp. 1396–1399). https://doi.org/10.1109/ICCSE.2011.6028891.

  • Liu, Y., & Huang, T. (2017). Exposing video inter-frame forgery by zernike opponent chromaticity moments and coarseness analysis. Multimedia Systems, 23(2), 223–238. https://doi.org/10.1007/s00530-015-0478-1.

    Article  MathSciNet  Google Scholar 

  • Nixon, M. S., & Aguado, A. S. (2012). Chapter 9—Moving object detection and description. In M. S. Nixon & A. S. Aguado (Eds.), Feature extraction & image processing for computer vision (3d ed., pp. 435–487). Oxford: Academic Press. https://doi.org/10.1016/B978-0-12-396549-3.00009-4.

    Chapter  Google Scholar 

  • Ouyang, J., Liu, Y., & Liao, M. (2019). Robust copy-move forgery detection method using pyramid model and Zernike moments. Multimedia Tools and Applications, 78(8), 10207–10225.

  • Qadir, G., Yahaya, S., & Ho, A. T. S. (2012). Surrey university library for forensic analysis (sulfa) of video content. In IET conference on image processing (IPR) (pp. 1–6). https://doi.org/10.1049/cp.2012.0422. Retrieved May 8, 2018, from http://sulfa.cs.surrey.ac.uk/index.php.

  • Shi, Y., Qi, M., Yi, Y., Zhang, M., & Kong, J. (2013). Object based dual watermarking for video authentication. Optik—International Journal for Light and Electron Optics, 124(19), 3827–3834. https://doi.org/10.1016/j.ijleo.2012.11.078.

    Article  Google Scholar 

  • Singh, G., & Singh, K. (2019). Video frame and region duplication forgery detection based on correlation coefficient and coefficient of variation. Multimedia Tools and Applications, 78(9), 11527–11562.

  • Sitara, K., & Mehtre, B. (2016). Digital video tampering detection: An overview of passive techniques. Digital Investigation, 18(Supplement C), 8–22. https://doi.org/10.1016/j.diin.2016.06.003.

    Article  Google Scholar 

  • Sohn, H., Neve, W. D., & Ro, Y. M. (2011). Privacy protection in video surveillance systems: Analysis of subband-adaptive scrambling in jpeg xr. IEEE Transactions on Circuits and Systems for Video Technology, 21(2), 170–177. https://doi.org/10.1109/TCSVT.2011.2106250.

    Article  Google Scholar 

  • Ulutas, G., Ustubioglu, B., Ulutas, M., & Nabiyev, V. V. (2018). Frame duplication detection based on bow model. Multimedia Systems, 24(5), 549–567. https://doi.org/10.1007/s00530-017-0581-6.

    Article  Google Scholar 

  • Wang, W., & Farid, H. (2006). Exposing digital forgeries in video by detecting double mpeg compression. In Proceedings of the 8th workshop on multimedia and security (MM&Sec’06) (pp. 37–47). New York, NY: ACM. https://doi.org/10.1145/1161366.1161375.

  • Wang, W., & Farid, H. (2007a). Exposing digital forgeries in video by detecting duplication. In Proceedings of the 9th workshop on multimedia & security (pp. 35–42). Dallas, TX: ACM.

  • Wang, W., & Farid, H. (2007b). Exposing digital forgeries in video by detecting duplication. In Proceedings of the 9th workshop on multimedia & security (pp. 35–42). ACM.

  • Wang, W., Jiang, X., Wang, S., Wan, M., & Sun, T. (2014). Identifying video forgery process using optical flow. In 12th International workshop on digital forensics and watermarking (IWDW) (pp. 244–257). Auckland: Springer. https://doi.org/10.1007/978-3-662-43886-2_18.

  • Yang, J., Huang, T., & Su, L. (2016). Using similarity analysis to detect frame duplication forgery in videos. Multimedia Tools Applications, 75(4), 1793–1811. https://doi.org/10.1007/s11042-014-2374-7.

    Article  Google Scholar 

  • Zabih, R., Miller, J., & Mai, K. (1995). Feature-based algorithms fordetecting and classifying scene breaks. Tech. rep., Cornell University.

  • Zhang, Q., Lu, W., & Weng, J. (2016). Joint image splicing detection in dct and contourlet transform domain. Journal of Visual Communication and Image Representation, 40, 449–458. https://doi.org/10.1016/j.jvcir.2016.07.013.

    Article  Google Scholar 

  • Zhang, Z., Hou, J., Ma, Q., & Li, Z. (2015). Efficient video frame insertion and deletion detection based on inconsistency of correlations between local binary pattern coded frames. Security and Communication Networks, 8(2), 311–320. https://doi.org/10.1002/sec.981.

    Article  Google Scholar 

  • Zhao, D. N., Wang, R. K., & Lu, Z. M. (2018). Inter-frame passive-blind forgery detection for video shot based on similarity analysis. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-018-5791-1.

  • Zheng, L., Sun, T., & Shi, Y. Q. (2015). Inter-frame video forgery detection based on block-wise brightness variance descriptor. In International Workshop on Digital Forensics and Watermarking (IWDW) (pp. 18–30). Taipei: Springer. https://doi.org/10.1007/978-3-319-19321-2-2.

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant Numbers 61471141, 61361166006, 61301099); Key Technology Program of Shenzhen, China (Grant Number JSGG20160427185010977); Basic Research Project of Shenzhen, China (Grant Number JCYJ20150513151706561).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin Institute of Technology, Harbin, 150080, China

    Sondos Fadl, Qi Han & Li Qiong

  2. Faculty of Computers and Information, Menoufia University, Shebin El-koom, 32511, Egypt

    Sondos Fadl

Authors
  1. Sondos Fadl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qi Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Li Qiong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qi Han.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fadl, S., Han, Q. & Qiong, L. Exposing video inter-frame forgery via histogram of oriented gradients and motion energy image. Multidim Syst Sign Process 31, 1365–1384 (2020). https://doi.org/10.1007/s11045-020-00711-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-020-00711-6

Keywords

Search

Navigation