Skip to main content
SpringerLink
Log in

Frame-rate conversion detection based on periodicity of motion artifact

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With the advances in digital video technology, it is becoming easier to forge the digital video without introducing any artificial visual trace. The temporal domain of the digital videos is one of the main targets of video tampering, and video frame-rate conversion is one of the common operations for temporal video tampering such as temporal splicing and video speed adjustment. This operation necessarily accommodates temporal interpolation that introduces the periodic motion artifact on the motion trajectories. In this paper, the frame-rate converted video detection method is proposed based on the motion artifact. The experimental results demonstrated the performance of the proposed method through the extensive experiments on 1300 original videos and 18,000 frame-rate converted videos in uncompressed and H.264/AVC formats. Especially, for the nearest neighbor and motion-based interpolation, the proposed method could detect over than 93.35% of the frame-rate up-converted videos while exhibiting 0.01 false positive rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ascenoso J, Brites C, Pereira F (2005) Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding. In: 5th EURASIP Conference on Speech and Image Processing, Multimedia communications and Sevices, pp. 1-6. Citeseer

  2. Barron JL, Fleet DJ, Beauchemin SS (1994) Performance of optical flow techniques. Int J Comput Vis 12(1):43–77

    Article  Google Scholar 

  3. Bestagini P, Battaglia S, Milani S, Tagliasacchi M, Tubaro S (2013) Detection of temporal interpolation in video sequences. 2013 I.E. Int Conf Acoustics, Speech Signal Process: 3033–3037. doi 10.1109/ICASSP.2013.6638215

  4. Bian S, Luo W, Huang J (2014) Detecting video frame-rate up-conversion based on periodic properties of inter-frame similarity. Multimed Tools Appl 72(1):437–451

    Article  Google Scholar 

  5. Bouguet JY (2013) Pyramidal implementation of the lucas kanade feature tracker description of the algorithm. Cit’e en: 69

  6. Castagno R, Hassvisto P, Ramponi G (1996) A method for motion adaptive frame rate up-conversion. Circ Syst Video Technol, IEEE Trans 6(5):436–446

    Article  Google Scholar 

  7. Center for image processing research sequences. URL http://www.cipr.rpi.edu/resource/sequences/. (last access: Oct. 2015)

  8. Chen M, Fridrich J, Goljan M, Luka’ˇs J (2007) Source digital camcorder identification using sensor photo response non-uniformity. In: Electronic Imaging 2007, pp. 65,051G– 65,051G. International Society for Optics and Photonics

  9. Choi BD, Han JW, Kim CS, Ko SJ (2007) Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. Circ Syst Video Technol, IEEE Trans 17(4):407–416

    Article  Google Scholar 

  10. Choi BT, Lee SH, Ko SJ (2000) New frame rate up-conversion using bi-directional motion estimation. Consumer Electro, IEEE Trans 46(3):603–609

    Article  Google Scholar 

  11. Dash dataset at itec/alpen-adria-universita¨t klagenfurt. URL http://www-itec.uni-klu.ac.at/dash/?page_id=207. (last access: Oct. 2015)

  12. Farid H (2009) Image forgery detection. Sign Process Mag, IEEE 26(2):16–25

    Article  Google Scholar 

  13. Farid H, Simoncelli EP (2004) Differentiation of discrete multidimensional signals. Imag Process, IEEE Trans 13(4):496–508

    Article  MathSciNet  Google Scholar 

  14. Fridrich J (2009) Digital image forensics. Sign Process Mag, IEEE 26(2):26–37

    Article  Google Scholar 

  15. Gallagher AC (2005) Detection of linear and cubic interpolation in jpeg compressed images. In: Computer and Robot Vision, 2005. Proc 2nd Can Conf: 65–72. IEEE

  16. Horn B (1986) Robot vision. MIT press

  17. Kirchner M (2008) Fast and reliable resampling detection by spectral analysis of fixed linear predictor residue. Proc 10th ACM Workshop Multimed Sec: 11–20. ACM

  18. Luka’ˇs J, Fridrich J (2003) Estimation of primary quantization matrix in double compressed jpeg images. Proc Digit Forensic Res Workshop: 5–8

  19. Mahdian B, Saic S (2007) On periodic properties of interpolation and their application to image authentication. In: Information Assurance and Security, 2007. IAS 2007. Third Int Symp: 439–446. IEEE

  20. Milani S, Fontani M, Bestagini P, Barni M, Piva A, Tagliasacchi M, Tubaro S (2012) An overview on video forensics. APSIPA Trans Sign Inform Process 1:e2

    Article  Google Scholar 

  21. Paul RT (2011) Review of robust video watermarking techniques. IJCA Special Issue Computat Sci 3:90–95

    Google Scholar 

  22. Popescu AC, Farid H (2005) Statistical tools for digital forensics. In: Information Hiding, pp. 128–147. Springer

  23. Simoncelli EP (1999) Bayesian multi-scale differential optical flow

  24. Stamm MC, Lin WS, Liu K (2012) Temporal forensics and anti-forensics for motion compensated video. Inform Forensics Sec, IEEE Trans 7(4):1315–1329

    Article  Google Scholar 

  25. Video trace library yuv video sequences. URL http://trace.eas.asu.edu/yuv/. (last access: Oct. 2015)

  26. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. Imag Process, IEEE Trans 13(4):600–612

    Article  Google Scholar 

  27. Wang W, Farid H (2007) Exposing digital forgeries in interlaced and deinterlaced video. Inform Forensics Sec, IEEE Trans 2(3):438–449

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIP) (No. 2016R1A2B2009595), and by the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korean government (MSIP) (No.R0126-16-1024, Managerial Technology Development and Digital Contents Security of 3D Printing based on Micro Licensing Technology).

Author information

Authors and Affiliations

  1. Agency for Defense Development, P.O.Box 35, Yusong-Gu Daejoen, South Korea, 34186

    Dae-Jin Jung

  2. School of Computing, KAIST, 291 Daehak-Ro, Yusong-Gu Daejoen, South Korea, 34141

    Heung-Kyu Lee

Authors
  1. Dae-Jin Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heung-Kyu Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heung-Kyu Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, DJ., Lee, HK. Frame-rate conversion detection based on periodicity of motion artifact. Multimed Tools Appl 77, 6095–6116 (2018). https://doi.org/10.1007/s11042-017-4519-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4519-y

Keywords

Search

Navigation