Detecting Tampered Videos with Multimedia Forensics and Deep Learning

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11295)


User-Generated Content (UGC) has become an integral part of the news reporting cycle. As a result, the need to verify videos collected from social media and Web sources is becoming increasingly important for news organisations. While video verification is attracting a lot of attention, there has been limited effort so far in applying video forensics to real-world data. In this work we present an approach for automatic video manipulation detection inspired by manual verification approaches. In a typical manual verification setting, video filter outputs are visually interpreted by human experts. We use two such forensics filters designed for manual verification, one based on Discrete Cosine Transform (DCT) coefficients and a second based on video requantization errors, and combine them with Deep Convolutional Neural Networks (CNN) designed for image classification. We compare the performance of the proposed approach to other works from the state of the art, and discover that, while competing approaches perform better when trained with videos from the same dataset, one of the proposed filters demonstrates superior performance in cross-dataset settings. We discuss the implications of our work and the limitations of the current experimental setup, and propose directions for future research in this area.


Video forensics Video tampering detection Video verification Video manipulation detection User-generated video 



This work is supported by the InVID project, which is funded by the European Commission’s Horizon 2020 program under contract number 687786.


  1. 1.
    Chen, S., Tan, S., Li, B., Huang, J.: Automatic detection of object-based forgery in advanced video. IEEE Trans. on Circ. Syst. Video Technol. 26(11), 2138–2151 (2016)CrossRefGoogle Scholar
  2. 2.
    D’Amiano, L., Cozzolino, D., Poggi, G., Verdoliva, L.: Video forgery detection and localization based on 3D patchmatch. In: IEEE International Conference on Multimedia Expo Workshop (ICMEW) (2015)Google Scholar
  3. 3.
    Dong, Q., Yang, G., Zhu, N.: A MCEA based passive forensics scheme for detecting frame based video tampering. Digit. Investig. 9, 151–159 (2012)CrossRefGoogle Scholar
  4. 4.
    Fridrich, J., Kodovsky, J.: Rich models for steganalysis of digital images. IEEE Trans. Inf. Forensics Secur. 7(3), 868–882 (2012)CrossRefGoogle Scholar
  5. 5.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  6. 6.
    Labartino, D., Bianchi, T., Rosa, A.D., Fontani, M., Vazquez-Padin, D., Piva, A.: Localization of forgeries in MPEG-2 video through GOP size and DQ analysis. In: IEEE International Workshop on Multimedia and Signal Processing, pp. 494–499 (2013)Google Scholar
  7. 7.
    Li, L., Wang, X., Wang, G., Hu, G.: Detecting removed object from video with stationary background. In: Proceedings of the 11th International Conference on Digital Forensics and Watermarking (WDW), pp. 242–252 (2013)CrossRefGoogle Scholar
  8. 8.
    Lin, C.S., Tsay, J.J.: A passive approach for effective detection and localization of region-level video forgery with spatio-temporal coherence analysis. Digit. Investig. 11(2), 120–140 (2014)CrossRefGoogle Scholar
  9. 9.
    Pandey, R., Singh, S., Shukla, K.: Passive copy-move forgery detection in videos. In: IEEE International Conference on Computer and Communications and Technology (ICCCT), pp. 301–306 (2014)Google Scholar
  10. 10.
    Papadopoulou, O., Zampoglou, M., Papadopoulos, S., Kompatsiaris, Y., Teyssou, D.: Invid Fake Video Corpus v2.0 (Version 2.0). Dataset on Zenodo (2018)Google Scholar
  11. 11.
    Pittaras, N., Markatopoulou, F., Mezaris, V., Patras, I.: Comparison of fine-tuning and extension strategies for deep convolutional neural networks. In: Amsaleg, L., Guðmundsson, G.Þ., Gurrin, C., Jónsson, B.Þ., Satoh, S. (eds.) MMM 2017. LNCS, vol. 10132, pp. 102–114. Springer, Cham (2017). Scholar
  12. 12.
    Piva, A.: An overview on image forensics. ISRN Sig. Process. 2013, 22 p. (2013). Article ID 496701Google Scholar
  13. 13.
    Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., Nießner, M.: FaceForensics: a large-scale video dataset for forgery detection in human faces. arXiv preprint arXiv:1803.09179 (2018)
  14. 14.
    Sitara, K., Mehtre, B.M.: Digital video tampering detection: an overview of passive techniques. Digit. Investig. 18, 8–22 (2016)CrossRefGoogle Scholar
  15. 15.
    Su, L., Huang, T., Yang, J.: A video forgery detection algorithm based on compressive sensing. Multimedia Tools Appl. 74, 6641–6656 (2015)CrossRefGoogle Scholar
  16. 16.
    Su, Y., Xu, J.: Detection of double compression in MPEG-2 videos. In: IEEE 2nd International Workshop on Intelligent Systems and Application (ISA) (2010)Google Scholar
  17. 17.
    Subramanyam, A., Emmanuel, S.: Video forgery detection using HOG features and compression properties. In: IEEE 14th International Workshop on Multimedia and Signal Processing (MMSP), pp. 89–94 (2012)Google Scholar
  18. 18.
    Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)Google Scholar
  19. 19.
    Wang, W., Farid, H.: Exposing digital forgeries in interlaced and deinterlaced video. IEEE Trans. Inf. Forensics Secur. 2(3), 438–449 (2007)CrossRefGoogle Scholar
  20. 20.
    Wu, Y., Jiang, X., Sun, T., Wang, W.: Exposing video inter-frame forgery based on velocity field consistency. In: ICASSP (2014)Google Scholar
  21. 21.
    Xu, J., Su, Y., Liu, Q.: Detection of double MPEG-2 compression based on distribution of DCT coefficients. Int. J. Pattern Recogn. AI 27(1), 1354001 (2013)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Yao, Y., Shi, Y., Weng, S., Guan, B.: Deep learning for detection of object-based forgery in advanced video. Symmetry 10(1), 3 (2017)CrossRefGoogle Scholar
  23. 23.
    Zampoglou, M., Papadopoulos, S., Kompatsiaris, Y.: Large-scale evaluation of splicing localization algorithms for web images. Multimedia Tools Appl. 76(4), 4801–4834 (2017)CrossRefGoogle Scholar
  24. 24.
    Zhang, Z., Hou, J., Ma, Q., Li, Z.: Efficient video frame insertion and deletion detection based on inconsistency of correlations between local binary pattern coded frames. Secur. Commun. Netw. 8(2), 311–320 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Centre for Research and Technology HellasThermi-ThessalonikiGreece
  2. 2.eXo maKinaParisFrance
  3. 3.School of EECSQueen Mary University of LondonLondonUK

Personalised recommendations