Abstract
The field of Artificial Intelligence is so advanced that it made the creation and modification of synthetic images and videos very easy. Tampering of videos attained a new level of refinement due to the deep learning techniques and the availability of high computing power. This contributes to the ‘deepfake’ era. Deepfake is a term coined for the fake videos created using deep learning techniques. With this method, one can create fake videos of people that they never did by replacing their face in some other real videos. There is a great danger of misusing this technique to disseminate false information or fake news. Thus the detection of deepfakes is critical to protect the people’s pride and trust in the digital content. Most of the works in detecting deepfakes are using deep learning methods. In this paper, we are proposing an approach to identify deepfake videos with very less computational power. The proposed method exploits visual artifacts present in the face regions in the generated deepfakes. We use a three-layer neural network to classify the videos as deepfake or real. As a second step of confirmation, the variance of laplacian is calculated for different patches in the face, and based on their comparison, detection of deepfakes is assured. Our approach is tested in two datasets, UADF dataset, and the latest DeepFakeDetection dataset released by the Google AI team. The proposed method achieves better results in terms of computational requirements and accuracy, and are explained in detail in the analysis section.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Afchar D, Nozick V, Yamagishi J, Echizen I (2018) Mesonet: a compact facial video forgery detection network. In: IEEE international workshop on information forensics and security (WIFS). IEEE, pp 1–7
Thies J, Zollhofer M, Stamminger M, Theobalt C, Niessner M (2016) Face2face: real-time face capture and reenactment of rgb videos. In: The IEEE conference on computer vision and pattern recognition (CVPR)
Antipov G, Baccouche M, Dugelay J (2017) Face aging with conditional generative adversarial networks. In: 2017 IEEE international conference on image processing (ICIP), pp 2089–2093
Upchurch P, Gardner J, Pleiss G, Pless R, Snavely N, Bala K, Weinberger K (2017) Deep feature interpolation for image content changes. In: The IEEE conference on computer vision and pattern recognition (CVPR)
Stankiewicz K (2019) Three threats posed by deepfakes that technology won’t solve. Technol Rev
Rössler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nießner M (2019) Faceforensics++: learning to detect manipulated facial images. arXiv:1901.08971
Matern F, Riess C, Stamminger M (2019) Exploiting visual artifacts to expose deepfakes and face manipulations. In: IEEE winter applications of computer vision workshops (WACVW). IEEE, pp 83–92
Li Y, Lyu S (2018) Exposing deepfake videos by detecting face warping artifacts. arXiv:1811.00656
Güera D, Delp EJ (2018) Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE international conference on advanced video and signal based surveillance (AVSS), pp 1–6
Sabir E, Cheng J, Jaiswal A, AbdAlmageed W, Masi I, Natarajan P (2019) Recurrent convolutional strategies for face manipulation detection in videos. Interfaces (GUI) 3:1
Li Y, Chang M-C, Lyu S (2018) In ictu oculi: exposing AI created fake videos by detecting eye blinking. In: IEEE international workshop on information forensics and security (WIFS). IEEE, pp 1–7
Yang X, Li Y, Lyu S (2019) Exposing deep fakes using inconsistent head poses. In: ICASSP 2019—2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 8261–8265
Agarwal S, Farid H, Gu Y, He M, Nagano K, Li H (2019) Protecting world leaders against deep fakes. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 38–45
Güera D, Delp EJ (2018) Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp 1–6
Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1867–1874
Pech-Pacheco JL, Cristóbal G, Chamorro-Martinez J, Fernández-Valdivia J (2000) Diatom autofocusing in brightfield microscopy: a comparative study. In: Proceedings 15th international conference on pattern recognition. ICPR-2000, vol 3. IEEE, pp 314–317
Soukupova T, Cech J (2016) Eye blink detection using facial landmarks. In: 21st computer vision winter workshop. Rimske Toplice, Slovenia
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sahla Habeeba, M.A., Lijiya, A., Chacko, A.M. (2021). Detection of Deepfakes Using Visual Artifacts and Neural Network Classifier. In: Favorskaya, M.N., Mekhilef, S., Pandey, R.K., Singh, N. (eds) Innovations in Electrical and Electronic Engineering. Lecture Notes in Electrical Engineering, vol 661. Springer, Singapore. https://doi.org/10.1007/978-981-15-4692-1_31
Download citation
DOI: https://doi.org/10.1007/978-981-15-4692-1_31
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4691-4
Online ISBN: 978-981-15-4692-1
eBook Packages: EnergyEnergy (R0)