Abstract
Deepfakes are the manipulated images and videos that are created by performing a face swap using various Artificial Intelligence tools. This creates an illusion that someone either said something that they did not say or are someone they are not. This incorrect way of using the deepfake technology leads to severe consequences. Some scenarios like creating political tension, fake terrorism events, damaging image and dignity of people are some of the negative impacts created by these deep fakes. It is difficult for a naked human eye to detect the results of these deepfake technology. Thus, in this work, a deep learning-based method that can efficiently differentiate deepfake videos is developed. The proposed method uses Res-Next pretrained Convolutional neural network for extracting features from the frames that are divided from the input video. The extracted features are then utilized to train a Long Short Term Memory (LSTM) network to differentiate whether the input video taken from the user is subject to any manipulation or not. To make the model perform better on real time data, it is trained with a balanced dataset. The dataset used to train the model is Deepfake detection challenge dataset. The results of the proposed model can predict the output with a better accuracy. This method can thus encounter the threats and danger produced from the deepfake technology to the society.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Guarnera, L., Giudice, O., Battiato, S.: Fighting deepfake by exposing the convolutional traces on images. IEEE Access 8, 165085–165098 (2020)
Kolagati, S., Priyadharshini, T., Rajam, V.M.A.: Exposing deepfakes using a deep multilayer perceptron-convolutional neural network model. Int. J. Inf. Manage. Data Insights 2(1), 100054 (2022)
Nguyen, X.H., Tran, T.S., Nguyen, K.D., Truong, D.T.: Learning spatio-temporal features to detect manipulated facial videos created by the deepfake techniques. Forensic Sci. Int. Digit. Invest. 36, 301108 (2021)
Elhassan, A., Al-Fawa’reh, M., Jafar, M.T., Ababneh, M., Jafar, S.T.: DFT-MF: enhanced deepfake detection using mouth movement and transfer learning. SoftwareX 19, 101115 (2022)
Xu, Z., et al.: Detecting facial manipulated videos based on set convolutional neural networks. J. Vis. Commun. Image Represent. 77, 103119 (2021)
Singh, A., Saimbhi, A.S., Singh, N., Mittal, M.: DeepFake video detection: a time-distributed approach. SN Comput. Sci. 1(4), 1–8 (2020)
Jung, T., Kim, S., Kim, K.: Deepvision: Deepfakes detection using human eye blinking pattern. IEEE Access 8, 83144–83154 (2020)
Chintha, A., et al.: Recurrent convolutional structures for audio spoof and video deepfake detection. IEEE J. Select. Top. Sig. Process. 14(5), 1024–1037 (2020)
Caldelli, R., Galteri, L., Amerini, I., Del Bimbo, A.: Optical Flow based CNN for detection of unlearnt deepfake manipulations. Pattern Recogn. Lett. 146, 31–37 (2021)
Kaur, M., Daryani, P., Varshney, M., Kaushal, R.: Detection of fake images on whatsApp using socio-temporal features. Soc. Netw. Anal. Min. 12(1), 1–13 (2022)
Kang, J., Ji, S.K., Lee, S., Jang, D., Hou, J.U.: Detection enhancement for various deepfake types based on residual noise and manipulation traces. IEEE Access 10, 69031–69040 (2022)
Tolosana, R., Romero-Tapiador, S., Vera-Rodriguez, R., Gonzalez-Sosa, E., Fierrez, J.: DeepFakes detection across generations: Analysis of facial regions, fusion, and performance evaluation. Eng. Appl. Artif. Intell. 110, 104673 (2022)
Yu, C.-M., Chen, K.-C., Chang, C.-T., Ti, Y.-W.: SegNet: a network for detecting deepfake facial videos. Multimedia Syst. 28, 793–814 (2022). https://doi.org/10.1007/s00530-021-00876-5
Nirkin, Y., Wolf, L., Keller, Y., Hassner, T.: “Deepfake detection based on discrepancies between faces and their context”. In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2021)
Han, B., Han, X., Zhang, H., Li, J., Cao, X.: Fighting fake news: two stream network for deepfake detection via learnable SRM. IEEE Trans. Biomet. Behavior Identity Sci. 3(3), 320–331 (2021)
Ciftci, U.A., Demir, I., Yin, L.: Fakecatcher: detection of synthetic portrait videos using biological signals. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020)
Hu, J., Liao, X., Wang, W., Qin, Z.: Detecting compressed deepfake videos in social networks using frame-temporality two-stream convolutional network. IEEE Trans. Circuits Syst. Video Technol. 32(3), 1089–1102 (2021)
Yang, J., Li, A., Xiao, S., Lu, W., Gao, X.: MTD-Net: learning to detect deepfakes images by multi-scale texture difference. IEEE Trans. Inf. Forensics Secur. 16, 4234–4245 (2021)
Kong, C., Chen, B., Li, H., Wang, S., Rocha, A., Kwong, S.: Detect and locate: exposing face manipulation by semantic-and noise-level telltales. IEEE Trans. Inf. Forensics Secur. 17, 1741–1756 (2022)
Yang, J., Xiao, S., Li, A., Lu, W., Gao, X., Li, Y.: MSTA-Net: forgery detection by generating manipulation trace based on multi-scale self-texture attention. IEEE Transactions on Circuits and Systems for Video Technology (2021)
Miao, C., Tan, Z., Chu, Q., Yu, N., Guo, G.: Hierarchical frequency-assisted interactive networks for face manipulation detection. IEEE Transactions on Information Forensics and Security (2022)
Zhang, L., Qiao, T., Xu, M., Zheng, N., Xie, S.: Unsupervised learning-based framework for deepfake video detection. IEEE Transactions on Multimedia (2022)
Pan, D., Sun, L., Wang, R., Zhang, X., Sinnott, R.O.: Deepfake detection through deep learning. In 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), pp. 134–143. IEEE (2020)
Srikantrh, P., Behera, C.K.: A Machine Learning framework for Covid Detection Using Cough Sounds. In: 2022 International Conference on Engineering MIS (ICEMIS), pp. 1–5. IEEE (2022)
Srikanth, P., Behera, C.K.: An Empirical study and assessment of minority oversampling with dynamic ensemble selection on COVID-19 utilizing blood sample. In 2022 International Conference on Engineering & MIS (ICEMIS), pp. 1–7. IEEE (2022)
Srikanth, P.: An efficient approach for clustering and classification for fraud detection using bankruptcy data in IoT environment. Int. J. Inf. Technol. 13(6), 2497–2503 (2021)
Srikanth, P., Rajasekhar, N.: A novel cluster analysis for gene-miRNA interactions documents using improved similarity measure. In 2016 International Conference on Engineering & MIS (ICEMIS), pp. 1–7. IEEE (2016)
Srikanth, P., Deverapalli, D.: A critical study of classification algorithms using diabetes diagnosis. In: 2016 IEEE 6th International Conference on Advanced Computing (IACC), pp. 245–249. IEEE (2016)
Srikanth, P., Anusha, C., Devarapalli, D.: A computational intelligence technique for effective medical diagnosis using decision tree algorithm. i-Manager’s J. Comput. Sci. 3(1), 21 (2015)
Srikanth, P.: Clustering algorithm of novel distribution function for dimensionality reduction using big data of omics: health, clinical and biology research information. In: 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–6. IEEE (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gedela, S.S., Yanda, N., Kusumanchi, H., Daki, S., Challa, K., Gurrala, P. (2023). An Approach to Identify DeepFakes Using Deep Learning. In: Abraham, A., Pllana, S., Casalino, G., Ma, K., Bajaj, A. (eds) Intelligent Systems Design and Applications. ISDA 2022. Lecture Notes in Networks and Systems, vol 716. Springer, Cham. https://doi.org/10.1007/978-3-031-35501-1_57
Download citation
DOI: https://doi.org/10.1007/978-3-031-35501-1_57
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35500-4
Online ISBN: 978-3-031-35501-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)