Skip to main content
SpringerLink
Log in

MesoNet3: A Deepfakes Facial Video Detection Network Based on Object Behavior Analysis

  • Conference paper
  • First Online:
New Trends in Information and Communications Technology Applications (NTICT 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1764))

  • 142 Accesses

Abstract

Deepfake is the process of manipulating objects with images and video. As a result of the development of deep learning techniques such as GAN, Deepfake has become closer to the truth. Many researchers are based on discovering deep fakes that were created by traditional methods. These methods produce often generate artifacts that may be subtle to humans. This paper can detect deepfakes that are perfectly created. Through the use of the new MesoNet3 algorithm to analyze behavior, facial expressions, and the appearance of an object based on a dataset. This paper consists of two stages. The first stage is to build a new MesoNet3 network that is trained on a set of data using a deepfake dataset. The second stage is to test the videos through the extraction of the face. After that, enter it into MesoNet3 and discover whether it is fake or not. The new MesoNet3 algorithm has proven its ability and accuracy in detecting fake video, compared to the old Meso-4. The accuracy of the MesoNet3 in detecting and distinguishing fake and real videos is %99.54.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., Nießner, M.: FaceForensics: a large-scale video dataset for forgery detection in human faces (2018). http://arxiv.org/abs/1803.09179

  2. Huang, R., Fang, F., Nguyen, H.H., Yamagishi, J., Echizen, I.: Security of facial forensics models against adversarial attacks (2019)

    Google Scholar 

  3. Nguyen, T.T., et al.: Deep learning for deepfakes creation and detection: a survey (2019)

    Google Scholar 

  4. Yang, X., Li, Y., Lyu, S.: Exposing deep fakes using inconsistent head poses (2019)

    Google Scholar 

  5. Li, Y., Yang, X., Sun, P., Qi, H., Lyu, S.: Celeb-DF: a large-scale challenging dataset for DeepFake forensics (2020)

    Google Scholar 

  6. Kaur, S., Kumar, P., Kumaraguru, P.: DeepFakes: temporal sequential analysis to detect face-swapped video clips using convolutional long short-term memory (2020). https://doi.org/10.1117/1.JEI.29

  7. Qi, H., et al.: DeepRhythm: exposing DeepFakes with attentional visual heartbeat rhythms (2020)

    Google Scholar 

  8. Ramachandran, S., Nadimpalli, A.V., Rattani, A.: An experimental evaluation on DeepFake detection using deep face recognition (2021)

    Google Scholar 

  9. Hsu, C.C., Zhuang, Y.X., Lee, C.Y.: Deep fake image detection based on pairwise learning. Appl. Sci. (Switzerland) 10 (2020). https://doi.org/10.3390/app10010370

  10. Xia, Z., Qiao, T., Xu, M., Wu, X., Han, L., Chen, Y.: DeepFake video detection based on MesoNet with preprocessing module. Symmetry 14 (2022). https://doi.org/10.3390/sym14050939

  11. Pashine, S., Mandiya, S., Gupta, P., Sheikh, R.: DeepFake detection: survey of facial manipulation detection solutions (2021)

    Google Scholar 

  12. Xia, Z., Qiao, T., Xu, M., Wu, X., Han, L., Chen, Y.: DeepFake video detection based on MesoNet with preprocessing module. Symmetry 14, 939 (2022)

    Google Scholar 

  13. Afchar, D., Nozick, V., Yamagishi, J., Echizen, I.: MesoNet: a compact facial video forgery detection network (2018). https://doi.org/10.1109/WIFS.2018.8630761

  14. Yasrab, R., Jiang, W., Riaz, A.: Fighting DeepFakes using body language analysis. Forecasting 3, 303–321 (2021)

    Article  Google Scholar 

  15. Agarwal, S., Farid, H., El-Gaaly, T., Lim, S.-N.: Detecting deep-fake videos from appearance and behavior (2020)

    Google Scholar 

  16. Hernandez-Ortega, J., Tolosana, R., Fierrez, J., Morales, A.: DeepFakesON-Phys: DeepFakes detection based on heart rate estimation (2020)

    Google Scholar 

  17. Kaur, S., Kumar, P., Kumaraguru, P.: DeepFakes: temporal sequential analysis to detect face-swapped video clips using convolutional long short-term memory. J. Electron. Imaging 29, 33013 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Babylon- College of Information Technology, Babylon, Iraq

    Qasim Jaleel & Israa H. Ali

Authors
  1. Qasim Jaleel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Israa H. Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qasim Jaleel .

Editor information

Editors and Affiliations

  1. University of Information Technology and Communications, Baghdad, Iraq

    Abbas M. Al-Bakry

  2. University of Information Technology and Communications, Baghdad, Iraq

    Safaa O. Al-Mamory

  3. University of Information Technology and Communications, Baghdad, Iraq

    Mouayad A. Sahib

  4. University of Information Technology and Communications, Baghdad, Iraq

    Loay E. George

  5. University of Information Technology and Communications, Baghdad, Iraq

    Jaafar A. Aldhaibani

  6. University of Information Technology and Communications, Baghdad, Iraq

    Haitham S. Hasan

  7. Open University of Tanzania, Dar es Salaam, Tanzania

    George S. Oreku

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Jaleel, Q., Ali, I.H. (2023). MesoNet3: A Deepfakes Facial Video Detection Network Based on Object Behavior Analysis. In: Al-Bakry, A.M., et al. New Trends in Information and Communications Technology Applications. NTICT 2022. Communications in Computer and Information Science, vol 1764. Springer, Cham. https://doi.org/10.1007/978-3-031-35442-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35442-7_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35441-0

  • Online ISBN: 978-3-031-35442-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation