Skip to main content
SpringerLink
Log in

A Deep Learning Framework for Image Authentication: An Automatic Source Camera Identification Deep-Net

  • Research Article-Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

The main aim of digital image forensics is to validate the authenticity of images by identifying the camera that captured the image and finding traces of any alteration in the spatial content. The majority of the existing literature focuses on manual extraction of intrinsic camera features such as lens aberration, sensor imperfections, pixel non-uniformity, color filter array type, and so on. These handcrafted features are analyzed and characterized as a unique signature for detecting the camera and authenticating the image which is recorded from the device. To facilitate an end-to-end automated forensics analysis, the current research explores the ability of a novel deep learning framework to learn the intrinsic signature of a selected camera model. The proposed deep convolutional network performs source camera identification (SCI). It contains two functional blocks, namely, esidual noise feature extractor (RNFE) and Feature Modulator (FM). To extract the noise pattern from camera images, the RNFE module analyses the debayered image using a U-Net. The generated noise residue is then modulated through a CNN pipeline to an embedding vector. Triplet loss function is used to train the proposed SCI network such that, the images captured from the source cameras are located closer to each other than images from different cameras. Experimental results demonstrate that the CNN achieves a 97.59% F-score and 97.01% recall, on par with state-of-the-art. Hence, the unified architectural representation of the proposed deep-net could be treated as a generic deep net framework in learning the sensor pattern noise (SPN) fingerprint of a camera model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Lukas, J.; Fridrich, J.; Goljan, M.: Digital camera identification from sensor pattern noise. IEEE Trans. Inf. Forensics Secur. 1(2), 205–214 (2006)

    Article  Google Scholar 

  2. San Choi, K.; Lam, E.Y.; Wong, K.K.: Automatic source camera identification using the intrinsic lens radial distortion. Opt. Express 14(24), 11551–11565 (2006)

    Article  Google Scholar 

  3. Thai, T.H.; Cogranne, R.; Retraint, F.: Camera model identification based on the heteroscedastic noise model. IEEE Trans. Image Process. 23(1), 250–263 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  4. Goljan, M.; Fridrich, J.; Filler, T.: Large scale test of sensor fingerprint camera identification. In: Media Forensics and Security. International Society for Optics and Photonics, vol. 7254, p. 72540I (2009)

  5. Filler, T.; Fridrich, J.; Goljan, M.: Using sensor pattern noise for camera model identification. In: 2008 15th IEEE International Conference on Image Processing. IEEE, pp. 1296–1299 (2008)

  6. Thai, T.H.; Retraint, F.; Cogranne, R.: Camera model identification based on the generalized noise model in natural images. Digit. Signal Process. 48, 285–297 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  7. Bromley, J.; Bentz, J.W.; Bottou, L.; Guyon, I.; LeCun, Y.; Moore, C.; Säckinger, E.; Shah, R.: Signature verification using a “siamese” time delay neural network. Int. J. Pattern Recognit. Artif. Intell. 7(04), 669–688 (1993)

    Article  Google Scholar 

  8. Apostolopoulos, S.; De Zanet, S.; Ciller, C.; Wolf, S.; Sznitman, R.: Pathological OCT retinal layer segmentation using branch residual u-shape networks. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, pp. 294–301 (2017)

  9. Bharathiraja, S.: Anti-forensics contrast enhancement detection (AFCED) technique in images based on Laplace derivative histogram. Mobile Netw. Appl. 24(4), 1174–1180 (2019)

    Article  Google Scholar 

  10. Yang, P.; Ni, R.; Zhao, Y.; Zhao, W.: Source camera identification based on content-adaptive fusion residual networks. Pattern Recognit. Lett. 119, 195–204 (2019)

    Article  Google Scholar 

  11. Shah, A.; Zhou, L.; Abrámoff, M.D.; Wu, X.: Multiple surface segmentation using convolution neural nets: application to retinal layer segmentation in OCT images. Biomed. Opt. Express 9(9), 4509–4526 (2018)

    Article  Google Scholar 

  12. Zhang, K.; Zuo, W.; Gu, S.; Zhang, L.: Learning deep CNN denoiser prior for image restoration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3929–3938 (2017)

  13. Noh, H.; Hong, S.; Han, B.: Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1520–1528 (2015)

  14. Chen, Y.; Huang, Y.; Ding, X.: Camera model identification with residual neural network. In: 2017 IEEE International Conference on Image Processing (ICIP). IEEE, pp. 4337–4341 (2017)

  15. Yao, H.; Qiao, T.; Xu, M.; Zheng, N.: Robust multi-classifier for camera model identification based on convolution neural network. IEEE Access 6, 24973–24982 (2018)

    Article  Google Scholar 

  16. Tuama, A.; Comby, F.; Chaumont, M.: Camera model identification with the use of deep convolutional neural networks. In 2016 IEEE International Workshop on Information Forensics and Security (WIFS). IEEE, pp. 1–6 (2016)

  17. Qian, Y.; Dong, J.; Wang, W.; Tan, T.: Deep learning for steganalysis via convolutional neural networks. In: Media Watermarking, Security, and Forensics 2015. International Society for Optics and Photonics, vol. 9409, p. 94090J (2015)

  18. Zhang, K.; Zuo, W.; Chen, Y.; Meng, D.; Zhang, L.: Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  19. Kuzin, A.; Fattakhov, A.; Kibardin, I.; Iglovikov, V.I.; Dautov, R.: Camera model identification using convolutional neural networks. In: 2018 IEEE International Conference on Big Data (Big Data). IEEE, pp. 3107–3110 (2018)

  20. Banerjee, D.; Naskar, R.: Deep Learning based Blind Source Identification of WhatsApp and Facebook Images. In: 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom). IEEE, pp. 306–311 (2021)

  21. Ronneberger, O.; Fischer, P.; Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, pp. 234–241 (2015)

  22. Bondi, L.; Baroffio, L.; Güera, D.; Bestagini, P.; Delp, E.J.; Tubaro, S.: First steps toward camera model identification with convolutional neural networks. IEEE Signal Process. Lett. 24(3), 259–263 (2016)

    Article  Google Scholar 

  23. Huang, N.; He, J.; Zhu, N.; Xuan, X.; Liu, G.; Chang, C.: Identification of the source camera of images based on convolutional neural network. Digit. Investig. 26, 72–80 (2018)

    Article  Google Scholar 

  24. Bayar, B.; Stamm, M.C.: Constrained convolutional neural networks: A new approach towards general purpose image manipulation detection. IEEE Trans. Inf. Forensics Secur. 13(11), 2691–2706 (2018)

    Article  Google Scholar 

  25. Lin, H.; Wo, Y.; Wu, Y.; Meng, K.; Han, G.: Robust source camera identification against adversarial attacks. Comput. Secur. 100, 102079 (2021)

    Article  Google Scholar 

  26. Kirchner, M.; Johnson, C.: Spn-cnn: Boosting sensor-based source camera attribution with deep learning. In: 2019 IEEE International Workshop on Information Forensics and Security (WIFS). IEEE, pp. 1–6 (2019)

  27. Zhang, G.; Wang, B.; Wei, F.; Shi, K.; Wang, Y.; Sui, X.; Zhu, M.: Source camera identification for re-compressed images: a model perspective based on tri-transfer learning. Comput. Secur. 100, 102076 (2021)

    Article  Google Scholar 

  28. López, R.R.; Orozco, A.L.S.; Villalba, L.J.G.: Compression effects and scene details on the source camera identification of digital videos. Expert Syst. Appl. 170, 114515 (2021)

    Article  Google Scholar 

  29. Gurrola-Ramos, J.; Dalmau, O.; Alarcón, T.E.: A residual dense U-Net neural network for image denoising. IEEE Access 9, 31742–31754 (2021)

    Article  Google Scholar 

  30. Tripathi, M.: Facial image denoising using AutoEncoder and UNET. Herit. Sustain. Dev. 3(2), 89–96 (2021)

    Article  Google Scholar 

  31. Hoffer, E.; Ailon, N.: Deep metric learning using triplet network. In: International Workshop on Similarity-Based Pattern Recognition. Springer, Cham, pp. 84–92 (2015)

  32. Gloe, T.; Böhme, R.: The ‘Dresden Image Database’ for benchmarking digital image forensics. In: Proceedings of the 2010 ACM Symposium on Applied Computing, pp. 1584–1590 (2010)

  33. Freire-Obregón, D.; Narducci, F.; Barra, S.; Castrillón-Santana, M.: Deep learning for source camera identification on mobile devices. Pattern Recogn. Lett. 126, 86–91 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the management of the Vellore Institute of Technology, Chennai, India for providing the necessary facility to carry out the research. The authors also thank Dr. Anusooya G, Dr. Geetha S, and Dr. Asnath Victy Phamila Y, School of Computer Science & Engineering, for their feedback towards the enhancement of this research work.

Author information

Authors and Affiliations

  1. Vellore Institute of Technology, Chennai, India

    S. Bharathiraja & B. Rajesh Kanna

  2. Cisco Systems India Pvt Ltd, Bangalore, India

    M. Hariharan

Authors
  1. S. Bharathiraja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. B. Rajesh Kanna
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Hariharan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to B. Rajesh Kanna.

Ethics declarations

Conflict of interest

We wish to confirm that there are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bharathiraja, S., Rajesh Kanna, B. & Hariharan, M. A Deep Learning Framework for Image Authentication: An Automatic Source Camera Identification Deep-Net. Arab J Sci Eng 48, 1207–1219 (2023). https://doi.org/10.1007/s13369-022-06743-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-022-06743-3

Keywords

Search

Navigation