Multimedia Tools and Applications

, Volume 76, Issue 4, pp 4747–4764 | Cite as

Handling multiple materials for exposure of digital forgeries using 2-D lighting environments

  • Christian Riess
  • Mathias Unberath
  • Farzad Naderi
  • Sven Pfaller
  • Marc Stamminger
  • Elli Angelopoulou
Article

Abstract

The distribution of incident light is an important physics-based cue for exposing image manipulations. If an image has been composed from multiple sources, it is likely that the illumination environments of the spliced objects differ. Johnson and Farid introduced a proof-of-principle algorithm for a forensic comparison of lighting environments. However, this baseline approach suffers from relatively strict assumptions that limit its practical applicability. In this work, we address one of the biggest limitations, namely the need to compute a lighting environment from patches of homogeneous material. To compute a lighting environment from multiple-color surfaces, we propose a method that we call “intrinsic contour estimation” (ICE). ICE is able to integrate reflectances from multiple materials into one lighting environment, as long as surfaces of different materials share at least two similar normal vectors. We validate the proposed method in a controlled ground-truth experiment on two datasets, with light from three different directions. These experiments show that using ICE can improve the median estimation error by almost 50 %, and the mean error by almost 30 %.

Keywords

Image forensics 2-D lighting environment Illuminant direction Reflectance normalization 

Notes

Acknowledgments

This work was supported by the Research Training Group 1773 “Heterogeneous Image Systems”, funded by the German Research Foundation (DFG).

References

  1. 1.
    Brian V, Funt Mark S, Drew MB (2005) Recovering shading from color images. In: European Conference on Computer Vision, pp 124–132Google Scholar
  2. 2.
    Conotter V, O’Brien JF, Farid H (2012) Exposing digital forgeries in ballistic motion. IEEE Trans Inf Forensic Secur 7(1):283–296CrossRefGoogle Scholar
  3. 3.
    De Carvalho TJ, Riess C, Angelopoulou E, Pedrini H, Rocha A (2013) Exposing digital image forgeries by illumination color classification. IEEE Trans Inf Forensic Secur 8(7):1182–1194CrossRefGoogle Scholar
  4. 4.
    Fan W, Wang K, Cayre F, Xiong Z (2012) 3D lighting-based image forgery detection using shape-from-shading. In: Proceedings of the 20th European Signal Processing Conference (EUSIPCO-2012). Bucarest, Romania, pp 1777–1781Google Scholar
  5. 5.
  6. 6.
    Forsyth DA, Ponce J (2003) Computer vision — a modern approach. Pearson Education IncGoogle Scholar
  7. 7.
    Gehler PV, Rother C, Kiefel M, Zhang L, Schölkopf B (2011) Recovering intrinsic images with a global sparsity prior on reflectance. In: Advances in Neural Information Processing Systems (NIPS 2011), vol 24. Granada, Spain, pp 765–773Google Scholar
  8. 8.
    Grosse R, Johnson M, Adelson E, Freeman W (2009) Ground truth dataset and baseline evaluations for intrinsic image algorithms. In: Proceedings of the 12th IEEE International Conference on Computer Vision (ICCV 2009), Kyoto, Japan, pp 2335–2342Google Scholar
  9. 9.
    Johnson M, Farid H (2007) Exposing digital forgeries in complex lighting environments. IEEE Trans Inf Forensic Secur 2(3):450–461CrossRefGoogle Scholar
  10. 10.
    Kee E, Farid H (2010) Exposing digital forgeries from 3-D lighting environments. In: Proceedings of the 2nd IEEE International Workshop on Information Forensic Security (WIFS, WA, USA, p 2010Google Scholar
  11. 11.
    Kee E, O’Brien J, Farid H (2013) Exposing photo manipulation with inconsistent shadows. ACM Trans Graph 32(4):28:1–12Google Scholar
  12. 12.
    Kee E, O’Brien J, Farid H (2014) Exposing photo manipulation from shading and shadows. ACM Trans Graph 33(5):165:1–21CrossRefGoogle Scholar
  13. 13.
    Ostrovsky Y, Cavanagh P, Sinha P (2005) Perceiving illumination inconsistencies in scenes. Perception 34(11):1301–1314CrossRefGoogle Scholar
  14. 14.
    Peng B, Wang W, Dong J, Tan T (2015) Improved 3D lighting environment estimation for image forgery detection. In: Proceedings of the 7th IEEE International Workshop on Information Forensics and Security (WIFS, Rome, Italy, p 2015Google Scholar
  15. 15.
    Redi J, Taktak W, Dugelay JL (2011) Digital image forensics: a booklet for beginners. Multimed Tools Appl 51(1):133–162CrossRefGoogle Scholar
  16. 16.
    Riess C, Angelopoulou E (2010) Scene illumination as an indicator of image manipulation. In: Proceedings of the 12th International Conference on Information Hiding (IH 2010), vol. Lecture Notes in Computer Science 6387, AB, Canada, pp 66–80Google Scholar
  17. 17.
    Riess C, Pfaller S, Angelopoulou E (2015) Reflectance normalization in illumination-based image manipulation detection. In: International Workshop on Recent Advances in Digital Security: Biometrics and Forensics, pp 3–10Google Scholar
  18. 18.
    Shen L, Yeo C (2011) Intrinsic images decomposition using a local and global sparse representation of reflectance. In: Proceedings of the 24th IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2011), CO, USA, pp 697–704Google Scholar
  19. 19.
    Zhang W, Cao X, Qu Y, Hou Y, Zhang C (2010) Detecting and extracting the photo composites using planar homography and graph cut. IEEE Trans Inf Forensic Secur 5(3):544–555CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Christian Riess
    • 1
  • Mathias Unberath
    • 1
  • Farzad Naderi
    • 1
  • Sven Pfaller
    • 1
  • Marc Stamminger
    • 2
  • Elli Angelopoulou
    • 1
  1. 1.Pattern Recognition LabFriedrich-Alexander University Erlangen-NurembergErlangenGermany
  2. 2.Computer Graphics LabErlangenGermany

Personalised recommendations