Skip to main content
SpringerLink
Log in

Forensic analysis and detection using polycolor model binary pattern for colorized images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image recoloring is used to colorize historic grayscale images. Recoloring gives new life to grayscale images with realistic colors. Several techniques exist that can colorize grayscale images. Sometimes attackers create a realistic fake image using colorization techniques. Consequently, there is a need for some technique that can differentiate between natural color and colorized image to stop the misuse of the colorization techniques. In this paper, a Polycolor Model Binary Pattern (PMBP) is proposed to extract robust internal statistical features. Several color models such as RGB, YUV, YCbCr, and HSV are considered to fetch crucial statistical information from an image. A novel Polycolor Model Binary Pattern is formed using the effective channels of several color models. The proposed method gives promising results on non-compressed colorized images as well as on highly compressed colorized images. The efficacy of the proposed detection technique is verified on three fully automated deep learning-based colorization techniques. Three diverse image databases are used to assess the performance. Linear Discriminant Analysis classifier is utilized to classify natural color and colorized images from extracted features, whereas the inverse of the covariance matrix is calculated by using the Moore-Penrose Pseudo Inverse Matrix (MPPM).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Agarwal N, Singh AK, Singh PK (2019) Survey of robust and imperceptible watermarking. Multimed Tools Appl 78:8603–8633. https://doi.org/10.1007/s11042-018-7128-5

    Article  Google Scholar 

  2. Kumar R, Kim D-S, Jung K-H (2019) Enhanced AMBTC based data hiding method using hamming distance and pixel value differencing. J Inf Secur Appl 47:94–103. https://doi.org/10.1016/j.jisa.2019.04.007

    Article  Google Scholar 

  3. Weng S, Shi Y, Hong W, Yao Y (2019) Dynamic improved pixel value ordering reversible data hiding. Inf Sci (Ny) 489:136–154. https://doi.org/10.1016/j.ins.2019.03.032

    Article  Google Scholar 

  4. Agarwal S, Chand S (2017) Image Forgery Detection Using Markov Features in Undecimated Wavelet Transform. In Proceedings of the 2016 9th International Conference on Contemporary Computing, IC3 2016. https://doi.org/10.1109/IC3.2016.7880221

  5. Pomari T, Ruppert G, Rezende E, Rocha A, Carvalho T (2018) Image splicing detection through illumination inconsistencies and deep learning. In Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP); IEEE, pp 3788–3792. https://doi.org/10.1109/ICIP.2018.8451227

  6. Qureshi MA, Deriche M (2015) A bibliography of pixel-based blind image forgery detection techniques. Signal Process Image Commun 39:46–74. https://doi.org/10.1016/j.image.2015.08.008

    Article  Google Scholar 

  7. Cao G, Zhao Y, Ni R, Li X (2014) Contrast enhancement-based forensics in digital images. IEEE Trans Inf Forensics Secur 9:515–525. https://doi.org/10.1109/TIFS.2014.2300937

    Article  Google Scholar 

  8. Shan W, Yi Y, Huang R, Xie Y (2019) Robust contrast enhancement forensics based on convolutional neural networks. Signal Process Image Commun 71:138–146. https://doi.org/10.1016/j.image.2018.11.011

    Article  Google Scholar 

  9. Barni M, Bondi L, Bonettini N, Bestagini P, Costanzo A, Maggini M, Tondi B, Tubaro S (2017) Aligned and non-aligned double JPEG detection using convolutional neural networks. J Vis Commun Image Represent 49:153–163. https://doi.org/10.1016/j.jvcir.2017.09.003

    Article  Google Scholar 

  10. Bao B, Fu H (2019) Scribble-based colorization for creating smooth-shaded vector graphics. Comput Graph 81:73–81. https://doi.org/10.1016/j.cag.2019.04.003

    Article  Google Scholar 

  11. Arbelot B, Vergne R, Hurtut T, Thollot J (2017) Local texture-based color transfer and colorization. Comput Graph 62:15–27. https://doi.org/10.1016/j.cag.2016.12.005

    Article  Google Scholar 

  12. Fang F, Wang T, Zeng T, Zhang G (2019) A Superpixel-based Variational model for image colorization. IEEE Trans Vis Comput Graph:1–1. https://doi.org/10.1109/TVCG.2019.2908363

  13. Larsson G, Maire M, Shakhnarovich G (2016) Learning Representations for Automatic Colorization. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer Vision – ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol 9908. Springer, Cham. https://doi.org/10.1007/978-3-319-46493-0_35

  14. Zhang R, Isola P, Efros AA (2016) Colorful Image Colorization. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 9907 LNCS, 649–666, https://doi.org/10.1007/978-3-319-46487-9_40

  15. Iizuka S, Simo-Serra E, Ishikawa H (2016) Let there be color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans Graph 35:1–11. https://doi.org/10.1145/2897824.2925974

    Article  Google Scholar 

  16. Mouzon T, Pierre F, Berger MO (2019) Joint CNN and variational model for fully-automatic image colorization. In: Lellmann J, Burger M, Modersitzki J (eds) Scale Space and Variational Methods in Computer Vision. SSVM 2019. Lecture Notes in Computer Science, vol 11603. Springer, Cham. https://doi.org/10.1007/978-3-030-22368-7_42

  17. Guo Y, Cao X, Zhang W, Wang R (2018) Fake colorized image detection. IEEE Trans Inf Forensics Secur 13:1932–1944. https://doi.org/10.1109/TIFS.2018.2806926

    Article  Google Scholar 

  18. Yu Y, Zheng N, Qiao T, Xu M, Wu J (2021) Distinguishing between natural and recolored images via lateral chromatic aberration. J Vis Commun Image Represent 80:103295. https://doi.org/10.1016/j.jvcir.2021.103295

    Article  Google Scholar 

  19. Yan Y, Ren W, Cao X (2019) Recolored image detection via a deep discriminative model. IEEE Trans Inf Forensics Secur 14:5–17. https://doi.org/10.1109/TIFS.2018.2834155

    Article  Google Scholar 

  20. Zhuo L, Tan S, Zeng J, Lit B (2019) Fake colorized image detection with channel-wise convolution based deep-learning framework. In Proceedings of the 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Honolulu, HI, USA, 2018, pp 733–736. https://doi.org/10.23919/APSIPA.2018.8659761

  21. Quan W, Wang K, Yan D-M, Pellerin D, Zhang X (2019) Improving the generalization of colorized image detection with enhanced training of CNN. In Proceedings of the 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA); IEEE; vol 2019-Septe, pp 246–252. https://doi.org/10.1109/ISPA.2019.8868802

  22. Li Y, Zhang Y, Lu L, Jia Y, Liu J (2019) Using neural networks for fake colorized image detection. In: Peterson G, Shenoi S (eds) Advances in Digital Forensics XV. Digital Forensics 2019. IFIP Advances in Information and Communication Technology, vol 569. Springer, Cham. https://doi.org/10.1007/978-3-030-28752-8_11

  23. Phutke SS, Murala S (2022) Channel difference based regeneration architecture for fake colorized image detection. In: Raman B, Murala S, Chowdhury A, Dhall A, Goyal P (eds) Computer Vision and Image Processing. CVIP 2021. Communications in Computer and Information Science, vol 1568. Springer, Cham. https://doi.org/10.1007/978-3-031-11349-9_7

  24. Zhang Y, Chen N, Qi S, Xue M, Cao X (2022) Detecting recolored image by spatial correlation. arXiv Prepr. arXiv2204.10973. https://doi.org/10.48550/arXiv.2204.10973

  25. Swathi B, Jhade S, Santosh Reddy P, Gottumukkala L, Subbarayudu Y (2022) An efficient novel approach for detection of recolored image using deep learning for identifying the original images in public surveillance. In: Pandian AP, Palanisamy R, Narayanan M, Senjyu T (eds) Proceedings of Third International Conference on Intelligent Computing, Information and Control Systems. Advances in Intelligent Systems and Computing, vol 1415. Springer, Singapore. https://doi.org/10.1007/978-981-16-7330-6_21

  26. Gupta S, Roy PP, Dogra DP, Kim BG (2020) Retrieval of colour and texture images using local directional Peak Valley binary pattern. Pattern Anal Applic 23, https://doi.org/10.1007/s10044-020-00879-4

  27. Liu Y, Xu X, Li F (2018) Image feature matching based on deep learning. In Proceedings of the 2018 IEEE 4th International Conference on Computer and Communications (ICCC), IEEE, pp 1752–1756. https://doi.org/10.1109/CompComm.2018.8780936

  28. Zhang Z, Lee WS (2019) Deep graphical feature learning for the feature matching problem. In Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE, vol 2019-Octob, pp 5086–5095. https://doi.org/10.1109/ICCV.2019.00519

  29. Kim JH, Kim BG, Roy PP, Jeong DM (2019) Efficient facial expression recognition algorithm based on hierarchical deep neural network structure. IEEE Access, 7, https://doi.org/10.1109/ACCESS.2019.2907327

  30. Fridrich J, Kodovsky J (2012) Rich models for Steganalysis of digital images. IEEE Trans Inf Forensics Secur 7:868–882. https://doi.org/10.1109/TIFS.2012.2190402

    Article  Google Scholar 

  31. Mäenpää T, Pietikäinen M (2005) Texture analysis with local binary patterns. In: Chen CH, Wang PSP (eds) Handbook of Pattern Recognition and Computer Vision, 3rd edn. World Scientific, Singapore, pp 197–216. https://doi.org/10.1142/9789812775320_0011

  32. Agarwal S, Chand S (2018) Blind forensics of images using higher order local binary pattern. J Appl Secur Res 13:209–222. https://doi.org/10.1080/19361610.2017.1422367

    Article  Google Scholar 

  33. Lim T-S, Loh W-Y, Shih Y-S (2000) A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach Learn 40:203–228

    Article  Google Scholar 

  34. Gorecki T, Luczak M (2013) Linear discriminant analysis with a generalization of the Moore-Penrose pseudoinverse. Int J Appl Math Comput Sci 23:463–471. https://doi.org/10.2478/Amcs-2013-0035

    Article  MathSciNet  Google Scholar 

  35. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115:211–252. https://doi.org/10.1007/s11263-015-0816-y

    Article  MathSciNet  Google Scholar 

  36. Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In Proceedings of the Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2007.383172

Download references

Acknowledgements

This research was supported by Brain Pool program funded by the Ministry of Science and ICT through the National Research Foundation of Korea (2019H1D3A1A01101687) and Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2021R1I1A3049788).

Author information

Authors and Affiliations

  1. Amity School of Engineering & Technology, Amity University Uttar Pradesh, Noida, India

    Saurabh Agarwal

  2. Department of Software Convergence, Andong National University, Andong, Gyeongbuk, 36729, Korea

    Saurabh Agarwal & Ki-Hyun Jung

Authors
  1. Saurabh Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ki-Hyun Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ki-Hyun Jung.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Agarwal, S., Jung, KH. Forensic analysis and detection using polycolor model binary pattern for colorized images. Multimed Tools Appl 83, 41683–41702 (2024). https://doi.org/10.1007/s11042-023-16675-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16675-1

Keywords

Search

Navigation