Advertisement

Towards Photo-Realistic Visible Watermark Removal with Conditional Generative Adversarial Networks

  • Xiang Li
  • Chan Lu
  • Danni Cheng
  • Wei-Hong Li
  • Mei Cao
  • Bo Liu
  • Jiechao MaEmail author
  • Wei-Shi Zheng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11901)

Abstract

Visible watermark plays an important role in image copyright protection and the robustness of a visible watermark to an attack is shown to be essential. To evaluate and improve the effectiveness of watermark, watermark removal attracts increasing attention and becomes a hot research top. Current methods cast the watermark removal as an image-to-image translation problem where the encode-decode architectures with pixel-wise loss are adopted to transfer the transparent watermarked pixels into unmarked pixels. However, when a number of realistic images are presented, the watermarks are more likely to be unknown and diverse (i.e., the watermarks might be opaque or semi-transparent; the category and pattern of watermarks are unknown). When applying existing methods to the real-world scenarios, they mostly can not satisfactorily reconstruct the hidden information obscured under the complex and various watermarks (i.e., the residual watermark traces remain and the reconstructed images lack reality). To address this difficulty, in this paper, we present a new watermark processing framework using the conditional generative adversarial networks (cGANs) for visible watermark removal in the real-world application. The proposed method enables the watermark removal solution to be more closed to the photo-realistic reconstruction using a patch-based discriminator conditioned on the watermarked images, which is adversarially trained to differentiate the difference between the recovered images and original watermark-free images. Extensive experimental results on a large-scale visible watermark dataset demonstrate the effectiveness of the proposed method and clearly indicate that our proposed approach can produce more photo-realistic and convincing results compared with the state-of-the-art methods.

Keywords

Visible watermark Watermark removal Conditional generative adversarial networks 

Notes

Acknowledgment

This work was supported by NSFC(U1811461). Xiang Li and Chan Lu equally contributed to this work.

References

  1. 1.
    Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRefGoogle Scholar
  2. 2.
    Cheng, D., et al.: Large-scale visible watermark detection and removal with deep convolutional networks. In: Lai, J.H., et al. (eds.) PRCV 2018. LNCS, vol. 11258, pp. 27–40. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-03338-5_3CrossRefGoogle Scholar
  3. 3.
    Dekel, T., Rubinstein, M., Liu, C., Freeman, W.T.: On the effectiveness of visible watermarks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2146–2154 (2017)Google Scholar
  4. 4.
    Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)Google Scholar
  5. 5.
    Huang, C.H., Wu, J.L.: Attacking visible watermarking schemes. IEEE Trans. Multimed. 6(1), 16–30 (2004)CrossRefGoogle Scholar
  6. 6.
    Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)Google Scholar
  7. 7.
    Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 694–711. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-46475-6_43CrossRefGoogle Scholar
  8. 8.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
  9. 9.
    Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017)Google Scholar
  10. 10.
    Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)
  11. 11.
    Pei, S.C., Zeng, Y.C.: A novel image recovery algorithm for visible watermarked images. IEEE Trans. Inf. Forensics Secur. 1(4), 543–550 (2006)CrossRefGoogle Scholar
  12. 12.
    Qin, C., He, Z., Yao, H., Cao, F., Gao, L.: Visible watermark removal scheme based on reversible data hiding and image inpainting. Sig. Proces.: Image Commun. 60, 160–172 (2018)Google Scholar
  13. 13.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-24574-4_28CrossRefGoogle Scholar
  14. 14.
    Santoyo-Garcia, H., Fragoso-Navarro, E., Reyes-Reyes, R., Sanchez-Perez, G., Nakano-Miyatake, M., Perez-Meana, H.: An automatic visible watermark detection method using total variation. In: 2017 5th International Workshop on Biometrics and Forensics (IWBF), pp. 1–5. IEEE (2017)Google Scholar
  15. 15.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  16. 16.
    Xu, C., Lu, Y., Zhou, Y.: An automatic visible watermark removal technique using image inpainting algorithms. In: 2017 4th International Conference on Systems and Informatics (ICSAI), pp. 1152–1157. IEEE (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Xiang Li
    • 1
  • Chan Lu
    • 2
  • Danni Cheng
    • 3
  • Wei-Hong Li
    • 4
  • Mei Cao
    • 1
  • Bo Liu
    • 5
  • Jiechao Ma
    • 1
    Email author
  • Wei-Shi Zheng
    • 1
  1. 1.Sun Yat-sen UniversityGuangdongChina
  2. 2.Shanghai University of Finance and EconomicsShanghaiChina
  3. 3.Shanghai Jiao Tong UniversityShanghaiChina
  4. 4.The University of EdinburghEdinburghUK
  5. 5.Zhejiang UniversityZhejiangChina

Personalised recommendations