Skip to main content
Log in

A robust video zero-watermarking based on deep convolutional neural network and self-organizing map in polar complex exponential transform domain

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a robust video zero-watermarking scheme for copyright protection using a combination of convolutional neural network (CNN) and self-organizing map (SOM) in polar complex exponential transform (PCET) space is presented. The scheme is developed not only to remedy the existing problems of lacking in some performance assessments but also to enhance the robustness. It starts with extracting the content feature of each frame by CNN and then some significant frames are selected using SOM clustering and maximum entropy. Secondly, the PCET is applied to all selected frames to abstract invariant moments, and further, is scrambled by a chaotic logistic map and is reduced in dimensions by singular value decomposition (SVD). Next, a binary sequence is generated by comparing adjacent values of the obtained compact PCET moments in the previous step, and further is permuted to produce a binary matrix. Finally, a bitwise exclusive-OR operation is imposed on the binary matrix and the encrypted watermark by the chaotic map to generate a zero-watermark signal. Experimental results demonstrate that the proposed scheme has adequate equalization and distinguishability of zero-watermarks as well as strong robustness against common signal processing, geometric, compression, and inter-frame attacks. Also, compared with existing video zero-watermarking and traditional video watermarking methods, the proposed scheme exhibits superior robustness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Asikuzzaman M, Pickering MR (2018) An overview of digital video watermarking. IEEE Trans Circ Syst Video Technol 28(9):2131–2153

    Article  Google Scholar 

  2. Cao Z, Wang L (2019) A secure video watermarking technique based on hyperchaotic Lorentz system. Multimed Tools Appl 78(18):26089–26109

    Article  Google Scholar 

  3. Chen L, Zhao J (2017) Contourlet-based image and video watermarking robust to geometric attacks and compressions. Multimed Tools Appl 77(6):7187–7204

    Article  Google Scholar 

  4. Gao Z, Wang X, Sun S, Wu D, Bai J, Yin Y, Liu X, Zhang H, Victor H (2020) Learning physical properties in complex visual scenes: an intelligent machine for perceiving blood flow dynamics from static CT angiography imaging. Neural Netw 123:82–93

    Article  Google Scholar 

  5. Golea NE-H, Melkemi KE (2019) ROI-based fragile watermarking for medical image tamper detection. Int J High Perform Comput Netw 13(2):199–210

    Article  Google Scholar 

  6. Joshi AM, Gupta S, Girdhar M, Agarwal P, Sarker R (2017) Combined DWT–DCT-based video watermarking algorithm using Arnold transform technique. In: Proceedings of the international conference on data engineering and communication technology. Springer, Singapore, pp 455–463

    Chapter  Google Scholar 

  7. Kang X, Lin G, Chen Y, Zhao F, Zhang E, Jing C (2020) Robust and secure zero-watermarking algorithm for color images based on majority voting pattern and hyper-chaotic encryption. Multimed Tools Appl 79(1–2):1169–1202

    Article  Google Scholar 

  8. Kohonen T (2001) Self-Organizating maps, 3rd extended Ed. Springer-Verlag, New York

    Book  Google Scholar 

  9. Li L, Li S, Abraham A, Pan JS (2012) Geometrically invariant image watermarking using polar harmonic transforms. Inf Sci 199:1–19

    Article  MathSciNet  Google Scholar 

  10. Li D, Qiao L, Kim J (2015) A video zero-watermarking algorithm based on LPM. Multimed Tools Appl 75(21):13093–13106

    Article  Google Scholar 

  11. Li J, Yu C, Gupta BB, Ren X (2018) Color image watermarking scheme based on quaternion Hadamard transform and Schur decomposition. Multim Tools Appl 77(4):4545-4561

    Article  Google Scholar 

  12. Li D, Yang S, Zuo Y, Zheng Z, Cui L (2018) Animation Zero Watermarking Algorithm Based on Edge Feature. MUE/FutureTech 2018:565-571

  13. Li D, Deng L, Gupta BB, Wang H, Choi C (2019) A novel CNN based security guaranteed image watermarking generation scenario for smart city applications. Inf Sci 479:432–447

    Article  Google Scholar 

  14. Li Y, Hu H, Zhu Z, Zhou G (2020) SCANet: sensor-based continuous authentication with two-stream convolutional neural networks. ACM Trans Sensor Netw 16(3):1–26. https://doi.org/10.1145/3397179

    Article  Google Scholar 

  15. Liu X, Zhu Y, Sun Z, Diao M, Zhang L (2014) A novel robust video fingerprinting-watermarking hybrid scheme based on visual secret sharing. Multimed Tools Appl 74(21):9157–9174

    Article  Google Scholar 

  16. Liu X, Zhao R, Li F, Liao S, Ding Y, Zou B (2017) Novel robust zero-watermarking scheme for digital rights management of 3D videos. Signal Process Image Commun 54:140–151

    Article  Google Scholar 

  17. Quan W, Sun T, Wang S (2003) Concept and application of zero-watermark. Acta Electron Sin 31(2):214–216

    Google Scholar 

  18. Qu Z, He H, Liu W, Ma S (2019) A self-adaptive quantum steganography algorithm based on QLSb modification in watermarked quantum image. Int J High Perform Comput Netw 14(2):121–129

  19. Raghu S, Natarajan S, Yasin T, Shyam VR, Pieter LK (2020) EEG based multi-class seizure type classification using convolutional neural network and transfer learning. Neural Netw 124:202–212

    Article  Google Scholar 

  20. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  21. Shadi A, Mehdi G, Gian L, Christian M (2020) Adaptive neural tree exploiting expert nodes to classify high-dimensional data. Neural Netw 124:20–38

    Article  Google Scholar 

  22. Shukla D, Sharma M (2018) A novel scene-based video watermarking scheme for copyright protection. J Intell Syst 27(1):47–66

    Article  Google Scholar 

  23. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Computer science arXiv:1409.1556v1

  24. Singh KM (2018) A robust rotation resilient video watermarking scheme based on the SIFT. Multimed Tools Appl 77(13):16419–16444

    Article  Google Scholar 

  25. Strogatz SH (2015) Nonlinear dynamics and Chaos: with applications to physics, Second edn. CRC Press

  26. Video trace library. YUV 4:2:0 video sequences [Online]. Available: http://trace.eas.asu.edu/yuv/index.html

  27. Wang C, Wang X, Xia Z, Zhang C, Chen X (2016) Geometrically resilient color image zero-watermarking algorithm based on quaternion exponent moments. J Vis Commun Image Represent 41:247–259

    Article  Google Scholar 

  28. Wang Y-G, Xie D, Gupta BB (2018) A study on the collusion security of LUT-based client-side watermark embedding. IEEE Access 6:15816–15822

    Article  Google Scholar 

  29. Wang C, Wang X, Xia Z, Zhang C (2019) Ternary radial harmonic Fourier moments based robust stereo image zero-watermarking algorithm. Inf Sci 470:109-120

    Article  Google Scholar 

  30. Xu G, Wang R (2009) A video zero-watermark algorithm against RST attacks. In: 2009 Asia-Pacific conference on information processing. Pp 15-18

  31. Yang H, Qi S, Niu P, Wang X (2020) Color image zero-watermarking based on fast quaternion generic polar complex exponential transform. Signal Process Image Commun 82:115747

    Article  Google Scholar 

  32. Yap PT, Jiang X, Kot AC (2010) Two-dimensional polar harmonic transforms for invariant image representation. IEEE Trans Pattern Anal Mach Intell 32(7):1259–1270

    Article  Google Scholar 

  33. Yu X, Wang C, Zhou X (2019) A hybrid transforms-based robust video zero-watermarking algorithm for resisting high efficiency video coding compression. IEEE Access 7:115708–115724

    Article  Google Scholar 

  34. Zhang H, Li J, Dong C (2012) Multiple video Zero-Watermarking based on 3D DFT to resist geometric attacks. In: 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet). pp 1141–1144

  35. Zhang E, Zhang Y, Duan J (2019) Color inverse Halftoning method with the correlation of multi-color components based on extreme learning machine. Appl Sci 9(5):841

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Key R&D Program of China (Grant No. 2018YFD0700400), National Natural Science Foundation of China (Grant No. 61671374), the Key Research and Development Program of Shaanxi Province (Grant No. 2019GY-080), and the Scientific Research Program Funded by Shaanxi Provincial Education Department (Program Nos. 15JK1504 & 20JY053).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaobing Kang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, Y., Kang, X. & Chen, Y. A robust video zero-watermarking based on deep convolutional neural network and self-organizing map in polar complex exponential transform domain. Multimed Tools Appl 80, 6019–6039 (2021). https://doi.org/10.1007/s11042-020-09904-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09904-4

Keywords

Navigation