Abstract
Given that the traditional image restoration algorithm cannot generate high-quality false images and the restoration accuracy for the large-area damaged images is low, this study proposed the restoration algorithm of large-area damaged images based on the generative adversarial network. First of all, this study extracted multi-scale edge detailed information in image damage area through building the smooth function. Secondly, this study built the generative adversarial network model by using the multi-scale edge detailed information as the original information of large-area damaged images and then trained the model to generate the best false images through the continuous game between the generator and discriminator. Finally, this study obtained the existing information of the false images by combining the contextual information and the perceptual information, calculated the priority of information and restored the information according to the optimal sequencing results and continuously updated the damaged edge information until the large-area damaged image restoration is completed. The results show that the accuracy of extracting the detailed information with the proposed algorithm is high, and peak signal-to-noise ratio of the false images generated by the generative adversarial network model is high, the structural similarity index with the real image is not less than 0.93, the quality of the false images is high, the accuracy rate of priority calculation of the restoration information is high, and the restoration accuracy for large-area damaged images is far ahead of other algorithms.
Similar content being viewed by others
References
Alfaro-Almagro F, Jenkinson M, Bangerter NK et al (2018) Image processing and quality control for the first 10,000 brain imaging datasets from UK Biobank. Neuroimage 166:400–424
Lee CW, Tsai WH (2011) A secret-sharing-based method for authentication of grayscale document images via the use of the PNG image with a data repair capability. IEEE Trans Image Process 21(1):207–218
Xie Z, Ma H, Bo Q et al (2016) Wavefront sensing and image restoration with spatially overlapping diversity technology. IEEE Photon Technol Lett 28(17):1882–1885
Zeng W, Chen G, Ju R et al (2018) The combined application of database and three-dimensional image registration technology in the restoration of total nose defect. J Craniofac Surg 29(5):1–6
Chen SH (2016) Inspecting lens collars for defects using discrete cosine transformation based on an image restoration scheme. IET Image Proc 10(6):474–482
Yu J, Li J, Yu Z, Huang Q (2019) Multimodal transformer with multi-view visual representation for image captioning. IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/tcsvt.2019.2947482
Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/.2019.2932058
Yujie L, Changhong D, Qilu Z et al (2017) Hand drawn image retrieval based on condition generated adversary network. J Comput Aided Des Graph 29(12):186–192
Siquan Y, Zhi H, Yandong T et al (2018) Texture synthesis method based on confrontation generation network. Infrared Laser Eng 5(2):43–48
Jiwei T, Jinsong W, Kai S (2019) POI location algorithm based on PU and generative network. Comput Res Dev 9:1843–1850
Qinglin Z, Jiachen D, Ruifeng X (2019) Research on irony recognition based on confrontation learning. J Peking Univ (Nat Sci Ed) 55(1):29–36
Kehui S, Ying Z, Jiangwei Z et al (2019) Structured data table generation model based on generative adversary network. Comput Res Dev 56(9):1832–1842
Mattei F, Franceschini S, Scardi M (2018) A depth-resolved artificial neural network model of marine phytoplankton primary production. Ecol Model 382:51–62
Yu L, Houquan L (2019) Facial image restoration based on confrontation training and convolution neural network. Comput Eng Appl 55(2):110–115
Kai H, Junqiao G, Wenxia L (2017) Image restoration algorithm based on improved confidence function and matching criteria. J Tianjin Univ (Nat Sci Eng Technol Ed) 50(4):399–404
Chaohui L, Yinghua S, Jinghua L (2016) Kinect based depth image inpainting method. J Jilin Univ (Eng Ed) 46(5):1697–1703
Chenchao D, Hongyuan W, Tongguang N, Shoubing C (2019) Pedestrian recognition based on deep convolution generation of confrontation network and expanding nearest neighbor reordering. Comput Res Dev 56(8):1632–1641
Bo W, Bo H, Kai C et al (2016) Improving spatiotemporal reflectance fusion using image inpainting and steering kernel regression techniques. Int J Remote Sens 38(3):706–727
Li S, Yang X (2017) Novel image inpainting algorithm based on adaptive fourth-order partial differential equation. IET Image Proc 11(10):870–879
Yang X, Guo B (2017) Fractional-order tensor regularisation for image inpainting. IET Image Proc 11(9):734–745
Sanders T, Dwyer C (2017) Subsampling and inpainting approaches for electron tomography. Ultramicroscopy 182:292–302
Jun Y, Zhu C, Zhang J et al (2020) Spatial pyramid-enhanced NetVLAD with and weighted triplet loss for place recognition. IEEE Trans Neural Netw Learn Syst 31(2):661–674
Jeong J, Lee JY, Son Y (2018) A study of partial image classification of vehicles using finger gestures. Int J Grid Distrib Comput 11(2):111–122
Xianbin O, Liping S, Zhifang L (2017) Unequal backup and dual authentication self-healing limited domain image sharing. J Softw 28(12):3306–3346
Wang X, Fang S, Zhu X (2017) Weighted least-squares phase unwrapping algorithm based on a non-interfering image of an object. Appl Opt 56(15):45–53
Selmani A, Seddik H (2018) Anisotropic smart shape-adapted image smoothing without conductance function efficient for impulse noise removal. Digit Signal Proc 75:S1051200418300010
Yin Y, Xia J, Li Y et al (2019) Group-wise itinerary planning in temporary mobile social network. IEEE Access 7:83682–83693
Lim S, Cho YI (2018) Development and validation study of the korean genital image scale; focused on korean married women. Int J Multimed Ubiquitous Eng 13(2):7–12
Chaudhari N, Sharma A, Lal AM (2017) Crack detection using image processing for automobiles and aircrafts. Int J Eng Technol Automob Secur 1(1):17–28
Zhang H, Liu L, Long Y et al (2018) Unsupervised deep hashing with pseudo labels for scalable image retrieval. IEEE Trans Image Process 27(4):1626–1638
Jin Y, Guo X, Li Y et al (2020) Towards stabilizing facial landmark detection and tracking via hierarchical filtering: a new method. J Frankl Inst 357(5):3019–3037
Ding D, Ram S, Rodriguez J (2018) Perceptually aware image in painting. Pattern Recogn 83:174–184
Li JX, Zhang XK, Wang Z et al (2019) Dual-band eight-antenna array design for MIMO applications in 5G mobile terminals. IEEE Access 7(1):71636–71644
Dutta S, Manideep BCS, Basha SM et al (2018) Classification of diabetic retinopathy images by using deep learning models. Int J Grid Distrib Comput 11(1):99–106
Karchi RP, Munusamy N (2018) Exploration of unmixing and classification of hyperspectral imagery. Int J Future Gen Commun Netw 11(6):13–32
Shiwen H, Lin L, Yongqiang Z et al (2016) Image restoration method for improving TV-H model. J Harbin Univ Technol 48(2):167–172
Gao H, Xu Y, Yin Y et al (2019) Context-aware QoS prediction with neural collaborative filtering for internet-of-things services. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2019.2956827
Mushtaq S, Mir AH (2018) Image copy move forgery detection: a review. Int J Future Gen Commun Netw 11(2):11–22
Yin Y, Chen L, Xu Y et al (2020) QoS prediction for service recommendation with deep feature learning in edge computing environment. Mob Netw Appl 25:391–401
Rao KS, Satyanarayana KV, Rao PS (2018) Segmentation of images using two parameter logistic type distribution and K-means clustering. Int J Grid Distrib Comput 11(12):1–20
Acknowledgements
This work was supported by the Humanities and Social Sciences Research Planning Fund Project in Ministry of Education under Grant Number 19YJAZH053 and the Opening Project of State Key Laboratory of Digital Publishing Technology under Grant Number cndplab-2020-M003 and Ministry of Education Science and Technology Development Center Industry-University Research Innovation Fund under Grant Number 2018A01002.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest. No conflict of interest exits in the submission of this manuscript, and manuscript is approved by all authors for publication.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liu, G., Li, X. & Wei, J. Large-area damage image restoration algorithm based on generative adversarial network. Neural Comput & Applic 33, 4651–4661 (2021). https://doi.org/10.1007/s00521-020-05308-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05308-5