Abstract
We propose a GAN for image deblurring based on latent image extraction and blur kernel estimation, with which the single image deblurring assignment is successfully completed. We introduce the FFT to the image of the latent image extraction because the FFT can convert image transformation from spatial to frequency domain; this is a good solution for the convolutional neural network for partial frequency domain knowledge learning and gives a sharper picture; We also apply the cross-scale reproducibility of natural images to the extraction of blur kernel. By adding regularization constraints to the kernel to enhance estimation precision, the estimated kernel of the image is generated via fusing of local kernels after numerous iterations. Meanwhile, a multi-scale discriminator structure combining RSGAN and PatchGAN is used. RSGAN is applied as a global discriminator with more accurate classification criteria, while PatchGAN is applied as a local discriminator to determine the accuracy of local blur kernel. The experiment proves that our work is effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kupyn, O., Martyniuk, T., Wu, J., Wang, Z.: Deblurgan-v2: Deblurring (Orders-of-Magnitude) Faster and Better. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8878–8887 (2019)
Yadav, S., Chen, C., Ross, A.: Synthesizing Iris Images Using RaSGAN with application in presentation attack detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (2019)
Pan, Y., Pi, D., Chen, J., Meng, H.: FDPPGAN: remote sensing image fusion based on deep perceptual patchGAN. Neural Comput. Appl. 33, 9589–9605 (2021)
Bell-Kligler, S., Shocher, A., Irani, M.: Blind Super-Resolution Kernel Estimation Using an Internal-GAN. Advances in Neural Information Processing Syst. 32 (2019)
Kavyashree, P.S., El-Sharkawy, M.: Compressed Mobilenet v3: A Light Weight Variant for Resource-Constrained Platforms. In: 2021 IEEE 11th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0104–0107. IEEE (2021)
Mao, X., Liu, Y., Shen, W., Li, Q., Wang, Y.: Deep Residual Fourier Transformation for Single Image Deblurring. arXiv preprint arXiv:2111.11745 (2021)
Nah, S., Hyun Kim, T., Mu Lee, K.: Deep Multi-Scale Convolutional Neural Network for Dynamic Scene Deblurring. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3883–3891 (2017)
Tao, X., Gao, H., Shen, X., Wang, J., Jia, J.: Scale-Recurrent Network for Deep image Deblurring. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8174–8182 (2018)
Ren, D., Zhang, K., Wang, Q., Hu, Q., Zuo, W.: Neural Blind Deconvolution Using Deep Priors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3341–3350 (2020)
Kaufman, A., Fattal, R.: Deblurring Using analysis-synthesis networks Pair. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5811–5820 (2020)
Rozumnyi, D., Oswald, M.R., Ferrari, V., Matas, J., Pollefeys, M.: Defmo: Deblurring and Shape Recovery of Fast Moving Objects. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3456–3465 (2021)
Nimisha, T.M., Sunil, K., Rajagopalan, A.N.: Unsupervised class-specific deblurring. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 353-369 (2018)
Zhang, K., et al.: Deblurring by realistic blurring. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2737–2746 (2020)
Karnewar, A., Wang, O.: :Msg-gan: multi-scale gradients for generative adversarial networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7799–7808 (2020)
Xu, L., Ren, J.S., Liu, C., Jia, J.: Deep convolutional neural network for image deconvolution. Advances in Neural Information Processing Syst. 27 (2014)
Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., Bharath, A.A.: Generative adversarial networks: an overview. IEEE Signal Process. Mag. 35(1), 53–65 (2018)
Gajera, B., Kapil, S.R., Ziaei, D., Mangalagiri, J., Siegel, E., Chapman, D.: CT-scan denoising using a charbonnier loss generative adversarial network. IEEE Access 9, 84093–84109 (2021)
Shocher, A., Cohen, N., Irani, M.: “Zero-Shot” super-resolution using deep internal learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3118–3126 (2018)
Cho, S.J., Ji, S.W., Hong, J.P., Jung, S.W., Ko, S.J.: Rethinking coarse-to-fine approach in single image deblurring. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4641–4650 (2021)
Chen, L., Lu, X., Zhang, J., Chu, X., Chen, C.: Hinet: half instance normalization network for image restoration. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 182–192 (2021)
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.C.: Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510–4520 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, X., Qian, P. (2023). GAN for Blind Image Deblurring Based on Latent Image Extraction and Blur Kernel Estimation. In: Huang, DS., Premaratne, P., Jin, B., Qu, B., Jo, KH., Hussain, A. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2023. Lecture Notes in Computer Science(), vol 14090. Springer, Singapore. https://doi.org/10.1007/978-981-99-4761-4_66
Download citation
DOI: https://doi.org/10.1007/978-981-99-4761-4_66
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-4760-7
Online ISBN: 978-981-99-4761-4
eBook Packages: Computer ScienceComputer Science (R0)