Abstract
Recent advancements in deep learning have enabled significant progress in image noise type classification and denoising systems. Researchers working on deep learning-based image multi-type denoising either use a single-stage or a two-stage denoising approach. The single-stage approach proposes designing a single denoising autoencoder (DAE), whereas the two-stage approach first classifies the noise type, followed by applying a noise-specific filter. The problem with the single-stage approach is that a generalized DAE fails to be effective. Two-stage approaches work on a limited number of noise types, as researchers typically address only two or three noise types. This paper proposes a framework for two-stage multi-type image denoising that provides classification and denoising of four types of noise with a per-class classification accuracy of 98.2–100% and a denoising technique that obtained promising PSNR and SSIM values for various types of noise, ensuring effective image restoration. The proposed methodology can be applied to any field that requires image denoising without prior knowledge of the type of noise.
Similar content being viewed by others
Data Availability
Data available in Github repository.
References
Yuan, Y.; Shen, Q.; Wang, S.; Ren, J.; Yang, D.; Yang, Q.; Fan, J.; Mu, X.: Coronavirus mask protection algorithm: a new bio-inspired optimization algorithm and its applications. J. Bionic Eng. 20(4), 1747–1765 (2023). https://doi.org/10.1007/s42235-023-00359-5
Yuan, Y.; Yang, Q.; Ren, J.; Fan, J.; Shen, Q.; Wang, X.; Zhao, Y.: Learning-imitation strategy-assisted alpine skiing optimization for the boom of offshore drilling platform. Ocean Eng. 278, 114317 (2023). https://doi.org/10.1016/j.oceaneng.2023.114317
Yuan, Y.; Ren, J.; Wang, S.; Wang, Z.; Mu, X.; Zhao, W.: Alpine skiing optimization: a new bio-inspired optimization algorithm. Adv. Eng. Softw. 170, 103158 (2022). https://doi.org/10.1016/j.advengsoft.2022.103158
Yuan, Y.; Mu, X.; Shao, X.; Ren, J.; Zhao, Y.; Wang, Z.: Optimization of an auto drum fashioned brake using the elite opposition-based learning and chaotic k-best gravitational search strategy based grey wolf optimizer algorithm. Appl. Soft Comput. 123, 108947 (2022). https://doi.org/10.1016/j.asoc.2022.108947
Russo, F.: Edge detection in noisy images using fuzzy reasoning. IEEE Trans. Instrum. Meas. 47(5), 1102–1105 (1998)
Khan, S.; Lee, D.H.; Khan, M.A., Gilal, A.R.; Iqbal, J.; Waqas, A.: Efficient and improved edge detection via a hysteresis thresholding method. Curr. Sci. (2020)
Bustince, H.; Barrenechea, E.; Pagola, M.; Fernandez, J.: Interval-valued fuzzy sets constructed from matrices: application to edge detection. Fuzzy Sets Syst. 160(13), 1819–1840 (2009)
Thaha, M.M.; Kumar, K.P.M.; Murugan, B.S.; Dhanasekeran, S.; Vijayakarthick, P.; Selvi, A.S.: Brain tumor segmentation using convolutional neural networks in MRI images. J. Med. Syst. 43, 1–10 (2019)
Qiao, Y.; Truman, M.; Sukkarieh, S.: Cattle segmentation and contour extraction based on mask R-CNN for precision livestock farming. Comput. Electron. Agric. 165, 104958 (2019)
Sobbahi, R.A.; Tekli, J.: Comparing deep learning models for low-light natural scene image enhancement and their impact on object detection and classification: overview, empirical evaluation, and challenges. Signal Process. Image Commun. 109 (2022)
Jasti, V.D.P.; Zamani, A.S.; Arumugam, K.; Naved, M.; Pallathadka, H.; Raghuvanshi, A.; Kaliyapremal, K.: Computational technique based on machine learning and image processing for medical image analysis of breast cancer diagnosis. Secur. Commun. Netw. 2022 (2022)
Abdou, M.A.: Literature review: efficient deep neural networks techniques for medical image analysis. Neural Comput. Appl. 34, 5791–5812 (2022)
Xie, J.; Xu, L.; Chen, E.: Image denoising and inpainting with deep neural networks (2012)
Eng, H.-L.; Ma, K.-Y.K.: Noise adaptive soft-switching median filter. IEEE Trans. Image Process. 10, 242–251 (2001)
Wang, T.; Qiu, J.; Fu, S.; Ji, W.: Distributed fuzzy h filtering for nonlinear multirate networked double-layer industrial processes. IEEE Trans. Ind. Electron. 64, 5203–5211 (2017)
Civicioglu, P.: Using uncorrupted neighborhoods of the pixels for impulsive noise suppression with ANFIS. IEEE Trans. Image Process. 16, 759–773 (2007)
Yin, H.; Gong, Y.; Qiu, G.: Side window filtering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8758–8766 (2019)
El Helou, M.; Süsstrunk, S.: Blind universal Bayesian image denoising with gaussian noise level learning. IEEE Trans. Image Process. 29, 4885–4897 (2020)
Mahdaoui, A.E.; Ouahabi, A.; Moulay, M.-S.: Image denoising using a compressive sensing approach based on regularization constraints. Sensors 22(6), 2199 (2022)
Thanh, D.N.H.; Enginoglu, S.: An iterative mean filter for image denoising. IEEE Access 7, 167847–167859 (2019)
Yamashita, R.; Nishio, M.; Do, R.K.; Togashi, K.: Convolutional neural networks: an overview and application in radiology. Insights Imaging 9(4), 611–629 (2018)
Perrotta, C.; Selwyn, N.: Deep learning goes to school: toward a relational understanding of AI in education. Learn. Media Technol. 45(3), 251–269 (2020)
Anand, R.; Shanthi, T.; Sabeenian, R.S.; Veni, S.: Real time noisy dataset implementation of optical character identification using CNN. Int. J. Intell. Enterp. 7(1–3), 67–80 (2020)
Momeny, M.; Latif, A.; Agha Sarram, M.; Sheikhpour, R.; Zhang, Y.: A noise robust convolutional neural network for image classification. Results Eng. 5, 100072 (2019)
Mansour, R.F.; Alfar, N.M.; Abdel-Khalek, S.; Abdelhaq, M.; Saeed, R.A.; Alsaqour, R.: Optimal deep learning based fusion model for biomedical image classification. Expert Syst. 39(3), 12764 (2021)
Ajay, P.; Goyal, L.M.; Vashistha, S.; Kumar, V.; Kumar, A.: Unsupervised hyperspectral microscopic image segmentation using deep embedded clustering algorithm. Scanning 2022 (2022)
Koziarski, M.; Cyganek, B.: Image recognition with deep neural networks in presence of noise-dealing with and taking advantage of distortions. Integr. VLSI J. 24(4), 337–349 (2017)
Liu, F.; Song, Q.; Jin, G.: The classification and denoising of image noise based on deep neural networks. Appl. Intell. 50(7), 2194–2207 (2020)
Tripathi, M.: Facial image noise classification and denoising using neural network. Sustain. Eng. Innov. 3(2), 25 (2021). https://doi.org/10.37868/sei.v3i2.id142
Chuah, J.H.; Khaw, H.Y.; Soon, F.C.; Chow, C.O.: Detection of gaussian noise and its level using deep convolutional neural network. In: IEEE Region 10 Annual International Conference Proceedings/TENCON, vol. 2017-Decem, pp. 2447–2450. IEEE (2017)
Roy, S.; Ahmed, M.; Akhand, M.: Noisy image classification using hybrid deep learning methods. J. Inf. Commun. Technol. (2018)
Ahmed, W.: Deep Learning-based Noise Type Classification and Removal for Drone Image Restoration—GitHub Repository. https://github.com/waqar-ahmed51/Deep-Learning-based-Noise-Type-Classification-and-Removal-for-Drone-Image-Restoration (2023)
Funding
This research work was funded by Institutional Fund Projects under Grant No. (IFPIP:169-611-1443). The authors gratefully acknowledge the technical and financial support by the Ministry of Education and King Abdulaziz University, DSR, Jeddah, Saudi Arabia.
Author information
Authors and Affiliations
Contributions
Conceptualization and methodology, SK and WA; experiments, WA and SK; validation, WA and AN; writing-review and editing, WA, SK, and GM; project administration and funding acquisition, AN. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ahmed, W., Khan, S., Noor, A. et al. Deep Learning-Based Noise Type Classification and Removal for Drone Image Restoration. Arab J Sci Eng 49, 4287–4306 (2024). https://doi.org/10.1007/s13369-023-08376-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-023-08376-6