Abstract
The visual quality of an outdoor scenario during the winter season is mainly affected by haze or fog. The visibility is lacking even if the optical sensor system’s lens was adjusted, for example, automatic driver assistance, remote sensing, and video surveillance. Removing such haziness effects from a single image has created a tricky situation due to the cloudy and murky atmosphere. This paper, proposes a new methodology that helps remove the haziness and gives a clear vision in terms of both color and texture information. To dehaze an image, introducing a multi-scale image-fusion on a single hazy image by extracting different scale images from a single scenario. Multi-scale image fusion supports solving hazing problems using significant features at multiple scales. The two derived images of an original degraded image are the white balanced portion and the luminance parameter-based image. The straightforward image fusion on the derived images with their corresponding weight maps prompts unwanted enhancement in the results. To eliminate such effects, pyramid decomposition is applied on weight maps and the input images which helps to enhance the contrast and also sharpens the hazy image. The proposed method effectively produces the dehazed image from a single hazy image. The experimental results reveal that the proposed algorithm is performing well in generating a better visible image efficiently. The proposed method has achieved better performance metrics such as peak signal-to-noise ratio (PSNR) and average gradient ratio (AGR) which are improved by 8.55 and 31.13% respectively compared to an average of other state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data and materials
The datasets analyzed during the current study are available in the HazySky repository, https://pan.baidu.com/s/1c8uufSfo2pTItHzjwWbNmQ.
Code availability
The code would be made publicly available after we get positive response.
Notes
Available at https://pan.baidu.com/s/1c8uufSfo2pTItHzjwWbNmQ, last accessed on March 01, 2021.
References
(1987) The Laplacian pyramid as a compact image code. In: Fischler MA, Firschein O (eds) Readings in computer vision. Morgan Kaufmann, San Francisco, pp 671–679. https://doi.org/10.1016/B978-0-08-051581-6.50065-9 (ISBN 978-0-08-051581-6)
Ancuti CO, Ancuti C (2013) Single image dehazing by multi-scale fusion. IEEE Trans Image Process 220(8):3271–3282. https://doi.org/10.1109/TIP.2013.2262284
Berman D, Treibitz T, Avidan S (2016) Non-local image dehazing. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR)
Burt PJ, Adelson EH (1985) Merging images through pattern decomposition. In: Tescher AG (ed) Applications of digital image processing VIII, vol 0575. International Society for Optics and Photonics, SPIE, pp 173–181. https://doi.org/10.1117/12.966501
Burt PJ, Kolczynski RJ (1993) Enhanced image capture through fusion. In: 1993 (4th) international conference on computer vision, pp 173–182. https://doi.org/10.1109/ICCV.1993.378222
Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24(11):3888–3901. https://doi.org/10.1109/TIP.2015.2456502
Farid H (2001) Blind inverse gamma correction. IEEE Trans Image Process 100(10):1428–33. https://doi.org/10.1109/83.951529
Fattal R (2015) Single image dehazing. In: ACM transactions on graphics (TOG)-proceedings of ACM SIGGRAPH 2008, vol 27, pp 1–9. https://doi.org/10.1145/1399504.1360671
Ganguly B, Bhattacharya A, Srivastava A, Dey D, Munshi S (2022) Single image haze removal with haze map optimization for various haze concentrations. IEEE Trans Circuits Syst Video Technol 32(1):286–301. https://doi.org/10.1109/TCSVT.2021.3059573
Gautam S, Gandhi TK, Panigrahi BK (2020) An improved air-light estimation scheme for single haze images using color constancy prior. IEEE Signal Process Lett 27:1695–1699. https://doi.org/10.1109/LSP.2020.3025462
He K, Sun J, Tang X (2009) Single image haze removal using dark channel prior. In: 2009 IEEE conference on computer vision and pattern recognition, pp 1956–1963. https://doi.org/10.1109/CVPR.2009.5206515
He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409. https://doi.org/10.1109/TPAMI.2012.213
Israël H, Kasten F (1959) KOSCHMIEDERs Theorie der horizontalen Sichtweite VS Verlag für Sozialwissenschaften, Wiesbaden, pp 7–10. https://doi.org/10.1007/978-3-663-04661-5_2 (ISBN 978-3-663-04661-5)
Kekre HB, Mishra D, Saboo R (2013) Review on image fusion techniques and performance evaluation parameters. Int J Eng Sci Technol 5(4):880–889
Li Yi LJ, Wen X-M (2001) A new fusion algorithm metallographic image. J Sichuan Univ 390(2):248–251
Liu Z, Tsukada K, Hanasaki K, Ho YK, Dai YP (2001) Image fusion by using steerable pyramid. Pattern Recognit Lett 22(9):929–939. https://doi.org/10.1016/S0167-8655(01)00047-2 (ISSN 0167-8655)
Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: 2013 IEEE international conference on computer vision, pp 617–624. https://doi.org/10.1109/ICCV.2013.82
Mertens T, Kautz J, Van Reeth F (2009) Exposure fusion: a simple and practical alternative to high dynamic range photography. Comput Graph Forum 28(1):161–171. https://doi.org/10.1111/j.1467-8659.2008.01171.x
Mohamed MA, El-Den BM (2011) Implementation of image fusion techniques for multi-focus images using FPGA. In: 2011 28th national radio science conference (NRSC), pp 1–11. https://doi.org/10.1109/NRSC.2011.5873618
Petrovic VS, Xydeas CS (2004) Gradient-based multiresolution image fusion. IEEE Trans Image Process 130(2):228–237. https://doi.org/10.1109/TIP.2004.823821
Pu T, Ni GG (2000) Contrast-based image fusion using the discrete wavelet transform. Opt Eng 39(2075–2082):08. https://doi.org/10.1117/1.1303728
Qi M, Hao Q, Guan Q, Kong J, Zhang Y (2015) Image dehazing based on structure preserving. Optik 126(22):3400–3406. https://doi.org/10.1016/j.ijleo.2015.07.114 (ISSN 0030-4026)
Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-Net: Feature fusion attention network for single image dehazing. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 11908–11915
Ren W, Liu S, Zhang H, Pan J, Cao X, Yang M-H (2016) Single image dehazing via multi-scale convolutional neural networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision—ECCV 2016, pp 154–169. Springer International Publishing, Cham
Song Y, Li J, Wang X, Chen X (2018a) Single image dehazing using ranking convolutional neural network. IEEE Trans Multimed 20(6):1548–1560. https://doi.org/10.1109/TMM.2017.2771472
Song Y, Luo H, Ma J, Hui B, Chang Z (2018b) Sky detection in hazy image. Sensors. https://doi.org/10.3390/s18041060
Tan Robby T (2008) Visibility in bad weather from a single image. In: 2008 IEEE conference on computer vision and pattern recognition, pp 1–8. https://doi.org/10.1109/CVPR.2008.4587643
Wang Y, Fu F, Lai F, Xu W, Shi J, Wang J (2019) Haze removal algorithm based on single-images with chromatic properties. Signal Process Image Commun 72:80–91. https://doi.org/10.1016/j.image.2018.12.010 (ISSN 0923-5965)
Wen Y-Q, Luo Y-N, Yi L (2000) The image fusion method based on wavelet transform in auto-analysis of PASHM. J Sichuan Univ (Nat Sci Ed) 37(6):248–251
Yin J-L, Huang Y-C, Chen B-H, Ye S-Z (2020) Color transferred convolutional neural networks for image dehazing. IEEE Trans Circuits Syst Video Technol 30(11):3957–3967. https://doi.org/10.1109/TCSVT.2019.2917315
Zhan Y, Zhang R, Wu Q, Wu Y (2016) A new haze image database with detailed air quality information and a novel no-reference image quality assessment method for haze images. In: 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1095–1099. https://doi.org/10.1109/ICASSP.2016.7471845
Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24(11):3522–3533. https://doi.org/10.1109/TIP.2015.2446191
Funding
This work was supported by the Science and Engineering Research Board (SERB), Department of Science and Technology, Government of INDIA under the Grant number SRG/2020/000617.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All the authors declare that they have no conflict of interest or competing interests
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bhavani, M.D.L., Murugan, R. & Goel, T. An efficient dehazing method of single image using multi-scale fusion technique. J Ambient Intell Human Comput 14, 9059–9071 (2023). https://doi.org/10.1007/s12652-022-04411-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-022-04411-w