Skip to main content
SpringerLink
Log in

Single Image Dehazing Using Hybrid Convolution Neural Network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Due to the dispersion of atmospheric particles, the quality of the image becomes inferior. The quality of the frames captured in poor weather conditions such as fog, smog, and haze declines as a result. These images are difficult to process using conventional visibility restoration algorithms. Several deep learning techniques have been proposed in order to resolve the aforementioned computer vision challenges. They are trained and tested on hazy dataset by designing and implementing a supervised learning-based convolutional neural network (CNN) or an unsupervised learning-based generative adversarial network (GAN). In this paper, a novel single image dehazing algorithm called hybrid CNN has been proposed that consists of wavelet and inverted wavelet-based multi-scale convolution neural network (WIW-MSCNN). Furthermore, the output of inverted wavelet transformed component has been processed using coarse scale network that generates an estimated transmission map; whereas, the output of the wavelet transformed component has been processed with the help of fine scale network along with the refinement of coarse transmission map. Images of various hazy datasets such as FRIDA, FRIDA2, RESIDE, NH-HAZE, O-HAZE, DENSE-HAZE, and HUDRS have been used for training and testing the architecture. The performance of the proposed model has been analyzed by comparing the generated results with existing dehazing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Yan J, Li C, Zheng Y, Xu S, Yan X (2020) MMP-net: a multi-scale feature multiple parallel fusion network for single image haze removal. IEEE Access 8:25431–25441

    Article  Google Scholar 

  2. Li B, Gou Y, Gu S, Liu JZ, Zhou JT, Peng X (2021) You only look yourself: Unsupervised and untrained single image dehazing neural network. Int J Comput Vision 129:1754–1767

    Article  Google Scholar 

  3. Kratz L, Nishino K (2009) Factorizing scene albedo and depth from a single foggy image. In: 2009 IEEE 12th International Conference on Computer Vision. IEEE, pp 1701–1708. https://doi.org/10.1109/ICCV.2009.5459382

  4. He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Google Scholar 

  5. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24(11):3522–3533. https://doi.org/10.1109/TIP.2015.2446191

    Article  MathSciNet  Google Scholar 

  6. Berman D, Avidan S (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1674–1682

  7. Zhang J, Cao Y, Fang S, Kang Y, Wen Chen C (2017) Fast haze removal for nighttime image using maximum reflectance prior. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7418–7426

  8. Hussain F, Jeong J (2016) Visibility enhancement of scene images degraded by foggy weather conditions with deep neural networks. J Sensors. https://doi.org/10.1155/2016/3894832

    Article  Google Scholar 

  9. Sharma N, Kumar V, Singla SK (2021) Single image defogging using deep learning techniques: past, present and future. Archives Comput Methods Eng 28:4449–4469

    Article  Google Scholar 

  10. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: An end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  Google Scholar 

  11. Ren W, Liu S, Zhang H, Pan J, Cao X, Yang MH, (2016) Single image dehazing via multi-scale convolutional neural networks. In Computer Vision–ECCV, (2016) 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part II 14:154–169. Springer International Publishing. https://doi.org/10.1007/978-3-319-46475-6_10

  12. Liu K, He L, Ma S, Gao S, Bi D (2018) A sensor image dehazing algorithm based on feature learning. Sensors 18(8):2606

    Article  Google Scholar 

  13. Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang MH (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3253–3261

  14. Wang A, Wang W, Liu J, Gu N (2018) AIPNet: Image-to-image single image dehazing with atmospheric illumination prior. IEEE Trans Image Process 28(1):381–393

    Article  MathSciNet  Google Scholar 

  15. Zhang S, Zhang J, He F, Hou N (2023) DRDDN: dense residual and dilated dehazing network. Vis Comput 39(3):953–969

    Article  Google Scholar 

  16. Li X, Hua Z, Li J (2023) Attention-based adaptive feature selection for multi-stage image dehazing. Vis Comput 39(2):663–678

    Article  Google Scholar 

  17. Zhang W, Dong L, Pan X, Zhou J, Qin L, Xu W (2019) Single image defogging based on multi-channel convolutional MSRCR. IEEE Access 7:72492–72504

    Article  Google Scholar 

  18. Ren W, Pan J, Zhang H, Cao X, Yang MH (2020) Single image dehazing via multi-scale convolutional neural networks with holistic edges. Int J Comput Vision 128:240–259

    Article  Google Scholar 

  19. Yeh CH, Huang CH, Kang LW (2019) Multi-scale deep residual learning-based single image haze removal via image decomposition. IEEE Trans Image Process 29:3153–3167

    Article  Google Scholar 

  20. Li C, Guo J, Porikli F, Fu H, Pang Y (2018) A cascaded convolutional neural network for single image dehazing. IEEE Access 6:24877–24887

    Article  Google Scholar 

  21. Song Y, Li J, Wang X, Chen X (2017) Single image dehazing using ranking convolutional neural network. IEEE Trans Multimedia 20(6):1548–1560

    Article  Google Scholar 

  22. Li J, Li G, Fan H (2018) Image dehazing using residual-based deep CNN. IEEE Access 6:26831–26842

    Article  Google Scholar 

  23. Dudhane A, Murala S (2018) C^ 2msnet: A novel approach for single image haze removal. In: 2018 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1397–1404. https://doi.org/10.1109/WACV.2018.00157

  24. Li R, Pan J, Li Z, Tang J (2018) Single image dehazing via conditional generative adversarial network. In: Proceedings of the IEEEconference on computer vision and pattern recognition, pp 8202–8211

  25. Bui TM, Kim W (2017) Single image dehazing using color ellipsoid prior. IEEE Trans Image Process 27(2):999–1009

    Article  MathSciNet  Google Scholar 

  26. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G (2019) Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision (WACV). IEEE, pp 1375–1383. https://doi.org/10.1109/WACV.2019.00151

  27. Ngo D, Lee GD, Kang B (2019) Improved color attenuation prior for single-image haze removal. Appl Sci 9(19):4011

    Article  Google Scholar 

  28. Huang LY, Yin JL, Chen BH, Ye SZ (2019) Towards unsupervised single image dehazing with deep learning. In: 2019 IEEE International Conference on Image Processing (ICIP). IEEE, pp 2741–2745. https://doi.org/10.1109/ICIP.2019.8803316

  29. Liu W, Hou X, Duan J, Qiu G (2020) End-to-end single image fog removal using enhanced cycle consistent adversarial networks. IEEE Trans Image Process 29:7819–7833

    Article  Google Scholar 

  30. Xiao J, Zhou J, Lei J, Xu C, Sui H (2019) Image hazing algorithm based on generative adversarial networks. IEEE Access 8:15883–15894

    Article  Google Scholar 

  31. Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-Net: Feature fusion attention network for single image dehazing. In Proceedings of the AAAI Conference Artificial Intell 34(07):11908–11915

    Google Scholar 

  32. Raikwar SC, Tapaswi S (2020) Lower bound on transmission using non-linear bounding function in single image dehazing. IEEE Trans Image Process 29:4832–4847

    Article  Google Scholar 

  33. Dong H, Pan J, Xiang L, Hu Z, Zhang X, Wang F, Yang MH (2020) Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognitio, pp 2157–2167

  34. Dhara SK, Roy M, Sen D, Biswas PK (2020) Color cast dependent image dehazing via adaptive airlight refinement and non-linear color balancing. IEEE Trans Circuits Syst Video Technol 31(5):2076–2081

    Article  Google Scholar 

  35. Wu H, Qu Y, Lin S, Zhou J, Qiao R, Zhang Z, Xie Y, Ma L (2021) Contrastive learning for compact single image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 10551–10560

  36. Fu M, Liu H, Yu Y, Chen J, Wang K (2021) DW-GAN: A discrete wavelet transform GAN for nonhomogeneous dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 203–212

  37. Silberman N, Hoiem D, Kohli P, Fergus R (2012) Indoor segmentation and support inference from rgbd images. Computer Vision–ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part V 12. Springer, Berlin, pp 746–760

    Chapter  Google Scholar 

  38. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255. https://doi.org/10.1109/CVPR.2009.5206848

  39. Ancuti C, Ancuti CO, De Vleeschouwer C (2016) D-hazy: a dataset to evaluate quantitatively dehazing algorithms. In: 2016 IEEE International Conference on Image Processing (ICIP). IEEE, pp 2226–2230. https://doi.org/10.1109/ICIP.2016.7532754

  40. Saxena A, Sun M, Ng AY (2008) Make3d: Learning 3d scene structure from a single still image. IEEE Trans Pattern Anal Mach Intell 31(5):824–840

    Article  Google Scholar 

  41. Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28(1):492–505

    Article  MathSciNet  Google Scholar 

  42. Ma K, Liu W, Wang Z (2015) Perceptual evaluation of single image dehazing algorithms. In: 2015 IEEE International Conference on Image Processing (ICIP). IEEE, pp 3600–3604. https://doi.org/10.1109/ICIP.2015.7351475

  43. Tarel JP, Hautiere N, Caraffa L, Cord A, Halmaoui H, Gruyer D (2012) Vision enhancement in homogeneous and heterogeneous fog. IEEE Intell Transp Syst Mag 4(2):6–20

    Article  Google Scholar 

  44. Ancuti CO, Ancuti C, Timofte R, De Vleeschouwer C (2018) O-haze: a dehazing benchmark with real hazy and haze-free outdoorimages. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 754–762

  45. Ancuti C, Ancuti CO, Timofte R, De Vleeschouwer C (2018) I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images. In: Advanced Concepts for Intelligent Vision Systems: 19th International Conference, ACIVS 2018, Poitiers, France, September 24–27, 2018, Proceedings 19. Springer International Publishing, pp 620–631. https://doi.org/10.1007/978-3-030-01449-0_52

  46. Scharstein D, Hirschmüller H, Kitajima Y, Krathwohl G, Nešić N, Wang X, Westling P (2014) High resolution stereo datasets with subpixel-accurate ground truth. In: Pattern Recognition: 36th German Conference, GCPR 2014, Münster, Germany, September 2–5, 2014, Proceedings 36. Springer International Publishing, pp 31–42

  47. Anon. (n.d.). pix2pix dataset. [online] Available at: https://www.kaggle.com/datasets/vikramtiwari/pix2pix-dataset. Accessed 6 Jul 2023

  48. Zhang Y, Ding L, Sharma G (2017) Hazerd: an outdoor scene dataset and benchmark for single image dehazing. In: 2017 IEEEinternational conference on image processing (ICIP). IEEE, pp 3205–3209. https://doi.org/10.1109/ICIP.2017.8296874

  49. Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24(11):3888–3901

    Article  MathSciNet  Google Scholar 

  50. Ancuti CO, Ancuti C, Timofte R (2020) NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 444–445

  51. Ancuti CO, Ancuti C, Vasluianu FA, Timofte R (2021) NTIRE 2021 nonhomogeneous dehazing challenge report. In: Proceedingsof the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 627–646

  52. Parihar AS, Singh K (2018) A study on Retinex based method for image enhancement. In: 2018 2nd International Conference on Inventive Systems and Control (ICISC). IEEE, pp 619–624. https://doi.org/10.1109/ICISC.2018.8398874

  53. Xizhi Z (2008) The application of wavelet transform in digital image processing. In: 2008 international conference on multimedia and information technology. IEEE, pp 326–329. https://doi.org/10.1109/MMIT.2008.134

  54. Hu Q, Zhang Y, Zhu Y, Jiang Y, Song M (2023) Single image dehazing algorithm based on sky segmentation and optimal transmission maps. Vis Comput 39(3):997–1013

    Article  Google Scholar 

  55. Zhang W, Chen W, Wang Z, Li H (2014) An improved fog-removing method for the traffic monitoring image. In: 2014 12thInternational Conference on Signal Processing (ICSP). IEEE, pp 938–941. https://doi.org/10.1109/ICOSP.2014.7015142

  56. Fu Q, Jung C, Xu K (2018) Retinex-based perceptual contrast enhancement in images using luminance adaptation. IEEE Access 6:61277–61286

    Article  Google Scholar 

  57. Dharejo FA, Zhou Y, Deeba F, Jatoi MA, Khan MA, Mallah GA, Ghaffar A, Chhattal M, Du Y, Wang X (2021) A deep hybrid neural network for single image dehazing via wavelet transform. Optik 231:166462

    Article  Google Scholar 

  58. Brownlee J (2019) A gentle introduction to the Rectified Linear Unit (ReLU) for deep learning neural networks. [online] MachineLearning Mastery. Available at: https://machinelearningmastery.com/rectified-linear-activation-function-for-deep-learning-neuralnetworks/. Accessed 6 Jul 2023

  59. Bindal A (2019) Normalization Techniques in Deep Neural Networks. [online] Techspace. Available at: https://medium.com/techspace-usict/normalization-techniques-in-deep-neural-networks-9121bf100d8. Accessed 6 Jul 2023

  60. Barner KE, Arce GR (1998) 21 Order-statistic filtering and smoothing of time-series: Part II. Handbook Statist 17:555–602

    Article  Google Scholar 

  61. Ancuti CO, Ancuti C, Sbert M, Timofte R (2019) Dense-haze: a benchmark for image dehazing with dense-haze and haze-free images. In: 2019 IEEE international conference on image processing (ICIP). IEEE, pp 1014–1018. https://doi.org/10.1109/ICIP.2019.8803046

  62. Tarel JP, Hautiere N, Cord A, Gruyer D, Halmaoui H (2010) Improved visibility of road scene images under heterogeneous fog. In: 2010 IEEE intelligent vehicles symposium. IEEE, pp 478–485. https://doi.org/10.1109/IVS.2010.5548128

  63. Juneja A, Kumar V, Singla SK (2022) A systematic review on foggy datasets: Applications and challenges. Archives Comput Methods Eng 29(3):1727–1752

    Article  Google Scholar 

  64. Anon (n.d.) Home - MatConvNet. [online] Available at: https://www.vlfeat.org/matconvnet/. Accessed 6 Jul 2023

  65. Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd ACM internationalconference on Multimedia, pp 689–692. https://doi.org/10.1145/2733373.2807412

  66. Choi LK, You J, Bovik AC (2014) Referenceless perceptual fog density prediction model. In: Human Vision and Electronic Imaging XIX, vol 9014. SPIE, pp 90–101

  67. Choi LK, You J, Bovik AC (2014) Reference less perceptual image defogging. In: 2014 Southwest Symposium on Image Analysis and Interpretation, IEEE edn, pp 165–168. https://doi.org/10.1109/SSIAI.2014.6806055

  68. Choi LK, You J, Bovik AC (2015) FADE software release. Available at: https://live.ece.utexas.edu/research/fog/FADE_release.zip. Accessed 6 Jul 2023

  69. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  70. Singh D, Kumar V (2019) A comprehensive review of computational dehazing techniques. Archives Computational Methods Eng 26:1395–1413

    Article  Google Scholar 

  71. Venkatanath N, Praneeth D, Bh MC, Channappayya SS, Medasani SS (2015) Blind image quality evaluation using perception based features. In: 2015 twenty first national conference on communications (NCC). IEEE, pp 1–6. https://doi.org/10.1109/NCC.2015.7084843

  72. Wang C, Shen HW (2011) Information theory in scientific visualization. Entropy 13(1):254–273

    Article  Google Scholar 

Download references

Funding

This research is supported by Council of Scientific and Industrial Research (CSIR), India. The sanction number of the scheme is 22(0801)/19/EMR-II.

Author information

Authors and Affiliations

  1. Department of Electrical and Instrumentation Engineering, Thapar Institute of Engineering and Technology, Patiala, India

    Akshay Juneja & Sunil Kumar Singla

  2. Department of Information Technology, Dr. B. R. Ambedkar, National Institute of Technology, Jalandhar, India

    Vijay Kumar

Authors
  1. Akshay Juneja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vijay Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sunil Kumar Singla
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Akshay Juneja.

Ethics declarations

Conflict of Interests

The authors have no conflict of interest to declare. All co-authors have seen and agree with the contents of the manuscript. We certify that the submission is original work and is not under review at any other publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Juneja, A., Kumar, V. & Singla, S.K. Single Image Dehazing Using Hybrid Convolution Neural Network. Multimed Tools Appl 83, 38355–38386 (2024). https://doi.org/10.1007/s11042-023-17132-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17132-9

Keywords

Search

Navigation