Skip to main content
SpringerLink
Log in

Joint dehazing and denoising for single nighttime image via multi-scale decomposition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Outdoor images taken in the foggy or haze weather conditions are usually contaminated due to the presence of turbid medium in the atmosphere. Moreover, images captured under nighttime haze scenarios will be degraded even further owing to some unexpected factors. However, most existing dehazing methods mainly focus on daytime haze scenes, which cannot effectively remove the haze and suppress the noise for nighttime hazy images. To overcome these intractable problems, a joint dehazing and denoising framework for nighttime haze scenes is proposed based on multi-scale decomposition. First, the glow is removed by using its characteristic of the relative smoothness and the gamma correction operation is employed on the glow-free image for improving the overall brightness. Then, we adopt the multi-scale strategy to decompose the nighttime hazy image into a structure layer and multiple texture layers based on the total variation. Subsequently, the structure layer is dehazed based on the dark channel prior (DCP) and the texture layers are denoised based on color block-matching 3D filtering (CBM3D) prior to enhancement. Finally, the dehazed structure layer and the enhanced texture layers are fused into a dehazing result. Experiments on real-world and synthetic nighttime hazy images reveal that the proposed nighttime dehazing framework outperforms other state-of-the-art daytime and nighttime dehazing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Ancuti CO, Ancuti C (2013) Single image dehazing by multi-scale fusion. IEEE Trans Image Process 22(8):3271–3282

    Article  Google Scholar 

  2. Ancuti C, Ancuti CO, De Vleeschouwer C, Bovik AC (2020) Day and night-time dehazing by local airlight estimation. IEEE Tran Image Process 29:6264–6275

    Article  Google Scholar 

  3. Ancuti C, Ancuti CO, Vleeschouwer CD, Bovik AC (2016) Night-time dehazing by fusion. In: Proc IEEE int conf image process, pp 2256–2260

  4. Ancuti CO, Ancuti C, Vleeschouwer CD, Sbetr M (2019) Color channel transfer for image dehazing. IEEE Signal Process Lett 26(9):1413–1417

    Article  Google Scholar 

  5. Bo J, Meng H, Ma X, Wang L, Zhou Y, Pengfei X u, Jiang S, Meng X (2018) Nighttime image dehazing with modified models of color transfer and guided image filter. Multimed Tools Appl 77(3):3125–3141

    Article  Google Scholar 

  6. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: An end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  Google Scholar 

  7. Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24 (11):3888–3901

    Article  MathSciNet  Google Scholar 

  8. Fattal R, Lischinski D, Werman M (2002) Gradient domain high dynamic range compression. ACM Transactions on Graphics, 21(3)

  9. Hautiere N, Tarel JP, Aubert D, Eric D (2008) Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Analysis & Stereology 27(2):87–95

    Article  MathSciNet  Google Scholar 

  10. He K, Sun J, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Article  Google Scholar 

  11. He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409

    Article  Google Scholar 

  12. Hirschmuller H, Scharstein D (2007) Evaluation of cost functions for stereo matching. In: 2007 IEEE Conference on computer vision and pattern recognition. IEEE, pp 1–8

  13. Ju M, Ding C, Jay Guo Y, Zhang D (2019) Idgcp: Image dehazing based on gamma correction prior. IEEE Trans Image Process 29:3104–3118

    Article  Google Scholar 

  14. Ju M, Gu Z, Zhang D (2017) Single image haze removal based on the improved atmospheric scattering model. Neurocomputing 260:180–191

    Article  Google Scholar 

  15. Koschmieder H (1925) Theorie der horizontalen sichtweite: Kontrast und Sichtweite. Keim & Nemnich, Germany

    Google Scholar 

  16. Kostadin D, Alessandro F, Vladimir K, Karen E (2007) Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space. In: IEEE International conference on image processing, pp i–313–i–316

  17. Li Y u, Tan RT, Brown MS (2015) Nighttime haze removal with glow and multiple light colors. In: Proc IEEE int Conf Comput vision, pp 226–234

  18. Liu Y, Li H, Wang M (2017) Single image dehazing via large sky region segmentation and multiscale opening dark channel model. IEEE Access 5:8890–8903

    Article  Google Scholar 

  19. Liu Y, Shang J, Pan L, Wang A, Wang M (2019) A unified variational model for single image dehazing. IEEE Access 7:15722–15736

    Article  Google Scholar 

  20. Liu Y, Wang A, Zhou H, Jia P (2021) Single nighttime image dehazing based on image decomposition. Signal Processing, 183(107986)

  21. Lou W, Li Y, Yang G, Chenlizhao C, Yang H, Yu T (2020) Integrating haze density features for fast nighttime image dehazing, vol 8, pp 113318–113330

  22. Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE international conference on computer vision, pp 617–624

  23. Mi Z, Zhou H, Zheng Y, Wang M (2016) Single image dehazing via multi-scale gradient domain contrast enhancement. Iet Image Processing 10(3):206–214

    Article  Google Scholar 

  24. Pan J, Dong J, Liu Y, Zhang J, Ren J, Tang J, Tai YW, Yang M-H (2020) Physics-based generative adversarial models for image restoration and beyond. IEEE Trans Pattern Anal Mach Intell

  25. Pei SC, Lee TY (2012) Nighttime haze removal using color transfer pre-processing and dark channel prior. In: Proc IEEE Int Conf Image process, pp 957–960

  26. Rajput SS, Arya KV (2019) Noise robust face hallucination via outlier regularized least square and neighbor representation. IEEE Transactions on Biometrics Behavior, and Identity Science 1(4):252–263

    Article  Google Scholar 

  27. Rajput SS, Arya KV (2019) A robust facial image super-resolution model via mirror-patch based neighbor representation. Multimedia Tools and Applications 78(18):25407–25426

    Article  Google Scholar 

  28. Rajput SS, Arya KV (2020) A robust face super-resolution algorithm and its application in low-resolution face recognition system. Multimedia Tools and Applications 79(33):23909–23934

    Article  Google Scholar 

  29. Rajput SS, Arya KV, Bohat VK (2019) Face image Super-Resolution using differential evolutionary Algorithm computational intelligence: Theories, Applications and Future Directions - Volume II

  30. Rajput SS, Arya KV, Singh V (2018) Robust face super-resolution via iterative sparsity and locality-constrained representation. Inf Sci 463:227–244

    Article  Google Scholar 

  31. Rajput SS, Arya KV, Singh V (2018) Face hallucination techniques: A survey. In: Proceedings of 2018 conference on information and communication technology (CICT), pp 21–6

  32. Rajput SS, Bohat VK, Arya KV (2019) Grey wolf optimization algorithm for facial image super-resolution. Appl Intell 49(4):1324–1338

    Article  Google Scholar 

  33. Rajput SS, Singh V, Arya KV, Junjun J (2018) Noise robust face hallucination algorithm using local content prior based error shrunk nearest neighbors representation. Signal Process 147:233–246

    Article  Google Scholar 

  34. Ren W, Si L, Zhang H, Pan J, Cao X, Yang M-H (2016) Single image dehazing via multi-scale convolutional neural networks. In: Proc Eur Conf Comput Vis. pp 154–169

  35. Rudin L, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena 60:259–268

    Article  MathSciNet  Google Scholar 

  36. Scharstein D, Hirschmüller H., Kitajima Y, Krathwohl G, Nešić N, Wang X, Westling P (2014) High-resolution stereo datasets with subpixel-accurate ground truth. In: German conference on pattern recognition. Springer, pp 31–42

  37. Tan RT (2008) Visibility in bad weather from a single image. In: Proc IEEE conf comput vis pattern recognit, pp 1–8

  38. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  39. Xu Z, Liu X, Chen X (2009) Fog removal from video sequences using contrast limited adaptive histogram equalization. Computational Intelligence, 1–4

  40. Yang M, Liu J, Li Z (2018) Superpixel-based single nighttime image haze removal. IEEE Trans Multimedia 20(11):3008–3018

    Article  Google Scholar 

  41. Yang D, Sun J (2018) Proximal dehaze-net: A prior learning-based deep network for single image dehazing. In: Proc. Eur. Conf. Comput. Vis., pp 702–717

  42. Yu L, Guo F, Tan RT, Brown MS (2014) A contrast enhancement framework with jpeg artifacts suppression. In: Proc Eur Conf Comput Vis, pp 174–188

  43. Yu T, Song K, Pu M, Yang G, Yang H, Chen C (2019) Nighttime single image dehazing via pixel-wise alpha blending, vol 7

  44. Zhang J, Cao Y, Fang S, Kang Y, Chen CW (2017) Fast haze removal for nighttime image using maximum reflectance prior. In: Proc IEEE conf Comput Vis Pattern recognit, pp 7418–7426

  45. Zhang J, Cao Y, Wang Z (2014) Nighttime haze removal based on a new imaging model. In: Proc IEEE int Conf Image process, pp 4557–4561

  46. Zhang J, Cao Y, Zha Z-J, Tao D (2020) Nighttime dehazing with a synthetic benchmark. In: Proceedings of the 28th ACM international conference on multimedia, pp 2355–2363

  47. Zhou J, Zhou F (2013) Single image dehazing motivated by retinex theory. In: 2013 2Nd international symposium on instrumentation & measurement, sensor network and automation (IMSNA)

  48. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Image Trans Process 24(11):3522–3533

    Article  MathSciNet  Google Scholar 

  49. Zhu Z, Wei H, Li Y, Qi G, Mazur N (2021) A novel fast single image dehazing algorithm based on artificial multiexposure image fusion. IEEE Trans Instrum Meas 70:1–23

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Artificial Intelligence, Southwest University, Chongqing, 400715, China

    Yun Liu & Pengfei Jia

  2. College of Computer and Information Science, Southwest University, Chongqing, 400715, China

    Hao Zhou

  3. College of Big Data and Computer Science, Guizhou Normal University, Guiyang, 550001, China

    Anzhi Wang

Authors
  1. Yun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pengfei Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hao Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anzhi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yun Liu.

Ethics declarations

Conflict of Interests

The authors declare no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported by Chongqing Natural Science Foundation (Grant no. cstc2020jcyj-msxmX0324), the Fundamental Research Funds for the Central Universities under Project SWU119044, the Construction of Chengdu-Chongqing Economic Circle Science and Technology Innovation Project (Grant no. KJCX2020007 ), the Fundamental Science and Advanced Technology Research Foundation of Chongqing (cstc2018jcyjA0867), the Fundamental Science on Nuclear Wastes and Environmental safety Laboratory (Grant No. 19kfhk03) and Open Research Fund Program of Data Recovery Key Laboratory of Sichuan Province (Grant No. DRN19015).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Y., Jia, P., Zhou, H. et al. Joint dehazing and denoising for single nighttime image via multi-scale decomposition. Multimed Tools Appl 81, 23941–23962 (2022). https://doi.org/10.1007/s11042-022-12681-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12681-x

Keywords

Search

Navigation