Skip to main content
SpringerLink
Log in

Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion

  • Research Article
  • Published:
Earth Science Informatics Aims and scope Submit manuscript

Abstract

During the imaging process, the image will be polluted by noise due to the influence of the earth's atmosphere fog. Noise pollution directly affects the processing of feature extraction, image segmentation, and pattern recognition. Therefore, the purpose of image defogging is to eliminate noise from foggy images to improve image quality. When dealing with uneven fog density in the same image, most of the existing methods are not satisfactory. Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion is proposed. In order to distinguish between the presence of fog with different concentrations in the image. We adopt the concept of attention that has been important in convolutional neural networks (CNN) in recent years. We adopt the attention mechanism to help our network pay more attention to important feature information, treat thick fog and mist differently, and solve the problem of uneven distribution of fog in the image, but the network handles the problem with the same weight. Finally, use a five-layer convolution operation to restore the image. The experimental results show that our method achieves a good defogging effect on the uneven distribution of the fog density of the synthesized foggy image. In the experiment of real natural foggy images, relying on the attention mechanism network to remove the fog, serious patches will appear on the restored images. Our method will not damage the image. Our method can reasonably remove thick fog and mist to obtain a good defogging effect. And our proposed method is robust.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Berman D, Avidan S (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1674–1682

  • Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25:5187–5198

    Article  Google Scholar 

  • Chen Z, Ou B, Tian Q (2019) An improved dark channel prior image defogging algorithm based on wavelength compensation. Earth Sci Inf 12:501–512

    Article  Google Scholar 

  • Choi LK, You J, Bovik AC (2015) Referenceless prediction of perceptual fog density and perceptual image defogging. IEEE Trans Image Process 24:3888–3901

    Article  Google Scholar 

  • Cozman F, Krotkov E (1997) Depth from scattering. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp 801–806

  • Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27:1–9

    Article  Google Scholar 

  • Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34:1–14

    Article  Google Scholar 

  • Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3146–3154

  • He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33:2341–2353

    Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  • He T, Zhang Z, Zhang H, Zhang Z, Xie J, Li M (2019) Bag of tricks for image classification with convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 558–567

  • Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J vis Commun Image Represent 24:410–425

    Article  Google Scholar 

  • Kingma DP, Ba J (2014) Adam: A method for stochastic optimization arXiv preprint arXiv:14126980

  • Li B, Peng X, Wang Z, Xu J, Feng D (2017) An all-in-one network for dehazing and beyond arXiv preprint arXiv:170706543

  • Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28:492–505

    Article  Google Scholar 

  • Lim B, Son S, Kim H, Nah S, Mu Lee K (2017) Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 136–144

  • Meng G, Wang Y, Duan J, Xiang S, Pan C (2013) Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE international conference on computer vision, pp 617–624

  • Narasimhan SG, Nayar SK (2000) Chromatic framework for vision in bad weather. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), IEEE, pp 598–605

  • Narasimhan SG, Nayar SK (2002) Vision and the atmosphere. Int J Comput Vis 48:233–254

    Article  Google Scholar 

  • Paszke A, Gross S, Chinatala S, et al. (2017) Automatic differentiation in pytorch. In: 31st Conference on Neural Information Processing System, pp 1–4

  • Paszke A et al (2019) Pytorch: an imperative style, high-performance deep learning library. In: Advances in neural information processing systems, pp 8026–8037

  • Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-Net: feature fusion attention network for single image dehazing. In: AAAI, pp 11908–11915

  • Ren W, Liu S, Zhang H, Pan J, Cao X, Yang M-H (2016) Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision. Springer, pp 154–169

  • Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang M-H (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp 3253–3261

  • Vaswani A et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30:5998–6008

    Google Scholar 

  • Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: International conference on machine learning. PMLR, pp 7354–7363

  • Zhang X-S, Gao S-B, Li C-Y, Li Y-J (2015) A retina inspired model for enhancing visibility of hazy images. Front Comput Neurosci 9:151

    Google Scholar 

  • Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301

  • Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24:3522–3533

    Article  Google Scholar 

Download references

Acknowledgements

We thank the Graduate education reform project of Minnan Normal University (No. MSYJG 8) and the Natural Science Foundation of Zhangzhou (No. ZZ2020J33).

Author information

Authors and Affiliations

  1. College of Computer, Minnan Normal University, Zhangzhou, Fujian, China

    Shengmin He & Fengli Wang

  2. Key Laboratory of Data Science and Intelligence Application, Minnan Normal University, Zhangzhou, Fujian, China

    Shengmin He & Fengli Wang

  3. College of Physics and Information Engineering, Minnan Normal University, Zhangzhou, Fujian, China

    Zhixiang Chen

  4. School of History and Geography, Minnan Normal University, Zhangzhou, Fujian, China

    Meiya Wang

Authors
  1. Shengmin He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhixiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fengli Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Meiya Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhixiang Chen.

Additional information

Communicated by H. Babaie.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, S., Chen, Z., Wang, F. et al. Integrated image defogging network based on improved atmospheric scattering model and attention feature fusion. Earth Sci Inform 14, 2037–2048 (2021). https://doi.org/10.1007/s12145-021-00672-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12145-021-00672-9

Keywords

Search

Navigation