Skip to main content
SpringerLink
Log in

AIDEDNet: anti-interference and detail enhancement dehazing network for real-world scenes

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

The haze phenomenon seriously interferes the image acquisition and reduces image quality. Due to many uncertain factors, dehazing is typically a challenge in image processing. The most existing deep learning-based dehazing approaches apply the atmospheric scattering model (ASM) or a similar physical model, which originally comes from traditional dehazing methods. However, the data set trained in deep learning does not match well this model for three reasons. Firstly, the atmospheric illumination in ASM is obtained from prior experience, which is not accurate for dehazing real-scene. Secondly, it is difficult to get the depth of outdoor scenes for ASM. Thirdly, the haze is a complex natural phenomenon, and it is difficult to find an accurate physical model and related parameters to describe this phenomenon. In this paper, we propose a black box method, in which the haze is considered an image quality problem without using any physical model such as ASM. Analytically, we propose a novel dehazing equation to combine two mechanisms: interference item and detail enhancement item. The interference item estimates the haze information for dehazing the image, and then the detail enhancement item can repair and enhance the details of the dehazed image. Based on the new equation, we design an anti-interference and detail enhancement dehazing network (AIDEDNet), which is dramatically different from existing dehazing networks in that our network is fed into the haze-free images for training. Specifically, we propose a new way to construct a haze patch on the flight of network training. The patch is randomly selected from the input images and the thickness of haze is also randomly set. Numerous experiment results show that AIDEDNet outperforms the state-of-the-art methods on both synthetic haze scenes and real-world haze scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. McCartney E J. Optics of the Atmosphere: Scattering by Molecules and Particles. New York: Wiley, 1976

    Google Scholar 

  2. Ju M, Ding C, Ren W, Yang Y, Zhang D, Guo Y J. IDE: image dehazing and exposure using an enhanced atmospheric scattering model. IEEE Transactions on Image Processing, 2021, 30: 2180–2192

    Article  Google Scholar 

  3. Golts A, Freedman D, Elad M. Unsupervised single image dehazing using dark channel prior loss. IEEE Transactions on Image Processing, 2020, 29: 2692–2701

    Article  Google Scholar 

  4. Zhang H, Patel V M. Densely connected pyramid dehazing network. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 3194–3203

  5. Dutta A, Ashishkumar G, Rao C V R. Performance analysis of ASR system in hybrid DNN-HMM framework using a PWL Euclidean activation function. Frontiers of Computer Science, 2021, 15(4): 154705

    Article  Google Scholar 

  6. Chen Y, He F, Li H, Zhang D, Wu Y. A full migration BBO algorithm with enhanced population quality bounds for multimodal biomedical image registration. Applied Soft Computing, 2020, 93: 106335

    Article  Google Scholar 

  7. Zhang H, Zhang Y, Geng Y. Practical age estimation using deep label distribution learning. Frontiers of Computer Science, 2021, 15(3): 153318

    Article  Google Scholar 

  8. Kim H, Yeo C, Lee I D, Mun D. Deep-learning-based retrieval of piping component catalogs for plant 3D CAD model reconstruction. Computers in Industry, 2020, 123: 103320

    Article  Google Scholar 

  9. Liang Y, He F, Zeng X. 3D mesh simplification with feature preservation based on whale optimization algorithm and differential evolution. Integrated Computer-Aided Engineering, 2020, 27(4): 417–435

    Article  Google Scholar 

  10. Zhang X, Liu Q, Wang D, Zhao L, Gu N, Maybank S. Self-taught semisupervised dictionary learning with nonnegative constraint. IEEE Transactions on Industrial Informatics, 2020, 16(1): 532–543

    Article  Google Scholar 

  11. Yan Y, Nie F, Li W, Gao C, Yang Y, Xu D. Image classification by cross-media active learning with privileged information. IEEE Transactions on Multimedia, 2016, 18(12): 2494–2502

    Article  Google Scholar 

  12. Song Y, He F, Duan Y, Liang Y, Yan X. A kernel correlation-based approach to adaptively acquire local features for learning 3D point clouds. Computer-Aided Design, 2022, 146: 103196

    Article  MathSciNet  Google Scholar 

  13. Ali S F, Khan M A, Aslam A S. Fingerprint matching, spoof and liveness detection: classification and literature review. Frontiers of Computer Science, 2021, 15(1): 151310

    Article  Google Scholar 

  14. Liang Y, He F, Zeng X, Luo J. An improved loop subdivision to coordinate the smoothness and the number of faces via multi-objective optimization. Integrated Computer-Aided Engineering, 2022, 29(1): 23–41

    Article  Google Scholar 

  15. Yeo C, Kim S, Kim H, Kim S, Mun D. Deep learning applications in an industrial process plant: repository of segmented point clouds for pipework components. JMST Advances, 2020, 2(1): 15–24

    Article  Google Scholar 

  16. Wu H, He F, Duan Y, Yan X. Perceptual metric-guided human image generation. Integrated Computer-Aided Engineering, 2021, DOI: https://doi.org/10.3233/ICA-210672

  17. Wu Q, Zhang J, Ren W, Zuo W, Cao X. Accurate transmission estimation for removing haze and noise from a single image. IEEE Transactions on Image Processing, 2020, 29: 2583–2597

    Article  Google Scholar 

  18. Li L, Dong Y, Ren W, Pan J, Gao C, Sang N, Yang M H. Semi-supervised image dehazing. IEEE Transactions on Image Processing, 2020, 29: 2766–2779

    Article  Google Scholar 

  19. Koppe G, Meyer-Lindenberg A, Durstewitz D. Deep learning for small and big data in psychiatry. Neuropsychopharmacology, 2021, 46(1): 176–190

    Article  Google Scholar 

  20. Høye T T, Ärje J, Bjerge K, Hansen O L, Iosifidis A, Leese F, Mann H M R, Meissner K, Melvad C, Raitoharju J. Deep learning and computer vision will transform entomology. Proceedings of the National Academy of Sciences of the United States of America, 2021, 118(2): e2002545117

    Article  Google Scholar 

  21. Zhang S, He F. DRCDN: learning deep residual convolutional dehazing networks. The Visual Computer, 2020, 36(9): 1797–1808

    Article  Google Scholar 

  22. Ren W, Pan J, Zhang H, Cao X, Yang M H. Single image dehazing via multi-scale convolutional neural networks with holistic edges. International Journal of Computer Vision, 2020, 128(1): 240–259

    Article  Google Scholar 

  23. He K, Sun J, Tang X. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(12): 2341–2353

    Article  Google Scholar 

  24. Zhang J, He F, Chen Y. A new haze removal approach for sky/river alike scenes based on external and internal clues. Multimedia Tools and Applications, 2020, 79(3): 2085–2107

    Article  Google Scholar 

  25. Li B, Peng X, Wang Z, Xu J, Feng D. AOD-Net: All-in-one dehazing network. In: Proceedings of 2017 IEEE International Conference on Computer Vision. 2017, 4780–4788

  26. Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang M H. Gated fusion network for single image dehazing. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 3253–3261

  27. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G. Gated context aggregation network for image dehazing and deraining. In: Proceedings of 2019 IEEE Winter Conference on Applications of Computer Vision. 2019, 1375–1383

  28. Engin D, Genç A, Kemal Ekenel H. Cycle-dehaze: enhanced CycleGAN for single image dehazing. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2018, 825–833

  29. Li C, Guo C, Guo J, Han P, Fu H, Cong R. PDR-Net: perception-inspired single image dehazing network with refinement. IEEE Transactions on Multimedia, 2020, 22(3): 704–716

    Article  Google Scholar 

  30. Qu Y, Chen Y, Huang J, Xie Y. Enhanced pix2pix dehazing network. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 8152–8160

  31. Ancuti C, Ancuti C O, De Vleeschouwer C. D-HAZY: a dataset to evaluate quantitatively dehazing algorithms. In: Proceedings of 2016 IEEE International Conference on Image Processing. 2016, 2226–2230

  32. Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z. Benchmarking single-image dehazing and beyond. IEEE Transactions on Image Processing, 2019, 28(1): 492–505

    Article  MathSciNet  MATH  Google Scholar 

  33. Chow L S, Rajagopal H. Modified-BRISQUE as no reference image quality assessment for structural MR images. Magnetic Resonance Imaging, 2017, 43: 74–87

    Article  Google Scholar 

  34. Yadav A, Sohoni S, Chandler D. GPGPU based implementation of a high performing no reference (NR)-IQA algorithm, BLIINDS-II. IS and T International Symposium on Electronic Imaging Science and Technology, 2017, Part F130046(12): 21–25

    Google Scholar 

  35. Talebi H, Milanfar P. NIMA: neural image assessment. IEEE Transactions on Image Processing, 2018, 27(8): 3998–4011

    Article  MathSciNet  MATH  Google Scholar 

  36. Dong H, Pan J, Xiang L, Hu Z, Zhang X, Wang F, Yang M H. Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020, 2154–2164

  37. Pan J, Dong J, Liu Y, Zhang J, Ren J, Tang J, Tai Y W, Yang M H. Physics-based generative adversarial models for image restoration and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(7): 2449–2462

    Article  Google Scholar 

  38. Pan Y, He F, Yu H. Learning social representations with deep autoencoder for recommender system. World Wide Web, 2020, 23(4): 2259–2279

    Article  Google Scholar 

  39. Qiao L, Zhang F, Huang X, Li K, Chen E. Heterogeneous-attributes enhancement deep framework for network embedding. Frontiers of Computer Science, 2021, 15(6): 156616

    Article  Google Scholar 

  40. Dong J, Pan J. Physics-based feature dehazing networks. In: Proceedings of the 16th European Conference on Computer Vision. 2020, 188–204

  41. Khan Z U, Pi D, Yao S, Nawaz A, Ali F, Ali S. PiEnPred: a bi-layered discriminative model for enhancers and their subtypes via novel cascade multi-level subset feature selection algorithm. Frontiers of Computer Science, 2021, 15(6): 156904

    Article  Google Scholar 

  42. Meng X, Li W, Peng X, Li Y, Li M. Protein interaction networks: centrality, modularity, dynamics, and applications. Frontiers of Computer Science, 2021, 15(6): 156902

    Article  Google Scholar 

  43. Li C, Mao Y, Zhang R, Huai J. A revisit to mackay algorithm and its application to deep network compression. Frontiers of Computer Science, 2020, 14(4): 144304

    Article  Google Scholar 

  44. Luo J, He F, Li H, Zeng X T, Liang Y. A novel whale optimization algorithm with filtering disturbance and non-linear step. International Journal of Bio-Inspired Computation, DOI: https://doi.org/10.1504/IJBIC.2020.10036562

  45. Huang L, Peng J, Zhang R, Li G, Lin L. Learning deep representations for semantic image parsing: a comprehensive overview. Frontiers of Computer Science, 2018, 12(5): 840–857

    Article  Google Scholar 

  46. Quan R, Yu X, Liang Y, Yang Y. Removing raindrops and rain streaks in one go. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021, 9143–9152

  47. Du Y, Xu J, Zhen X, Cheng M M, Shao L. Conditional variational image deraining. IEEE Transactions on Image Processing, 2020, 29: 6288–6301

    Article  Google Scholar 

  48. Zeng H, Xie X, Ning J. Hyperspectral image denoising via global spatial-spectral total variation regularized nonconvex local low-rank tensor approximation. Signal Processing, 2021, 178: 107805

    Article  Google Scholar 

  49. Kumar A, Jain A. Image smog restoration using oblique gradient profile prior and energy minimization. Frontiers of Computer Science, 2021, 15(6): 156706

    Article  Google Scholar 

  50. Zhu Z, Albadawy E, Saha A, Zhang J, Harowicz M R, Mazurowski M A. Deep learning for identifying radiogenomic associations in breast cancer. Computers in Biology and Medicine, 2019, 109: 85–90

    Article  Google Scholar 

  51. Masood M, Nazir T, Nawaz M, Javed A, Iqbal M, Mehmood A. Brain tumor localization and segmentation using mask RCNN. Frontiers of Computer Science, 2021, 15(6): 156338

    Article  Google Scholar 

  52. Zhang X, Hu W, Xie N, Bao H, Maybank S. A robust tracking system for low frame rate video. International Journal of Computer Vision, 2015, 115(3): 279–304

    Article  MathSciNet  Google Scholar 

  53. Zhang X, Li W, Hu W, Ling H, Maybank S. Block covariance based l1 tracker with a subtle template dictionary. Pattern Recognition, 2013, 46(7): 1750–1761

    Article  Google Scholar 

  54. Li H, He F, Chen Y, Pan Y. MLFS-CCDE: MULTI-objective large-scale feature selection by cooperative coevolutionary differential evolution. Memetic Computing, 2021, 13(1): 1–18

    Article  Google Scholar 

  55. Men H, Wang B, Wu G. MITAR: a study on human activity recognition based on NLP with microscopic perspective. Frontiers of Computer Science, 2021, 15(5): 155330

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant No. 62072348), the National Key RD Program of China under (2019YFC1509604), and the Science and Technology Major Project of Hubei Province China (Next-Generation AI Technologies) (2019AEA170)

Author information

Authors and Affiliations

  1. School of Computer Science, Wuhan University, Wuhan, 430072, China

    Jian Zhang, Fazhi He & Shizhen Yang

  2. College of Sport Engineering and Information Technology, Wuhan Sports University, Wuhan, 430079, China

    Jian Zhang

  3. School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, 430072, China

    Yansong Duan

Authors
  1. Jian Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fazhi He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yansong Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shizhen Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fazhi He.

Additional information

Jian Zhang is currently a PhD candidate at the School of Computer Science in Wuhan University, China. His research interests include image processing, pattern recognition, and computer graphics.

Fazhi He is currently a professor at the School of Computer Science of Wuhan University, China. His research interests include collaborative computing, computer graphics, computer vision, and high-performance computing.

Yansong Duan received the MS, and PhD degrees from Wuhan University, China in 2009 and 2016, respectively. He is currently an associate professor with the School of Remote Sensing and Information Engineering, Wuhan University, China. His research interests include photogrammetry, image processing and matching, 3-D city reconstruction, computer vision, and high performance computing.

Shizhen Yang received his BE degree in Computer Science and Technology from Wuhan University, China in 2019. Currently, he is pursuing a ME degree in Computer Science and Technology at Wuhan University, China. His research interest includes image restoration.

Electronic Supplementary Material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, J., He, F., Duan, Y. et al. AIDEDNet: anti-interference and detail enhancement dehazing network for real-world scenes. Front. Comput. Sci. 17, 172703 (2023). https://doi.org/10.1007/s11704-022-1523-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11704-022-1523-9

Keywords

Search

Navigation