Skip to main content
SpringerLink
Log in

Underwater enhancement computing of ocean HABs based on cyclic color compensation and multi-scale fusion

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The clarity of algal images is crucial for solving problems such as harmful algal blooms (HABs) classification and red tide warning. However, the original underwater microscopic images of HABs often produce color distortion and blurred details due to the effects of seawater quality, illumination and image extraction techniques. To deal with the above problems, an enhancement computing method based on cyclic color compensation and three-image Multi-scale fusion is proposed in this paper. In this method, first, we propose a novel cyclic color compensation method to correct the color of the microscopic images of HABs. Then, with the input of three images derived from the color compensation versions of the original images of the algae, the correlation weight maps of the three inputs are redefined to facilitate the transfer of texture features and color contrast to the output images. Finally, to avoid image artifacts in the low-frequency components of the output image after the weight map transformation, a novel image Multi-scale fusion strategy is used in this paper. Qualitative and quantitative experimental results show that the underwater microscopic images of HABs enhanced with the method proposed in this paper have the best texture clarity and global contrast, and the method significantly improves the accuracy of transmission map estimation, edge detection and key point matching in processing algal images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Aggarwal AK, Jaidka P (2022) Segmentation of crop images for crop yield prediction. Int J Biol Biomed 7

  2. Aguirre-Castro OA, García-Guerrero EE, López-Bonilla OR, Tlelo-Cuautle E, López-Mancilla D, Cárdenas-Valdez JR, ... Inzunza-González E (2022) Evaluation of underwater image enhancement algorithms based on Retinex and its implementation on embedded systems. Neurocomputing 494:148–159

  3. Agusa Y, Endo K, Kuroda H, Kobayashi S (2021) Examination of water temperature interpolation method for prediction. In: Progress in image processing, pattern recognition and communication systems. Springer, Cham, pp 339–350

    Google Scholar 

  4. Akkaynak D, Treibitz T (2019) Sea-thru: a method for removing water from underwater images. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 1682–1691

    Google Scholar 

  5. Ancuti CO, Ancuti C, De Vleeschouwer C, Bekaert P (2017) Color balance and fusion for underwater image enhancement. IEEE Trans Image Process 27(1):379–393

    Article  MathSciNet  Google Scholar 

  6. Arora K, Aggarwal AK (2018) Approaches for image database retrieval based on color, texture, and shape features. In: Handbook of research on advanced concepts in real-time image and video processing. IGI Global, pp 28–50

    Chapter  Google Scholar 

  7. Azmi KZM, Ghani ASA, Yusof ZM, Ibrahim Z (2019) Natural-based underwater image color enhancement through fusion of swarm-intelligence algorithm. Appl Soft Comput 85:105810

    Article  Google Scholar 

  8. Daway HG, Daway EG (2019) Underwater image enhancement using colour restoration based on YCbCr colour model. In: IOP conference series: materials science and engineering (vol 571, no 1, p. 012125). IOP Publishing

    Google Scholar 

  9. Emberton S, Chittka L, Cavallaro A (2018) Underwater image and video dehazing with pure haze region segmentation. Comput Vis Image Underst 168:145–156

    Article  Google Scholar 

  10. Finlayson GD, Trezzi E (2004) Shades of gray and colour constancy. In: Color and imaging conference vol. 2004, no. 1. Society for Imaging Science and Technology, pp 37–41

    Google Scholar 

  11. Galdran A, Pardo D, Picón A, Alvarez-Gila A (2015) Automatic red-channel underwater image restoration. J Vis Commun Image Represent 26:132–145

    Article  Google Scholar 

  12. Gao SB, Zhang M, Zhao Q, Zhang XS, Li YJ (2019) Underwater image enhancement using adaptive retinal mechanisms. IEEE Trans Image Process 28(11):5580–5595

    Article  MathSciNet  Google Scholar 

  13. He J, Zhang S, Yang M, Shan Y, Huang T (2019) Bi-directional cascade network for perceptual edge detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3828–3837

    Google Scholar 

  14. Huang D, Wang Y, Song W, Sequeira J, Mavromatis S (2018) Shallow-water image enhancement using relative global histogram stretching based on adaptive parameter acquisition. In: International conference on multimedia modeling. Springer, Cham, pp 453–465

    Chapter  Google Scholar 

  15. Huang R, Yu K, Huang X, Zou W, Wang Y (2019) Combining Landsat images with historic records to estimate the live coral cover of Luhuitou fringing reef in northern South China Sea. Image Vis Comput 92:103812

    Article  Google Scholar 

  16. Huo F, Li B, Zhu X (2021) Efficient wavelet boost learning-based multi-stage progressive refinement network for underwater image enhancement. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 1944–1952

    Google Scholar 

  17. Hussain MA, Akbari AS (2016) Max-RGB based colour constancy using the sub-blocks of the image. In: 2016 9th international conference on developments in eSystems engineering (DeSE). IEEE, pp 289–294

    Chapter  Google Scholar 

  18. Kumari T, Guleria V, Syal P, Aggarwal AK (2021) A feature cum intensity based SSIM optimised hybrid image registration technique. In: 2021 international conference on computing, communication and green engineering (CCGE). IEEE, pp 1–8

    Google Scholar 

  19. Lee MS, Park KA, Chae J, Park JE, Lee JS, Lee JH (2020) Red tide detection using deep learning and high-spatial resolution optical satellite imagery. Int J Remote Sens 41(15):5838–5860

    Article  Google Scholar 

  20. Lee MS, Park KA, Micheli F (2021) Derivation of red tide index and density using geostationary ocean color imager (GOCI) data. Remote Sens 13(2):298

    Article  Google Scholar 

  21. Li Y, Lu H, Li J, Li X, Li Y, Serikawa S (2016) Underwater image de-scattering and classification by deep neural network. Comput Electr Eng 54:68–77

    Article  Google Scholar 

  22. Li M, Liu J, Yang W, Sun X, Guo Z (2018) Structure-revealing low-light image enhancement via robust retinex model. IEEE Trans Image Process 27(6):2828–2841

    Article  MathSciNet  Google Scholar 

  23. Li Y, Zhang Y, Xu X, He L, Serikawa S, Kim H (2019) Dust removal from high turbid underwater images using convolutional neural networks. Opt Laser Technol 110:2–6

    Article  Google Scholar 

  24. Li C, Anwar S, Hou J, Cong R, Guo C, Ren W (2021) Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Trans Image Process 30:4985–5000

    Article  Google Scholar 

  25. Liu Y, Rong S, Cao X, Li T, He B (2020) Underwater single image dehazing using the color space dimensionality reduction prior. IEEE Access 8:91116–91128

    Article  Google Scholar 

  26. Lu H, Li Y, Zhang Y, Chen M, Serikawa S, Kim H (2017) Underwater optical image processing: a comprehensive review. Mob Netw Appl 22(6):1204–1211

    Article  Google Scholar 

  27. Lu J, Li N, Zhang S, Yu Z, Zheng H, Zheng B (2019) Multi-scale adversarial network for underwater image restoration. Opt Laser Technol 110:105–113

    Article  Google Scholar 

  28. Luchman S, Viriri S (2021) Underwater image enhancement using adaptive algorithms. In: International workshop on artificial intelligence and pattern recognition. Springer, Cham, pp 316–326

    Google Scholar 

  29. Ma X, Chen Z, Feng Z (2019) Underwater image restoration through a combination of improved dark channel prior and gray world algorithms. J Electronic Imaging 28(5):053033–053033

    Article  Google Scholar 

  30. Malik S, Kumar T (2016) Comparative analysis of edge detection between gray scale and color image. Communications on Applied Electronics (CAE)–ISSN, 2394–4714

  31. Matos F, Menkovski V, Felici F, Pau A, Jenko F, TCV Team, & EUROfusion MST1 Team (2020) Classification of tokamak plasma confinement states with convolutional recurrent neural networks. Nuclear Fusion 60(3):036022

    Article  Google Scholar 

  32. Muniraj M, Dhandapani V (2021) Underwater image enhancement by combining color constancy and dehazing based on depth estimation. Neurocomputing 460:211–230

    Article  Google Scholar 

  33. Poma XS, Riba E, Sappa A (2020) Dense extreme inception network: towards a robust cnn model for edge detection. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 1923–1932

    Google Scholar 

  34. Raveendran S, Patil MD, Birajdar GK (2021) Underwater image enhancement: a comprehensive review, recent trends, challenges and applications. Artif Intell Rev 54(7):5413–5467

    Article  Google Scholar 

  35. Sahu S, Singh AK, Ghrera SP, Elhoseny M (2019) An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE. Opt Laser Technol 110:87–98

    Article  Google Scholar 

  36. Saleh A, Sheaves M, Jerry D, Azghadi MR (2022) Adaptive uncertainty distribution in deep learning for unsupervised underwater image enhancement. arXiv preprint arXiv:2212.08983

  37. Shi D, Ma L, Liu R, Fan X, Luo Z (2021) Semantic-driven context aggregation network for underwater image enhancement. In: Chinese conference on pattern recognition and computer vision (PRCV). Springer, Cham, pp 29–40

    Google Scholar 

  38. Song W, Wang Y, Huang D, Tjondronegoro D (2018) A rapid scene depth estimation model based on underwater light attenuation prior for underwater image restoration. In: Pacific rim conference on multimedia. Springer, Cham, pp 678–688

    Google Scholar 

  39. Thukral R, Kumar A, Arora AS (2019) Effect of different thresholding techniques for denoising of emg signals by using different wavelets. In: 2019 2nd international conference on intelligent communication and computational techniques (ICCT). IEEE, pp 161–165

    Chapter  Google Scholar 

  40. Thukral R, Arora AS, Kumar A (2022) Denoising of thermal images using deep neural network. In: Proceedings of international conference on recent trends in computing: ICRTC 2021. Springer Nature Singapore, Singapore, pp 827–833

    Chapter  Google Scholar 

  41. Yang M, Hu K, Du Y, Wei Z, Sheng Z, Hu J (2020) Underwater image enhancement based on conditional generative adversarial network. Signal Process Image Commun 81:115723

    Article  Google Scholar 

Download references

Acknowledgments

The authors are grateful for the collaborative funding support from the Shandong Natural Science Foundation of China (ZR2021MD063).

Funding

This work was supported by Shandong Natural Science Foundation of China (ZR2021MD063).

Author information

Authors and Affiliations

  1. College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China

    Geng-Kun Wu, Jie Xu, Yi-Dan Zhang & Bei-Ping Zhang

  2. Shandong Province Key Laboratory of Wisdom Mine Information Technology, Shandong University of Science and Technology, Qingdao, 266590, China

    Geng-Kun Wu

Authors
  1. Geng-Kun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi-Dan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bei-Ping Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Geng-Kun Wu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, GK., Xu, J., Zhang, YD. et al. Underwater enhancement computing of ocean HABs based on cyclic color compensation and multi-scale fusion. Multimed Tools Appl 83, 16657–16681 (2024). https://doi.org/10.1007/s11042-023-16258-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16258-0

Keywords

Search

Navigation