Skip to main content
SpringerLink
Log in

Fractional wavelet combined with multi-scale morphology and PCNN hybrid algorithm for grayscale image fusion

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Grayscale image fusion is an important part of the digital image processing field, which is important for the integration of image information. This paper proposes a hybrid algorithm that addresses the problem of unclear edges caused by traditional image fusion algorithms. The proposed algorithm combines the discrete fractional wavelet transform with multi-scale morphology and the pulse coupled neural network. The hybrid algorithm employs discrete fractional wavelet transform to decompose the source images and obtain subbands that include both high- and low-frequency components. An image enhancement method, enhanced by multi-scale morphological operations, is developed to process the low-frequency subband. Additionally, a simplified pulse coupled neural network method is employed to adapt the high-frequency components and generate the high-frequency decision map. Fused images show that proposed algorithm effectively suppresses the Gibbs effect. Simulation experiments confirm that the fusion effect of the hybrid algorithm in this paper is better than the existing five classical algorithms, indicating that the hybrid algorithm is an efficient grayscale image fusion method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

  1. Mitchell, H.B.: Image Fusion: Theories Techniques and Applications. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-11216-4

    Book  Google Scholar 

  2. Fourati, H.: Multisensor Data Fusion: From Algorithms and Architectural Design to Applications. CRC Press, Boca Raton (2016). https://doi.org/10.1201/b18851

    Book  Google Scholar 

  3. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 4th edn. Pearson, New York (2018)

    Google Scholar 

  4. Li, J., Yang, Y., Dang, J., Wang, Y.: Multi-focus image fusion based on NSCT and guided filtering. Laser Optoelectron. Progress (2018). https://doi.org/10.3788/LOP55.071007

    Article  Google Scholar 

  5. Kong, W., Lei, Y., Zhao, R.: Fusion technique for multi-focus images based on NSCT–ISCM. Optik (2015). https://doi.org/10.1016/j.ijleo.2015.07.142

    Article  Google Scholar 

  6. Liu, S., Shi, M., Zhao, J., Geng, P., Zhang, Z.: Multi-focus image fusion based on nonsubsampled shearlet transform and pulse coupled neural network with self-similarity and depth information. Int. J. Appl. Math. Mach. Learn. 1, 1 (2015). https://doi.org/10.18642/ijamml_7100121449

    Article  Google Scholar 

  7. Chen, C., Geng, P., Lu, K.: Multifocus image fusion based on multiwavelet and dfb. Chem. Eng. Trans. (2015). https://doi.org/10.3303/CET1546047

    Article  Google Scholar 

  8. Geng, P., Sun, X., Liu, J.: Adopting quaternion wavelet transform to fuse multi-modal medical images. J. Med. Biol. Eng. (2017). https://doi.org/10.1007/s40846-016-0200-6

    Article  Google Scholar 

  9. Tang, M., Liu, C., Wang, X.P.: Autofocusing and image fusion for multi-focus plankton imaging by digital holographic microscopy. Appl. Opt. (2020). https://doi.org/10.1364/AO.59.000333

    Article  Google Scholar 

  10. Xiao, B., Xu, B., Bi, X., Li, W.: Global-feature encoding U-Net (GEU-Net) for multi-focus image fusion. IEEE Trans. Image Process. (2021). https://doi.org/10.1109/TIP.2020.3033158

    Article  Google Scholar 

  11. Zhang, Y., Jin, M., Huang, G.: Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map. Biomed. Signal Process. Control (2022). https://doi.org/10.1016/j.bspc.2022.103535

    Article  Google Scholar 

  12. Babu, B.S., Dr. Venkatanarayana, M.: MRI and CT image fusion using cartoon-texture and QWT decomposition and cuckoo search-grey wolf optimization. Multimed. Tools Appl. (2023). https://doi.org/10.1007/s11042-023-15636-y

    Article  Google Scholar 

  13. Shi, J., Liu, X., Zhang, N.: Multiresolution analysis and orthogonal wavelets associated with fractional wavelet transform. Signal Image Video Process. (2015). https://doi.org/10.1007/s11760-013-0498-2

    Article  Google Scholar 

  14. Xu, X., Wang, Y., Chen, S.: Medical image fusion using discrete fractional wavelet transform. Biomed. Signal Process. Control (2016). https://doi.org/10.1016/j.bspc.2016.02.008

    Article  Google Scholar 

  15. Li, C., Yang, X.: Multifocus image fusion method using discrete fractional wavelet transform and improved fusion rules. J. Mod. Opt. (2021). https://doi.org/10.1080/09500340.2021.1890250

    Article  MathSciNet  Google Scholar 

  16. Zhang, C., Cao, Y., Yang, X.: Multi-focus image fusion method based on fractional wavelet combined with guided filtering (In Chinese). J. Gr. (2023). https://doi.org/10.11996/JG.j.2095-302X.2023010077

    Article  Google Scholar 

  17. Soille, P.: Morphological Image Analysis: Principles and Applications, 2nd edn. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-662-05088-0

    Book  Google Scholar 

  18. Jiang, Y., Wang, M.: Image fusion with morphological component analysis. Information Fusion. (2014). https://doi.org/10.1016/j.inffus.2013.06.001

    Article  Google Scholar 

  19. Sazak, Ç., Nelson, C.J., Obara, B.: The multiscale bowler-hat transform for blood vessel enhancement in retinal images. Pattern Recogn. (2019). https://doi.org/10.1016/j.patcog.2018.10.011

    Article  Google Scholar 

  20. Tan, W., Xiang, P., Zhang, J., Zhou, H., Qin, H.: Remote sensing image fusion via boundary measured dual-channel PCNN in multi-scale morphological gradient domain. IEEE Access (2020). https://doi.org/10.1109/ACCESS.2020.2977299

    Article  Google Scholar 

  21. Li, S., Zou, Y., Wang, G., Lin, C.: Infrared and visible image fusion method based on principal component analysis network and multi-scale morphological gradient. Infrar. Phys. Technol. (2023). https://doi.org/10.1016/j.infrared.2023.104810

    Article  Google Scholar 

  22. Jin, X., Zhang, P., He, Y., Jiang, Q., Wang, P., Hou, J., Zhou, W., Yao, S.: A theoretical analysis of continuous firing condition for pulse-coupled neural networks with its applications. Eng. Appl. Artif. Intell. (2023). https://doi.org/10.1016/j.engappai.2023.107101

    Article  Google Scholar 

  23. Wang, Z., Ma, Y., Gu, J.: Multi-focus image fusion using PCNN. Pattern Recogn. (2010). https://doi.org/10.1016/j.patcog.2010.01.011

    Article  Google Scholar 

  24. Cheng, S., Qiguang, M., Pengfei, X.: A novel algorithm of remote sensing image fusion based on shearlets and PCNN. Neurocomputing (2013). https://doi.org/10.1016/j.neucom.2012.10.025

    Article  Google Scholar 

  25. Liu, X., Mei, W., Du, H.: Multimodality medical image fusion algorithm based on gradient minimization smoothing filter and pulse coupled neural network. Biomed. Signal Process. Control (2016). https://doi.org/10.1016/j.bspc.2016.06.013

    Article  Google Scholar 

  26. Geng, P., Wang, Z., Zhang, Z., Xiao, Z.: Image fusion by pulse couple neural network with shearlet. Opt. Eng. (2012). https://doi.org/10.1117/1.OE.51.6.067005

    Article  Google Scholar 

  27. Jin, X., Zhou, D., Yao, S., Nie, R., Jiang, Q., He, K., Wang, Q.: Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization. Soft. Comput. (2018). https://doi.org/10.1007/s00500-017-2694-4

    Article  Google Scholar 

  28. Panigrahy, C., Seal, A., Mahato, N.K.: MRI and SPECT image fusion using a weighted parameter adaptive dual channel PCNN. IEEE Signal Process. Lett. (2020). https://doi.org/10.1109/LSP.2020.2989054

    Article  Google Scholar 

  29. Wang, M., Shang, X.: An improved simplified PCNN model for salient region detection. Vis. Comput. (2022). https://doi.org/10.1007/s00371-020-02020-2

    Article  Google Scholar 

  30. Vajpayee, P., Panigrahy, C., Kumar, A.: Medical image fusion by adaptive Gaussian PCNN and improved Roberts operator. Signal Image Video Process. (2023). https://doi.org/10.1007/s11760-023-02581-4

    Article  Google Scholar 

  31. Nie, R., Cao, J., Zhou, D., Qian, W.: Multi-source information exchange encoding with PCNN for medical image fusion. IEEE Trans. Circuits Syst. Video Technol. (2021). https://doi.org/10.1109/TCSVT.2020.2998696

    Article  Google Scholar 

  32. Chen, J., Li, X., Luo, L., Ma, J.: Multi-focus image fusion based on multi-scale gradients and image matting. IEEE Trans. Multimedia (2022). https://doi.org/10.1109/TMM.2021.3057493

    Article  Google Scholar 

  33. Wang, X., Li, Z., Kang, H., Huang, Y., Gai, D.: Medical image segmentation using PCNN based on multi-feature grey wolf optimizer bionic algorithm. J. Bionic Eng. (2021). https://doi.org/10.1007/s42235-021-0049-4

    Article  Google Scholar 

  34. Zhang, Y., Bai, X., Wang, T.: Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure. Inf. Fus. (2017). https://doi.org/10.1016/j.inffus.2016.09.006

    Article  Google Scholar 

  35. Ganasala, P., Kumar, V.: Feature-motivated simplified adaptive PCNN-based medical image fusion algorithm in NSST domain. J. Imag. Inf. Med. (2016). https://doi.org/10.1007/s10278-015-9806-4

    Article  Google Scholar 

  36. Liu, Y., Wang, L., Cheng, J., Li, C., Chen, X.: Multi-focus image fusion: A Survey of the state of the art. Inf. Fus. (2020). https://doi.org/10.1016/j.inffus.2020.06.013

    Article  Google Scholar 

  37. Liu, F., Chen, L., Lu, L., Ahmad, A., Jeon, G., Yang, X.: Medical image fusion method by using laplacian pyramid and convolutional sparse representation. Concurr. Comput. Pract. Experience (2020). https://doi.org/10.1002/cpe.5632

    Article  Google Scholar 

  38. Singh, S., Singh, H., Gehlot, A., Kaur, J.: Gagandeep: IR and visible image fusion using DWT and bilateral filter. Microsyst. Technol. (2023). https://doi.org/10.1007/s00542-022-05315-7

    Article  Google Scholar 

  39. Roy, M., Mukhopadhyay, S.: A DCT-based multiscale framework for 2D greyscale image fusion using morphological differential features. Vis. Comput. (2023). https://doi.org/10.1007/s00371-023-03052-0

    Article  Google Scholar 

  40. Ullah, H., Zhao, Y., Abdalla, F.Y.O., Wu, L.: Fast local laplacian filtering based enhanced medical image fusion using parameter-adaptive PCNN and local features-based fuzzy weighted matrices. Appl. Intell. (2022). https://doi.org/10.1007/s10489-021-02834-0

    Article  Google Scholar 

  41. Ding, S., Zhao, X., Xu, H., Zhu, Q., Xue, Y.: NSCT-PCNN image fusion based on image gradient motivation. IET Comput. Vision (2018). https://doi.org/10.1049/iet-cvi.2017.0285

    Article  Google Scholar 

  42. Mitianoudis, N., Stathaki, T.: Pixel-based and region-based image fusion schemes using ICA bases. Inf. Fus. (2007). https://doi.org/10.1016/j.inffus.2005.09.001

    Article  Google Scholar 

Download references

Funding

This work is supported in part by the National Natural Science Foundation of China (Grant No. 11371135).

Author information

Authors and Affiliations

  1. Institute of Information and Computation, School of Mathematics and Physics, North China Electric Power University, Beijing, 102206, China

    Minghang Xie, Ziyun Liu & Xiaozhong Yang

  2. School of Control and Computer Engineering, North China Electric Power University, Beijing, 102206, China

    Chenyang Zhang

Authors
  1. Minghang Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chenyang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ziyun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaozhong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Minghang Xie contributed to the study conception and design, data collection and analysis. The first draft of the manuscript was written by Minghang Xie and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Xiaozhong Yang.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, M., Zhang, C., Liu, Z. et al. Fractional wavelet combined with multi-scale morphology and PCNN hybrid algorithm for grayscale image fusion. SIViP (2024). https://doi.org/10.1007/s11760-024-03137-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03137-w

Keywords

Search

Navigation