Skip to main content
SpringerLink
Log in

An Intelligent Multimodal Medical Image Fusion Model Based on Improved Fast Discrete Curvelet Transform and Type-2 Fuzzy Entropy

  • Published:
International Journal of Fuzzy Systems Aims and scope Submit manuscript

Abstract

Multi-modal medical image fusion has emerged as a famous and efficient tool in medical applications. The major goal of this fusion is to fuse diverse multi-modal medical images attained from varied imaging modalities into a single fused image, which is broadly utilized by surgeons for the precise diagnosis and treatment of diseases. Multi-modal medical images generally consist of captured images with the specific organ of a patient. These images will indicate a modality, which will provide the observed organ in a different way that leads to dissimilar examinations of a specific incident like stroke. The detection with more suitable clinical decisions is taken by the accurate analysis of each modality. Multi-modal medical imaging is an efficient research area that incorporates the improvement of robust techniques, which can facilitate the information of image fusion attained with diverse sets of modalities. The major goal of this paper is to develop the multi-modal medical image fusion model using the new hybrid meta-heuristic approach. At first, the high-frequency sub-bands and low frequency sub-bands of the images that to be fused split by the weighted fast discrete curvelet transform (W-FDCuT). Once the sub-bands are split, the high-frequency sub-bands of the two images are fused by the optimized Type-2 fuzzy entropy. On the other hand, Averaging approach is used for performing the fusion of low frequency sub-bands. Finally, the inverse W-FDCuT is done for generating the final fused image. To improvise the performance of W-FDCuT and Type-2 fuzzy entropy, the hybrid meta-heuristic algorithm named hybrid jaya with sun flower optimization (HJ-SFO) is adopted, thus enhances the significant parameters by maximizing the structural similarity index measure (SSIM). The comparison over the conventional image fusion models proves the efficiency of the proposed model in terms of diverse analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Zhu, Z., Zheng, M., Qi, G., Wang, D., Xiang, Y.: A phase congruency and local laplacian energy based multi-modality medical image fusion method in NSCT domain. IEEE Access 7, 20811–20824 (2019)

    Article  Google Scholar 

  2. Daniel, E.: Optimum wavelet-based homomorphic medical image fusion using hybrid genetic-grey wolf optimization algorithm. IEEE Sens. J. 18(16), 6804–6811 (2018)

    Article  Google Scholar 

  3. Sabuncu, M.R., Yeo, B.T.T., Van Leemput, K., Fischl, B., Golland, P.: A generative model for image segmentation based on label fusion. IEEE Trans. Med. Imaging 29(10), 1714–1729 (2010)

    Article  Google Scholar 

  4. Yang, Y., Que, Y., Huang, S., Lin, P.: Multimodal sensor medical image fusion based on type-2 fuzzy logic in NSCT domain. IEEE Sens. J. 16(10), 3735–3745 (2016)

    Article  Google Scholar 

  5. Yang, Y., Wu, J., Huang, S., Fang, Y., Lin, P., Que, Y.: Multimodal medical image fusion based on fuzzy discrimination with structural patch decomposition. IEEE J. Biomed. Health Inform. 23(4), 1647–1660 (2019)

    Article  Google Scholar 

  6. Zhu, R., Li, X., Zhang, X., Ma, M.: MRI and CT medical image fusion based on synchronized-anisotropic diffusion model. IEEE Access 8, 91336–91350 (2020)

    Article  Google Scholar 

  7. Wang N, Quan H (2021) GLUNet: global-local fusion U-net for 2D medical image segmentation. In: International conference on artificial neural networks, pp. 74–85. Springer, Cham

  8. Kong, W., Miao, Q., Lei, Y.: Multimodal sensor medical image fusion based on local difference in non-subsampled domain. IEEE Trans. Instrum. Meas. 68(4), 938–951 (2019)

    Article  Google Scholar 

  9. Yin, H.: Tensor sparse representation for 3-D medical image fusion using weighted average rule. IEEE Trans. Biomed. Eng. 65(11), 2622–2633 (2018)

    Article  Google Scholar 

  10. Gai, D., Shen, X., Cheng, H., Chen, H.: Medical image fusion via PCNN based on edge preservation and improved sparse representation in NSST domain. IEEE Access 7, 85413–85429 (2019)

    Article  Google Scholar 

  11. Jin, X., et al.: Brain medical image fusion using L2-norm-based features and fuzzy-weighted measurements in 2-D littlewood-paley EWT domain. IEEE Trans. Instrum. Meas. 69(8), 5900–5913 (2020)

    Article  Google Scholar 

  12. Asha, C.S., Lal, S., Gurupur, V.P., Saxena, P.U.P.: Multi-modal medical image fusion with adaptive weighted combination of NSST bands using chaotic grey wolf optimization. IEEE Access 7, 40782–40796 (2019)

    Article  Google Scholar 

  13. Singh, S., Anand, R.S.: Multimodal medical image fusion using hybrid layer decomposition with CNN-based feature mapping and structural clustering. IEEE Trans. Instrum. Meas. 69(6), 3855–3865 (2020)

    Article  Google Scholar 

  14. Alenezi, F., Salari, E.: A fuzzy-based medical image fusion using a combination of maximum selection and gabor filters. Int. J. Sci. Eng. Res. 9(3), 118–128 (2018)

    Google Scholar 

  15. Perfilieva, I., et al.: Fuzzy transform in the analysis of data. Int. J. Approx. Reason. 48(1), 36–46 (2008)

    Article  MATH  Google Scholar 

  16. Nandal, A., Rosales, H.G.: Enhanced image fusion using directional contrast rules in fuzzy transform domain. Springer Plus (2016). https://doi.org/10.1186/s40064-016-3511-8

    Article  Google Scholar 

  17. Perfiljeva, I., et al.: F-transform based image fusion. Commun. Comput. Inf. Sci. (2011). https://doi.org/10.1007/978-3-319-08855-6_16

    Article  Google Scholar 

  18. Al-Azzawi, N.A.: Color medical imaging fusion based on principle component analysis and F-transform. Pattern Recognit. Image Anal. 28, 393–399 (2018)

    Article  Google Scholar 

  19. Wang, L., Li, B., Tian, L.-F.: EGGDD: an explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain. Inf Fusion 19, 29–37 (2014)

    Article  Google Scholar 

  20. Ullah, H., Ullah, B., Wu, L., Abdalla, F.Y.O., Ren, G., Zhao, Y.: Multi-modality medical images fusion based on local-features fuzzy sets and novel sum-modified-Laplacian in non-subsampled shearlet transform domain. Biomed Signal Process Control 57, 101724 (2020)

    Article  Google Scholar 

  21. Kong, W., Chen, Y., Lei, Y.: Medical image fusion using guided filter random walks and spatial frequency in framelet domain. Signal Process 181, 107921 (2020)

    Article  Google Scholar 

  22. Li, B., Peng, H., Wang, J.: A novel fusion method based on dynamic threshold neural P systems and nonsubsampled contourlet transform for multi-modality medical images. Signal Process 178, 107793 (2021)

    Article  Google Scholar 

  23. Fu, J., Li, W., Du, J., Xiao, B.: Multi-modal medical image fusion via laplacian pyramid and convolutional neural network reconstruction with local gradient energy strategy. Comput Biol Med 126, 104048 (2020)

    Article  Google Scholar 

  24. Yin, M., Liu, X., Liu, Y., Chen, X.: Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain. IEEE Trans Instrum Meas 68(1), 49–64 (2019)

    Article  Google Scholar 

  25. Wang, Z., Cuia, Z., Zhu, Y.: Multi-modal medical image fusion by Laplacian pyramid and adaptive sparse representation. Comput. Biol. Med. 123, 1038 (2020)

    Article  Google Scholar 

  26. Zhou, T., Fu, H., Chen, G., Shen, J., Shao, L.: Hi-net: hybrid-fusion network for multi-modal MR image synthesis. IEEE Trans. Med. Imaging 39(9), 2772–2781 (2020)

    Article  Google Scholar 

  27. Wang, Z., Li, X., Duan, H., Su, Y., Zhang, X., Guan, X.: Medical image fusion based on convolutional neural networks and non-subsampled contourlet transform. Expert Syst Appl 171, 114574 (2021)

    Article  Google Scholar 

  28. Li, Y., Zhao, J., Lv, Z., Pan, Z.: Multimodal medical supervised image fusion method by CNN. Front Neurosci 15, 638976 (2021)

    Article  Google Scholar 

  29. Jose, J., Gautam, N., Tiwari, M., Tiwari, T., Suresh, A., Sundararaj, V., Rejeesh, M.R.: An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multi-modal medical image fusion. Biomed Signal Process Control 66, 102480 (2021)

    Article  Google Scholar 

  30. Singh, S., Gupta, D.: Multistage multi-modal medical image fusion model using feature-adaptive pulse coupled neural network. Int. J. Imaging Syst. Technol. 31(2), 981–1001 (2021)

    Article  Google Scholar 

  31. Venkata Rao, R.: Jaya: a simple and new optimization algorithm for solving constrained and unconstrained optimization problems. Int J Ind Eng Comput 7, 19–34 (2016)

    Google Scholar 

  32. Ferreira Gomes, G., Simões da Cunha Jr, S., Ancelotti Jr, A.C.: A sunflower optimization (SFO) algorithm applied to damage identification on laminated composite plates. Eng. Comput. 35, 619–626 (2019)

    Article  Google Scholar 

  33. Marsaline Beno, M., Valarmathi, I.R., Swamy, S.M., Rajakumar, B.R.: Threshold prediction for segmenting tumour from brain MRI scans. Int. J. Imaging Syst. Technol. 24(2), 129–137 (2014)

    Article  Google Scholar 

  34. Muthu Krishnammal, P., Selvakumar Raja, S.: Medical image segmentation using fast discrete curvelet transform and classification methods for MRI brain images. Multimed. Tools Appl. 79, 10099–10122 (2020)

    Article  Google Scholar 

  35. Yang, Y., Park, D.S., Huang, S., et al.: Medical image fusion via an effective wavelet-based approach. EURASIP J. Adv. Signal Process. (2010). https://doi.org/10.1155/2010/579341

    Article  Google Scholar 

  36. Wang, J.S., Li, S.X.: An improved grey wolf optimizer based on differential evolution and elimination mechanism. Sci. Rep. (2019). https://doi.org/10.1038/s41598-019-43546-3

    Article  Google Scholar 

  37. Mirjalili, S., Gandomi, A.H., Mirjalili, S.Z., Saremi, S., Faris, H., Mirjalili, S.M.: Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv. Eng. Softw. 114, 163–191 (2017)

    Article  Google Scholar 

  38. T Wang, L Yang, Q Liu (2018) Beetle swarm optimization algorithm: theory and application. Neural Evol Comput

  39. Batur, E., Maktav, D.: Assessment of surface water quality by using satellite images fusion based on PCA method in the Lake Gala, Turkey. IEEE Trans. Geosci. Remote Sens. 57(5), 2983–2989 (2019)

    Article  Google Scholar 

  40. Anoop Suraj, A., Francis, M., Kavya, T.S., Nirmal, T.M.: Discrete wavelet transform based image fusion and de-noising in FPGA. J. Electr. Syst. Inf. Technol. 1(1), 72–81 (2014)

    Article  Google Scholar 

  41. Al-Wassai, F.A., Kalyankar, N.V., Al-Zuk, A.A.: The IHS transformations based image fusion. Comput Vis Pattern Recog (2011)

  42. Naidu, V.P.S.: Discrete cosine transform based image fusion techniques. J. Commun. Navig. Signal Process. 1, 35–45 (2012)

    Google Scholar 

  43. El-Hoseny, H.M., El-Rahman, W.A., El-Rabaie, E.-S.M., El-Samie, F.E.A., Faragallah, O.S.: An efficient DT-CWT medical image fusion system based on modified central force optimization and histogram matching. Infrared Phys. Technol. 94, 223–231 (2018)

    Article  Google Scholar 

  44. Kong, W., Lei, Y., Lei, Y., Ni, X.: Fusion technique for grey-scale visible light and infrared images based on non-subsampled contourlet transform and intensity-hue-saturation transform. IET Signal Proc. 5(1), 75–80 (2011)

    Article  Google Scholar 

  45. Nagaraja Kumar, N., Jayachandra Prasad, T., Satya Prasad, K.: Optimized dual tree complex wavelet transform and fuzzy entropy for multimodal medical image fusion: a hybrid meta-heuristic concept. J. Mech. Med. Biol. 21, 2150024 (2020)

    Article  Google Scholar 

  46. Tao, J., Li, S., Yang, B.: Multimodal image fusion algorithm using dual-tree complex wavelet transform and particle swarm optimization. In: Huang, D.S., et al. (eds.) Advanced Intelligent Computing Theories and Applications, pp. 296–303. Springer, Berlin (2010)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of E.C.E, JNTUK, Kakinada, Andhra Pradesh, 533003, India

    N. Nagaraja Kumar

  2. Department of E.C.E, RGMCET, Nandyal, Andhra Pradesh, 518112, India

    T. Jayachandra Prasad

  3. Rector of Vignan’s Foundation for Science, Technology and Research, Guntur, Andhra Pradesh, India

    K. Satya Prasad

Authors
  1. N. Nagaraja Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. T. Jayachandra Prasad
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. Satya Prasad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to N. Nagaraja Kumar.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nagaraja Kumar, N., Jayachandra Prasad, T. & Prasad, K.S. An Intelligent Multimodal Medical Image Fusion Model Based on Improved Fast Discrete Curvelet Transform and Type-2 Fuzzy Entropy. Int. J. Fuzzy Syst. 25, 96–117 (2023). https://doi.org/10.1007/s40815-022-01379-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40815-022-01379-9

Keywords

Search

Navigation