Skip to main content
SpringerLink
Log in

Multi-modal medical image fusion in NSST domain for internet of medical things

  • 1218: Engineering Tools and Applications in Medical Imaging
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The Internet of Medical Things (IoMT) has included a new layer for development and smart infrastructure growth in the medical field. Besides, the medical data on IoMT systems are constantly expanding due to the rising peripherals in the health system. This paper introduces a new fusion technique in the shearlet domain to improve existing methods, which may provide medical image fusion in the IoMT system. In this paper, firstly low and high frequencies NSST coefficients are obtained of both input images. Over the low frequency component, a new Multi local extrema (MLE) based decomposition is performed to get more detail features (Coarse and detail layers). Over these MLE features saliency based weighted average is performed using co-occurrence filter to get the enhanced low frequency NSST Coefficients. These enhanced low frequency NSST Coefficients of both input images are fused using the proposed weighted function. In high frequency NSST Coefficients, local type-2 fuzzy entropy-based fusion is performed. Finally, inverse NSST is performed to get the final fused image. The experimental results are evaluated and compared with existing methods by visually and also by performance metrics. After a critical analysis, it was found that the results of the proposed method give better outcomes compared to similar and recent existing schemes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Al-Azzawi NA (2015) Medical image fusion based on shearlets and human feature visibility. Int J Comput Appl 125(12):1–12

    Google Scholar 

  2. Bhatnagar G, Wu QJ, Liu Z (2013) Directive contrast based multi-modal medical image fusion in N.S.C.T. domain. IEEE Trans Multimedia 15(5):1014–1024

    Article  Google Scholar 

  3. Bhatnagar G, Wu QJ, Liu Z (2013) Human visual system inspired multi-modal medical image fusion framework. Expert Syst Appl 40(5):1708–1720

    Article  Google Scholar 

  4. Dai Y, Zhou Z, Xu L (2017) The application of multi-modality medical image fusion based method to cerebral infarction. EURASIP J Image Video Process 2017(1):1–16

    Article  Google Scholar 

  5. Diwakar M, Singh P, Shankar A (2021) Multi-modal medical image fusion framework using co-occurrence filter and local extrema in NSST domain. Biomed Signal Process Control 68:102788

    Article  Google Scholar 

  6. Fu J, Li W, Du J, Huang Y (2021) A multiscale residual pyramid attention network for medical image fusion. Biomed Signal Process Control 66:102488

    Article  Google Scholar 

  7. Ganasala P, Kumar V (2014) Multi-modality medical image fusion based on new features in N.S.S.T. domain. Biomed Eng Lett 4(4):414–424

    Article  Google Scholar 

  8. Ganasala P, Kumar V (2016) Feature-motivated simplified adaptive PCNN-based medical image fusion algorithm in N.S.S.T. domain. J Digit Imaging 29(1):73–85

    Article  Google Scholar 

  9. Hermessi H, Mourali O, Zagrouba E (2021) Multimodal medical image fusion review: theoretical background and recent advances. Signal Process 108036:108036

    Article  Google Scholar 

  10. Jin X, Chen G, Hou J, Jiang Q, Zhou D, Yao S (2018) Multi-modal sensor medical image fusion based on nonsubsampled shearlet transform and S-PCNNs in HSV space. Signal Process 153:379–395

    Article  Google Scholar 

  11. Kaur M, Singh D (2020) Multi-modality medical image fusion technique using multi-objective differential evolution based deep neural networks. J Ambient Intell Humaniz Comput:1–11

  12. Khare A, Khare M, Srivastava R (2021) Shearlet transform based technique for image fusion using median fusion rule. Multimed Tools Appl 80(8):11491–11522

    Article  Google Scholar 

  13. Kong W, Liu J (2013) Technique for image fusion based on nonsubsampledshearlet transform and improved pulse-coupled neural network. Opt Eng 52(1):017001

    Article  Google Scholar 

  14. Kong W, Chen Y, Lei Y (2021) Medical image fusion using guided filter random walks and spatial frequency in framelet domain. Signal Process 181:107921

    Article  Google Scholar 

  15. Kumar P, Diwakar M (2020) A novel approach for multi-modality medical image fusion over secure environment. Trans Emerg Telecommun Technol 32:e3985

    Google Scholar 

  16. Li S, Yin H, Fang L (2012) Group-sparse representation with dictionary learning for medical image denoising and fusion. IEEE Trans Biomed Eng 59(12):3450–3459

    Article  Google Scholar 

  17. Li L, Ma H, Jia Z, Si Y (2021) A novel multiscale transform decomposition based multi-focus image fusion framework. Multimed Tools Appl 80(8):12389–12409

    Article  Google Scholar 

  18. Liu Z, Yin H, Chai Y, Yang SX (2014) A novel approach for multi-modal medical image fusion. Expert Syst Appl 41(16):7425–7435

    Article  Google Scholar 

  19. Liu X, Mei W, Du H (2017) Structure tensor and nonsubsampled shearlet transform based algorithm for C.T. and M.R.I. image fusion. Neurocomputing 235:131–139

    Article  Google Scholar 

  20. Liu X, Mei W, Du H (2018) Multi-modality medical image fusion based on image decomposition framework and nonsubsampled shearlet transform. Biomed Signal Process Control 40:343–350

    Article  Google Scholar 

  21. Murthy KN, Kusuma J (2017) Fusion of medical image using S.T.S.V.D. In: Proceedings of the 5th international conference on Frontiers in intelligent computing: theory and applications. Springer, Singapore, pp 69–79

    Google Scholar 

  22. Nair RR, Singh T (2021) An optimal registration on Shearlet domain with novel weighted energy fusion for multi-modal medical images. Optik 225:165742

    Article  Google Scholar 

  23. Parmar K, Kher RK, Thakkar FN (2012) Analysis of C.T. and M.R.I. image fusion using wavelet transform. In: 2012 international conference on communication systems and network technologies. IEEE, pp 124–127

    Chapter  Google Scholar 

  24. Ramlal SD, Sachdeva J, Ahuja CK, Khandelwal N (2018) Multi-modal medical image fusion using non-subsampled shearlet transform and pulse coupled neural network incorporated with morphological gradient. SIViP 12(8):1479–1487

    Article  Google Scholar 

  25. Shehanaz SK, Daniel E, Guntur SR, Satrasupalli S (2021) Optimum weighted multi-modal medical image fusion using particle swarm optimization. Optik 231:166413

    Article  Google Scholar 

  26. Singh R, Srivastava R, Prakash O, Khare A (2012) Multi-modal medical image fusion in dual tree complex wavelet transform domain using maximum and average fusion rules. J Med Imaging Health Inform 2(2):168–173

    Article  Google Scholar 

  27. Subbiah Parvathy V, Pothiraj S, Sampson J (2020) A novel approach in multi-modality medical image fusion using optimal shearlet and deep learning. Int J Imaging Syst Technol 30(4):847–859

    Article  Google Scholar 

  28. Tan W, Tiwari P, Pandey HM, Moreira C, Jaiswal AK (2020) Multi-modal medical image fusion algorithm in the era of big data. Neural Comput & Applic:1–21

  29. Ullah H, Ullah B, Wu L, Abdalla FY, Ren G, Zhao Y (2020) Multi-modality medical images fusion based on local-features fuzzy sets and novel sum-modified-Laplacian in non-subsampled shearlet transform domain. Biomed Signal Process Control 57:101724

    Article  Google Scholar 

  30. Wan S, Xia Y, Qi L, Yang YH, Atiquzzaman M (2020) Automated colorization of a grayscale image with seed points propagation. IEEE Trans Multimedia 22(7):1756–1768

    Article  Google Scholar 

  31. Wang L, Li B, Tian L (2013) Multi-modal medical volumetric data fusion using 3-D discrete shearlet transform and global-to-local rule. IEEE Trans Biomed Eng 61(1):197–206

    Article  Google Scholar 

  32. Wang L, Li B, Tian LF (2014) E.G.G.D.D.: an explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain. Inf Fusion 19:29–37

    Article  Google Scholar 

  33. Xiao-Bo Q, Jing-Wen Y, Hong-Zhi XIAO, Zi-Qian Z (2008) Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampledcontourlet transform domain. ActaAutomaticaSinica 34(12):1508–1514

    Google Scholar 

  34. Xu Z (2014) Medical image fusion using multi-level local extrema. Inf Fusion 19:38–48

    Article  Google Scholar 

  35. Yin M, Liu W, Zhao X, Yin Y, Guo Y (2014) A novel image fusion algorithm based on nonsubsampledshearlet transform. Optik 125(10):2274–2282

    Article  Google Scholar 

  36. Yin M, Liu X, Liu Y, Chen X (2018) Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain. IEEE Trans Instrum Meas 68(1):49–64

    Article  Google Scholar 

  37. Yu K, Tan L, Shang X, Huang J, Srivastava G, Chatterjee P (2020) Efficient and privacy-preserving medical research support platform against covid-19: a blockchain-based approach. IEEE Consum Electron Mag 10(2):111–120

    Article  Google Scholar 

  38. Zhang S, Liu F (2020) Infrared and visible image fusion based on non-subsampled shearlet transform, regional energy, and co-occurrence filtering. Electron Lett 56(15):761–764

    Article  Google Scholar 

  39. Zhang J, Yu K, Wen Z, Qi X, Paul AK (2021) 3D reconstruction for motion blurred images using deep learning-based intelligent systems. CMC-Comput Mater Contin 66(2):2087–2104

    Article  Google Scholar 

  40. Zhao W, Lu H (2017) Medical image fusion and denoising with alternating sequential filter and adaptive fractional order total variation. IEEE Trans Instrum Meas 66(9):2283–2294

    Article  Google Scholar 

  41. Zhen L, Bashir AK, Yu K, Al-Otaibi YD, Foh CH, Xiao P (2020) Energy-efficient random access for LEO satellite-assisted 6G internet of remote things. IEEE Internet Things J 8(7):5114–5128

    Article  Google Scholar 

  42. Zhu R, Li X, Zhang X, Xu X (2021) MRI enhancement based on visual-attention by adaptive contrast adjustment and image fusion. Multimed Tools Appl 80(9):12991–13017

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CSE Department, Graphic Era deemed to be University, Dehradun, Uttarakhand, India

    Manoj Diwakar

  2. Amity School of Engineering and Technology, Amity University Uttar Pradesh, Noida, India

    Achyut Shankar

  3. Birla Institute of Technology, Mesra, Jharkhand, India

    Chinmay Chakraborty

  4. School of Computer Science Engineering and Technology, Bennett University, Greater Noida, India

    Prabhishek Singh

  5. School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Vellore, India

    G. Arunkumar

Authors
  1. Manoj Diwakar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Achyut Shankar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chinmay Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Prabhishek Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. Arunkumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Prabhishek Singh.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Diwakar, M., Shankar, A., Chakraborty, C. et al. Multi-modal medical image fusion in NSST domain for internet of medical things. Multimed Tools Appl 81, 37477–37497 (2022). https://doi.org/10.1007/s11042-022-13507-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13507-6

Keywords

Search

Navigation