Skip to main content
SpringerLink
Log in

Multi-image fusion: optimal decomposition strategy with heuristic-assisted non-subsampled shearlet transform for multimodal image fusion

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Image fusion is significant in various distinct sectors of image processing, from remote sensing to medical applications. In recent years, real-valued wavelet transforms have been utilized to fuse images. This approach has offered enhancements against various poor approaches; however, this task lacks the shift variance and suffers from the directionality connected with its wavelet bases. Moreover, the conventional architecture of this hard wavelet decomposition implements a very hard resolution of filters to attain an essential quarter shift in the coefficient result. The establishment of image fusion methodology is to provide data integrated from distinct images to avoid inconsistency and redundancy presented among the images. This approach is utilized to enhance the utilization, reliability, accuracy, and interpretation of the data with the development of image data transparency by creating an accurate and clear detail of the monitored target. In this research work, a transform-aided image fusion mechanism is utilized to enhance the effectiveness in a better way. With the support of this approach, good “peak signal-to-noise ratio (PSNR)” with a minimum “mean square error (MSE)” can be achieved. Therefore, this work is aimed to implement a new multi-image fusion approach by fusing the normal images. Initially, the standard normal images are manually collected for the approach. Then, the decomposition of two images in the same scene is done through “optimal non-subsampled shearlet transform (ONSST),” where the attributes of NSST are optimized with the help of recommended fitness improved puzzle optimization algorithm (FIPOA). Moreover, the high-frequency fusion is done by optimal weighted average fusion, and low-frequency fusion is carried out by filter mapping-based fusion. In the end, the inverse ONSST is taken to get the final integrated images. The experimental analysis of the recommended approach is evaluated with various performance measures. The validation shows that the developed model attains 44.7%, 6.18%, 17.4%, 17.4%, and 9.7% enhanced performance than DOX-ONSST, AOA-ONSST, SFO-ONSST, and POA-ONSST in terms of standard deviation. The experimental analysis of the developed model shows better performance rather than the existing approaches. The image fusion is widely applicable in the field of clinical and healthcare applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data availability

The suggested multimodal image fusion approach utilized the manually collected dataset.

References

  1. Chen, C.I.: Fusion of PET and MR brain images based on IHS and log-Gabor transforms. IEEE Sens. J. 17(21), 6995–7010 (2017)

    Article  ADS  Google Scholar 

  2. Xu, X., Wang, Y., Chen, S.: Medical image fusion using discrete fractional wavelet transform. Biomed. Signal Process. Control. 27, 103–111 (2016)

    Article  Google Scholar 

  3. Chai, P., Luo, X., Zhang, Z.: Image fusion using quaternion wavelet transform and multiple features. IEEE Access 5, 6724–6734 (2017)

    Article  Google Scholar 

  4. Lifeng, Y., Donglin, Z., Weidong, W., Shanglian, B.: Multi-modality medical image fusion based on wavelet analysis and quality evaluation. J. Syst. Eng. Electron. 12(1), 42–48 (2016)

    Google Scholar 

  5. Wang, L., Li, B., Tian, L.F.: EGGDD: an explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain. Inform. Fusion 19, 29–37 (2014)

    Article  Google Scholar 

  6. Yang, Y., Que, Y., Huang, S., Lin, P.: Multimodal sensor medical image fusion based on type-2 Fuzzy logic in NSCT domain. IEEE Sens. J. 16(10), 3735–3745 (2016)

    Article  ADS  Google Scholar 

  7. Du, J., Li, W., Xiao, B., Nawaz, Q.: Union Laplacian pyramid with multiple features for medical image fusion. Neurocomputing 194, 326–339 (2016)

    Article  Google Scholar 

  8. Bhatnagar, G., Wu, Q.M.J., Liu, Z.: Human visual system inspired multi-modal medical image fusion framework. Expert Syst. Appl. 40(5), 1708–1720 (2013)

    Article  Google Scholar 

  9. Das, S., Kundu, M.K.: A neuro-fuzzy approach for medical image fusion. IEEE Trans. Biomed. Eng. 60(12), 3347–3353 (2013)

    Article  PubMed  Google Scholar 

  10. Parisotto, S., Calatroni, L., Bugeau, A., Papadakis, N., Schönlieb, C.-B.: Variational osmosis for non-linear image fusion. IEEE Trans. Image Process. 29, 5507–5516 (2020)

    Article  ADS  Google Scholar 

  11. Hou, B., Wei, Q., Zheng, Y., Wang, S.: Unsupervised change detection in SAR image based on gauss-log ratio image fusion and compressed projection. IEEE J. Select. Topics Appl. Earth Observat. Remote Sens. 7(8), 3297–3317 (2014)

    Article  ADS  Google Scholar 

  12. Wang, G., Li, W., Gao, X., Xiao, B., Du, J.: Functional and anatomical image fusion based on gradient enhanced decomposition model. IEEE Trans. Instrum. Meas. 71, 1–14 (2022)

    Article  Google Scholar 

  13. Liu, P., Zhang, L., Li, M., Zhang, X.: An efficient algorithm to highlight details in infrared and visible image fusion. IEEE Access 9, 110223–110235 (2021)

    Article  Google Scholar 

  14. Kumar, M., Dass, S.: A total variation-based algorithm for pixel-level image fusion. IEEE Trans. Image Process. 18(9), 2137–2143 (2009)

    Article  ADS  MathSciNet  PubMed  Google Scholar 

  15. Zhu, R., Li, X., Zhang, X., Wang, J.: HID: the hybrid image decomposition model for MRI and CT fusion. IEEE J. Biomed. Health Inform. 26(2), 727–739 (2022)

    Article  PubMed  Google Scholar 

  16. Du, J., Li, W., Tan, H.: Three-layer image representation by an enhanced illumination-based image fusion method. IEEE J. Biomed. Health Inform. 24(4), 1169–1179 (2020)

    Article  PubMed  Google Scholar 

  17. Zhang, K., Wang, M., Yang, S., Jiao, L.: Convolution structure sparse coding for fusion of panchromatic and multispectral images. IEEE Trans. Geosci. Remote Sens. 57(2), 1117–1130 (2019)

    Article  ADS  Google Scholar 

  18. Duan, Z., Zhang, T., Luo, X., Tan, J.: DCKN: multi-focus image fusion via dynamic convolutional kernel network. Signal Process. 189, 108282 (2021)

    Article  Google Scholar 

  19. You, C.-S., Yang, S.-Y.: A simple and effective multi-focus image fusion method based on local standard deviations enhanced by the guided filter. Displays 72, 102146 (2022)

    Article  Google Scholar 

  20. Huang, D., Liu, J., Zhou, S., Tang, W.: Deep unsupervised endoscopic image enhancement based on multi-image fusion. Comput. Methods Progr. Biomed. 221, 106800 (2022)

    Article  Google Scholar 

  21. Boyuan, M., Yu, Z., Xiang, Y., Xiaojuan, B., Haiyou, H., Michele, M.: SESF-Fuse: an unsupervised deep model for multi-focus image fusion. Neural Comput. Appl. 33, 5793–5804 (2021)

    Article  Google Scholar 

  22. Yang, Y., Wu, J., Huang, S., Fang, Y., Lin, P., Que, Y.: Multimodal medical image fusion based on fuzzy discrimination with structural patch decomposition. IEEE J. Biomed. Health Inform. 23(4), 1647–1660 (2019)

    Article  PubMed  Google Scholar 

  23. Zuo, Q., Zhang, J., Yang, Y.: DMC-fusion: deep multi-cascade fusion with classifier-based feature synthesis for medical multi-modal images. IEEE J. Biomed. Health Inform. 25(9), 3438–3449 (2021)

    Article  PubMed  Google Scholar 

  24. Duan, J., Mao, S., Jin, J., Zhou, Z., Chen, L., Chen, C.L.P.: A novel GA-based optimized approach for regional multimodal medical image fusion with superpixel segmentation. IEEE Access 9, 96353–96366 (2021)

    Article  Google Scholar 

  25. Daniel, E.: Optimum wavelet-based homomorphic medical image fusion using hybrid genetic-grey wolf optimization algorithm. IEEE Sens. J. 18(16), 6804–6811 (2018)

    Article  ADS  Google Scholar 

  26. Gao, G., Xu, L., Feng, D.: Multi-Focus Image Fusion Based on Non-Subsampled Shearlet Transform. Wiley, New Jersey (2013)

    Google Scholar 

  27. Fatemeh, A.Z., Mohammad, D.: POA: puzzle optimization algorithm. Int. J. Intell. Eng. Syst. 15(1), 15826 (2022)

    Google Scholar 

  28. Asha C.S., Shyam L., Varadraj P.G., Prakash Saxena P.U., Multi-modal medical image fusion with adaptive weighted combination of NSST bands using chaotic grey wolf optimization IEEE, (2019)

  29. Liu, S., Wang, J., Lu, Y., Hu, S., Ma, X., Wu, Y.: Multi-focus image fusion based on residual network in non-subsampled shearlet domain. IEEE Access 7, 152043–152063 (2019)

    Article  Google Scholar 

  30. Naidu, V.P.S.: Discrete cosine transform based image fusion techniques. J. Commun. Navig. Signal Process. 1(1), 35–45 (2012)

    Google Scholar 

  31. Yang, Y., Tong, S., Huang, S., Lin, P.: Dual-tree complex wavelet transform and image block residual-based multi-focus image fusion in visual sensor networks. Sensors 14(12), 22408–22430 (2014)

    Article  ADS  PubMed  PubMed Central  Google Scholar 

  32. Nagaraja Kumar, N., Jayachandra Prasad, T., Satya Prasad, K.: Multimodal medical image fusion with improved multi-objective meta-heuristic algorithm with fuzzy entropy. J. Inform. Knowl. Manag. 22, 2250063 (2023)

    Article  Google Scholar 

  33. Zuo, Q., Zhang, J., Yang, Y.: DMC-fusion: deep multi-cascade fusion with classifier-based feature synthesis for medical multi-modal images. IEEE J. Biomed. Health Inform. 25(9), 3438–3449 (2021)

    Article  PubMed  Google Scholar 

  34. Singh, R., Srivastava, R., Prakash, O., Khare, A.: Multimodal medical image fusion in dual-tree complex wavelet transform domain using maximum and average fusion rules. J. Med. Imag. Health Inform. 2, 168–173 (2012)

    Article  Google Scholar 

  35. Bairwa, A.K., Joshi, S., Singh, D.: Dingo optimizer: a nature-inspired metaheuristic approach for engineering problems. Math. Probl. Eng. 9, 1–12 (2021)

    Article  CAS  Google Scholar 

  36. Abualigah, L., Diabat, A., Mirjalili, S., Abd Elaziz, M., Gandomi, A.H.: The arithmetic optimization algorithm. Comput. Methods Appl. Mech. Eng. 376, 113609 (2021)

    Article  ADS  MathSciNet  Google Scholar 

  37. Yuan, Z., Wang, W., Wang, H., Razmjooy, N.: A new technique for optimal estimation of the circuit-based PEMFCs using developed sunflower optimization algorithm. Energy Rep. 6, 662–671 (2020)

    Article  Google Scholar 

  38. Xu, H., Fan, F., Zhang, H., Le, Z., Huang, J.: A deep model for multi-focus image fusion based on gradients and connected regions. IEEE Access 8, 26316 (2020)

    Article  Google Scholar 

  39. Selvakanmani, S., Ashreetha, B.G., Naga, R.D., Shubhrojit, M., Jayavadivel, R., Suresh, B.P.: Deep learning approach to solve image retrieval issues associated with IOT sensors. Measurem. Sens. 24, 100458 (2022)

    Article  Google Scholar 

Download references

Funding

This research did not receive any specific funding.

Author information

Authors and Affiliations

  1. Department of ECE, S.R.K.R. Engineering College, Bhimavaram, A.P, India

    Jampani Ravi, Yadavalli S. S. Sriramam & N. V. Phani Sai Kumar

  2. Department of ECE, Prasad V Potluri Siddhartha Institute of Technology, Vijayawada, A.P, India

    B. V. Subbayamma

  3. Department of ECE, Aditya Engineering College, Surampalem, A.P, India

    P. Vijaya Kumar

  4. Department of EEE, Agni College of Technology, Chennai, India

    S. Marlin

  5. Department of Computer Science and Engineering, St. Joseph’s Institute of Technology, Chennai, India

    Adlin Sheeba

Authors
  1. Jampani Ravi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. B. V. Subbayamma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. P. Vijaya Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yadavalli S. S. Sriramam
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. S. Marlin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Adlin Sheeba
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. N. V. Phani Sai Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have made substantial contributions to conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Jampani Ravi.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Ethics approval

Not applicable.

Consent to publish

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 2949 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ravi, J., Subbayamma, B.V., Kumar, P.V. et al. Multi-image fusion: optimal decomposition strategy with heuristic-assisted non-subsampled shearlet transform for multimodal image fusion. SIViP 18, 2297–2307 (2024). https://doi.org/10.1007/s11760-023-02906-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02906-3

Keywords

Search

Navigation