Skip to main content
SpringerLink
Log in

Performance enhanced hyperspectral and multispectral image fusion technique using ripplet type-II transform and deep neural networks for multimedia applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multispectral and hyper spectral image fusion aspires to improve the spectral information and spatial details. Previous fusion algorithms have concentrated on spectral information and spatial details, but those fused images have missed its sharpening. This paper is introduced the ripple type-II (RT-II) transform and deep neural network (DNN). RT -II transform can be decomposed both multispectral and hyper spectral images, then DNN are used for recognize the complementary features and sharpened the decomposed images. Then applied the fused rules for fuse the both images and applied inverse RT -II transform to get fused image. In this paper, the proposed method gets better entropy, standard deviation (SD), Correlation Coefficient (CC), Edge-Dependent Fusion Quality Index (EDFQI), Edge Based Similarity Measure (EBSM), Structural similarity (SSIM) as compared with other methods. The best way of analyzing the concepts of date and image fusion methods is to perform fusion based analysis in multimedia based tools.so that an end user can understand easily. The aspects like video, sound, text, animation, graphics have been elucidated by means of multimedia tools.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Amro I, Mateos J (2010) Multispectral image pansharpening based on the contourlet transform. Information Optics and Photonics. Springer, New York, p 247–261

    Chapter  Google Scholar 

  2. Choi M, Kim RY (2005) Fusion of Multispectral and Panchromatic Satellite Images Using the Curvelet Transform. IEEE Geosci Remote Sens Lett 2(2):136–140

    Article  Google Scholar 

  3. Choi Y, Sharifahmadian E (2014) Remote Sensing Image Fusion Using Contourlet Transform With Sharp Frequency Localization. International Journal of Information Technology, Modeling and Computing (IJITMC) 2(1):23–35

    Article  Google Scholar 

  4. Cormack A (1981) The Radon transform on a family of curves in the plane (I). Proc Am Math Soc 83(2):325–330

    Article  MathSciNet  Google Scholar 

  5. Cormack A (1982) The Radon transform on a family of curves in the plane (II). Proc Am Math Soc 83(2):293–298

    Article  MathSciNet  Google Scholar 

  6. Deng C, Wang S (2009) Remote Sensing Images Fusion Algorithm Based on Shearlet Transform. International Conference on Environmental Science and Information Application Technology 3:451–454

    Google Scholar 

  7. Dong Z, Wang Z (2013) SPOT5 multi-spectral (MS) and panchromatic (PAN) image fusion using an improved wavelet method based on local algorithm. Comput Geosci 60:134–141

    Article  Google Scholar 

  8. Dong L, Yang Q (2015) High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform. Elsevier Neurocomputing 159(2):268–274

    Article  Google Scholar 

  9. Duan C, Huang Q (2014) Remote Sensing Image Fusion Based On IHS and Dual Tree Compactly Supported Shearlet Transform. International Journal of Signal Processing, Image Processing and Pattern Recognition 7(5):361–374

    Article  Google Scholar 

  10. Geng P, Huang M, Liu S, Feng J, Bao P (2014) Multifocus image fusion method of Ripplet transform based on cycle spinning. Multimedia Tools and Applications 75(17):10583–10593

    Article  Google Scholar 

  11. González-Audícana M, Saleta JL (2004) Fusion of Multispectral and Panchromatic Images Using Improved IHS and PCA Mergers Based on Wavelet Decomposition. IEEE Trans Geosci Remote Sens 42(6):1291–1299

    Article  Google Scholar 

  12. Huang W (2015) A New Pan-Sharpening Method With Deep Neural Networks. IEEE Geosci Remote Sens Lett 12(5):1037–1041

    Article  Google Scholar 

  13. Jiaa Y, Xiao M (2010) Fusion of Pan and Multispectral Images Based On Contourlet Transform. ISPRS TC VII Symposium XXXVIII(Part 7B):314–316

    Google Scholar 

  14. JiaHu Chong X (2015) Comparative analysis of different fusion rules for SAR and multi-spectral image fusion based on NSCT and IHS transform” International Conference on Computer and Computational Sciences (ICCCS), pp: 271–274

  15. Murtagh F (1998) Multiscale transform methods in data analysis. University of Ulster, Coleraine, p 1–8

    Google Scholar 

  16. Pohl C, Van Genderen JL Multisensor image fusion in remote sensing: Concepts, methods and applications. Int J Remote Sens 19(5):823–854

  17. Shi H, Tian B (2010) Fusion of multispectral and panchromatic satellite images using principal component analysis and nonsubsampled contourlet transform. Seventh IEEE International Conference on Fuzzy Systems and Knowledge Discovery, pp 2313–2315

  18. Starck JL, Elad M, Donoho D (2004) Redundant multiscale transforms and their application for morphological component separation. Elsevier Science, New York, pp 1–64

    Google Scholar 

  19. Wang Q, Jia Z (2011) A New Technique for Multispectral and Panchromatic Image Fusion. International Conference on Advances in Engineering Procedia Engineering 24:182–186

    Google Scholar 

  20. Yao W-Q, Zhang CS (2008) Multi-Spectral Image Fusion Method Based On Wavelet Transformation. Int Arch Photogramm Remote Sens Spat Inf Sci XXXVII(Part B7):1261–1266

    Google Scholar 

  21. Zheng Y (2007) Effective image fusion rules of multi-scale image decomposition. 5th International Symposium on Image and Signal Processing and Analysis 362–366

Download references

Author information

Authors and Affiliations

  1. School of Computing, SASTRA Deemed University, Thanjavur, India

    K. Hariharan

  2. School of Electrical & Electronics Engineering, SASTRA Deemed University, Thanjavur, India

    N. R. Raajan

Authors
  1. K. Hariharan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. N. R. Raajan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Hariharan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hariharan, K., Raajan, N.R. Performance enhanced hyperspectral and multispectral image fusion technique using ripplet type-II transform and deep neural networks for multimedia applications. Multimed Tools Appl 79, 3561–3570 (2020). https://doi.org/10.1007/s11042-018-6174-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6174-3

Keywords

Search

Navigation