Abstract
Spectral and spatial resolutions play a vital role in remote sensing applications. However, due to the limitations of imaging sensors, hyperspectral image (HSI) with good spectral features often suffers from poor spatial information. To address this problem, HSIs are to be fused with their multispectral image (MSI) versions. Image fusion is the combination of multiple images of same scenes to intensify salient features in the fused image. It is widely used in agriculture, medical, remote sensing areas. In our proposed method, a unique edge-preserving HSI-MSI fusion is developed using principal component analysis (PCA) and guided bilateral filter (GBF). PCA eliminates the correlated variables and increases the variance. The HSI is spatially improved by replacing with the highest variance principal component with its MSI. In addition, the cascaded GBFs present restore the edge details in the fused image. Using three reference and four non reference public datasets, the effectiveness of our method is demonstrated over the existing methods. We have reported 36.98 dB peak signal-to-noise ratio and 0.764 universal image quality index, which are averaged over three HSI-MSI datasets.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aiazzi B, Alparone L, Baronti S, Garzelli A, Selva M (2006) MTF-tailored multiscale fusion of high-resolution MS and Pan imagery. Photogramm Eng Remote Sens 72(5):591–596
Bhataria KC, Shah BK (2018) A review of image fusion techniques. In: 2018 second international conference on computing methodologies and communication (ICCMC), pp 114–123. IEEE
Desale RP, Verma SV (2013) Study and analysis of PCA, DCT & DWT based image fusion techniques. In: 2013 international conference on signal processing, image processing & pattern recognition, pp 66–69. IEEE
Dhiman G, Vinoth Kumar V, Kaur A, Sharma A (2021) DON: deep learning and optimization-based framework for detection of novel coronavirus disease using X-ray images. Interdiscip Sci Comput Life Sci 13(2):260–272
Jolliffe IT, Cadima J (2016) Principal component analysis: a review and recent developments. Philos Trans R Soc A Math Phys Eng Sci 374(2065):20150202
Kouser RR, Manikandan T, Kumar VV (2018) Heart disease prediction system using artificial neural network, radial basis function and case based reasoning. J Comput Theor Nanosci 15(9–10):2810–2817
Lanaras C, Baltsavias E, Schindler K (2017) Hyperspectral super-resolution with spectral unmixing constraints. Remote Sens 9(11):1196
Liu JG (2000) Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details. Int J Remote Sens 21(18):3461–3472
Mahesh TR, Dhilip Kumar V, Vinoth Kumar V, Asghar J, Geman O, Arulkumaran G, Arun N (2022) AdaBoost ensemble methods using K-fold cross validation for survivability with the early detection of heart disease. Comput Intell Neurosci
Nasrabadi AT, Shirsavar MA, Ebrahimi A, Ghanbari M (2014) Investigating the PSNR calculation methods for video sequences with source and channel distortions. In: 2014 IEEE international symposium on broadband multimedia systems and broadcasting, pp 1–4. IEEE
Rajini KC, Roopa S (2017) A review on recent improved image fusion techniques. In: 2017 international conference on wireless communications, signal processing and networking (WiSPNET), pp 149–153. IEEE
Roopashree S, Anitha J, Mahesh TR, Kumar VV, Viriyasitavat W, Kaur A (2022) An IoT based authentication system for therapeutic herbs measured by local descriptors using machine learning approach. Measurement 200:111484
Student P (2014) Study of image fusion-techniques method and applications
Subramanian P, Sowndariya M, Swathi S, Monica S (2016) Image fusion techniques. Int J Chem Sci 14:812–816
Suryanarayana G, Dhuli R (2016) Simultaneous edge preserving and noise mitigating image super-resolution algorithm. AEU Int J Electron Commun 70(4):409–415
Suryanarayana G, Dhuli R (2017a) Super-resolution image reconstruction using dual-mode complex diffusion-based shock filter and singular value decomposition. Circ Syst Signal Process 36(8):3409–3425
Suryanarayana G, Dhuli R (2017b) Edge preserving super-resolution algorithm using multi-stage cascaded joint bilateral filter. Int J Model Simul Sci Comput 8(01):1750003
Suryanarayana G, Tu E, Yang J (2019a) Infrared super-resolution imaging using multi-scale saliency and deep wavelet residuals. Infrared Phys Technol 97:177–186
Suryanarayana G, Dhuli R, Yang J (2019b) Single image super-resolution algorithm possessing edge and contrast preservation. Int J Image Graph 19(04):1950024
Suryanarayana G, Chandran K, Khalaf OI, Alotaibi Y, Alsufyani A, Alghamdi SA (2021) Accurate magnetic resonance image super-resolution using deep networks and Gaussian filtering in the stationary wavelet domain. IEEE Access 9:71406–71417
Wald L (2000) Quality of high resolution synthesised images: is there a simple criterion?. In: Third conference “Fusion of Earth data: merging point measurements, raster maps and remotely sensed images”, pp 99–103. SEE/URISCA
Wei Q, Dobigeon N, Tourneret JY (2015) Fast fusion of multi-band images based on solving a Sylvester equation. IEEE Trans Image Process 24(11):4109–4121
Yokoya N, Yairi T, Iwasaki A (2011) Coupled nonnegative matrix factorization unmixing for hyperspectral and multispectral data fusion. IEEE Trans Geosci Remote Sens 50(2):528–537
Zhou Y, Mayyas A, Omar MA (2011) Principal component analysis-based image fusion routine with application to automotive stamping split detection. Res Nondestr Eval 22(2):76–91
Funding
This research did not receive any specific grant from funding agencies in the public, commercial or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest to be disclosed.
Human or animal rights
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Suryanarayana, G., Saidulu, B., Priya, M.R.H. et al. Fusion of hyperspectral and multispectral images based on principal component analysis and guided bilateral filtering. Int J Syst Assur Eng Manag 15, 439–448 (2024). https://doi.org/10.1007/s13198-022-01767-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13198-022-01767-2