Abstract
To retain spatial and spectral details simultaneously from source images is a trade-off in image sharpening. Fourier and wavelet transform based image fusion methods retain better spectral quality but represent less spatial details as in source images. Wavelets and Laplacian pyramid perform well only at linear discontinuities because they do not consider the geometric properties of structures and do not exploit the regularity of edges. In this paper we proposed a novel image fusion method to preserve high spatial and spectral details based on the curvelet transforms. Curvelet transforms overcome the difficulty to identify the critical transient features. To retain high spatial details, finer and detailed scale coefficients of High Resolution (HR) PAN image are substituted in Low Resolution (LR) multispectral (MS) bands in the Fast Discrete Curvelet Transforms (FDCT) domain. Spectral details in the fused image are preserved by following the shape of the spectral reflectance curve of each pixel in the resample MS image. Spectral profile of the each pixel in spatially fused image is parallel to the spectral profile of the corresponding pixel in the resampled MS image. For experimental study of this method, Indian Remote Sensing (IRS) Resourcesat-1 LISS IV images are used as LR MS image and Cartosat-1 images are used as HR PAN Image. Proposed fusion method is evaluated against state of the art fusion techniques and quality measures.
Similar content being viewed by others
References
Aiazzi, B., Alparone, L., Baronti, S., Pippi, I., & Selva, M. (2002a). Generalized Laplacian pyramid-based fusion of MS+ P image data with spectral distortion minimization. ISPRS International Archives of Photogrammetry and Remote Sensing, 34, 3–6.
Aiazzi, B., Alparone, L., Baronti, S., & Garzelli, A. (2002b). Context-driven fusionof high spatial and spectral resolution images based on oversampled multiresolution analysis. IEEE Transactions on Geoscience and Remote Sensing, 40, 2301–2312.
Aiazzi, B., Baronti, S., & Selva, M. (2007). Improving component substitution pansharpening through multivariate regression of MS+Pan data. IEEE Transactions on Geoscience and Remote Sensing, 45, 3230–3239.
Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2011). Multispectral pansharpening based on pixel modulation:state of the art and new results. In Proc. of SPIE Image and Signal Processing for Remote Sensing XVII, Vol. 8180, pp. 818002.
Alparone, L., Baronti, S., Garzelli, A., & Nencini, F. (2004). A global quality measurement of Pan- sharpened multipsectral imagery. IEEE Geoscience and Remote Sensing Letters, 1(4), 313–317.
Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., & Nencini, F. (2008). Multispectral and Panchromatic data fusion assessment wothout reference. Photogrammetry Engineering and Remote Sensing, 74(2), 193–200.
Candes, E. J., & Damanet, L. (2005). The curvelet representation of wave propagators is optimally sparse. Communications on Pure and Applied Mathematics, 58(11), 1472–1528.
Candes, E. J., Demanet, L., Donoho, D., & Ying, L. (2006). Fast discrete curvelet transforms (FDCT). Pasadena: Caltech.
Fallah, M., Yakhdani, & Azizi, A. (2010). Quality assessment of image fusion techniques for multi sensor high resolution satellite images (case study: IRSP5 and IRSP6 Satellite images). In ISPRS TC VII Symposium, Vienna, Austria, pp. 205–209.
Garzelli, A., & Nencini, F. (2009). Hypercomplex quality assessment of Multi/Hyperspectral images. IEEE Geoscience and Remote Sensing Letters, 6(4), 662–665.
Garzelli, A., Benelli, G., Barni, M., & Magini, C. (2001). Improving wavelet based merging of panchromatic and multispectral images by contextual information. In Proc. of SPIE Image and Signal Processing for Remote Sensing VI, Vol. 4170, pp. 82–91.
Golibagh, A., & Yazdi, M. (2009). A novel image fusion method using curvelet transform based on linear dependency test. In International conference on digital image processing. Bangkok, Thailand, pp. 351–354.
Hong, G., & Zhang, Y. (2007). Comparison and improvement of Wavelet-based image fusion. International Journal of Remote Sensing, 29, 673–691.
Kruse, F., Lefkoff, A., Boardman, J., Heidebrecht, K., Shapiro, A., Barloon, P., & Goetz, A. (1993). The spectral image processing system (SIPS) - interactive visualization and analysis of imaging spectrometer data. Remote Sensing of Environment, 44, 145–163.
Li, J. (2000). Spatial quality evaluation of fusion of different resolution images. In International archives of photogrammetry and remote sensing, XXXIII, Part B2, Amsterdam, pp. 339–346.
Lillo-Savedra, M., & Gonzalo, C. (2006). Spectral or spatial quality for fused satellite imagery? A trade-off solution using the wavelet à trous algorithm. International Journal of Remote Sensing, 27, 1453–1464.
Nencini, F., Garzelli, A., Baronti, S., & Alparone, L. (2006). Remote sensing image fusion. Informaion Fusion, 8, 143–156.
Rao, C. V., Reddy, P. S., Jain, D. S., & Rao, K. M. M. (2007). Quantitative value addition analysis of multisensory data fusion. The ICFAI Journal of Earth Sciences, 1, 82–96.
Rao, C. V., Rao, K. M. M., Reddy, P. S., & Pujari, G. (2008). A novel method for enhancement of radiometric resolution using image fusion. International Journal of Applied Earth Observation and Geoinformation, 10, 165–174.
Starck, J. L., Candes, E. J., & Donoho, D. L. (2002). The Curvelet transform for image denoising. IEEE Transactions on Image Processing, 11, 670–684.
Wald, L. (2000). Quality of high resolution synthesized: Is there a simple criterion?. In Proceedings of the International Conference on Fusion of Earth Data, SEE/URISCA, France, pp. 99–105.
Wang, & Bovik. (2002). Universal image quality index. IEEE Singal Processing Letters, 9, 81–84.
Yang, W., & Gong, Y. (2012). Multi-spectral and panchromatic images fusion based on PCA and fractional spline wavelet. International Journal of Remote Sensing, 33, 7060–7074.
Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T. (2012). Coupled dictionary training for image super-resolution. Image Processing, IEEE Transactions on, 21(8), 3467–3478.
Ying, L., Xu, X., Bai, B-D., & Zhang, Y.N. (2008). Remote sensing image fusion based on Fast Discrete Curvelet Transform. In International conference on machine learning and cybernetics, Kumming, China.
Zhang, Y. (2002). Problems in the fusion of commercial high-resolution satellite images as well as Landsat 7 images and initial solutions. International Archives of Photogrammetry and Remote Sensing (IAPRS), GeoSpatial Theory, Processing and Applications, 34(Pt. 4). [CD-ROM].
Zhou, J., Civico, D. L., & Silander, J. A. (1998). A Wavelet Transform method to merge Landsat TM and SPOT Panchromatic data. International Journal of Remote Sensing, 19(4), 743–757.
Acknowledgments
This research was supported under Technology Development Project (TDP) at National Remote Sensing Centre, ISRO, Department of Space, Government of India.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Rao, C.V., Rao, J.M., Kumar, A.S. et al. High Spatial and Spectral Details Retention Fusion and Evaluation. J Indian Soc Remote Sens 44, 167–175 (2016). https://doi.org/10.1007/s12524-015-0467-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12524-015-0467-z