Skip to main content
Log in

High Spatial and Spectral Details Retention Fusion and Evaluation

  • Research Article
  • Published:
Journal of the Indian Society of Remote Sensing Aims and scope Submit manuscript

Abstract

To retain spatial and spectral details simultaneously from source images is a trade-off in image sharpening. Fourier and wavelet transform based image fusion methods retain better spectral quality but represent less spatial details as in source images. Wavelets and Laplacian pyramid perform well only at linear discontinuities because they do not consider the geometric properties of structures and do not exploit the regularity of edges. In this paper we proposed a novel image fusion method to preserve high spatial and spectral details based on the curvelet transforms. Curvelet transforms overcome the difficulty to identify the critical transient features. To retain high spatial details, finer and detailed scale coefficients of High Resolution (HR) PAN image are substituted in Low Resolution (LR) multispectral (MS) bands in the Fast Discrete Curvelet Transforms (FDCT) domain. Spectral details in the fused image are preserved by following the shape of the spectral reflectance curve of each pixel in the resample MS image. Spectral profile of the each pixel in spatially fused image is parallel to the spectral profile of the corresponding pixel in the resampled MS image. For experimental study of this method, Indian Remote Sensing (IRS) Resourcesat-1 LISS IV images are used as LR MS image and Cartosat-1 images are used as HR PAN Image. Proposed fusion method is evaluated against state of the art fusion techniques and quality measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Aiazzi, B., Alparone, L., Baronti, S., Pippi, I., & Selva, M. (2002a). Generalized Laplacian pyramid-based fusion of MS+ P image data with spectral distortion minimization. ISPRS International Archives of Photogrammetry and Remote Sensing, 34, 3–6.

    Google Scholar 

  • Aiazzi, B., Alparone, L., Baronti, S., & Garzelli, A. (2002b). Context-driven fusionof high spatial and spectral resolution images based on oversampled multiresolution analysis. IEEE Transactions on Geoscience and Remote Sensing, 40, 2301–2312.

    Article  Google Scholar 

  • Aiazzi, B., Baronti, S., & Selva, M. (2007). Improving component substitution pansharpening through multivariate regression of MS+Pan data. IEEE Transactions on Geoscience and Remote Sensing, 45, 3230–3239.

    Article  Google Scholar 

  • Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2011). Multispectral pansharpening based on pixel modulation:state of the art and new results. In Proc. of SPIE Image and Signal Processing for Remote Sensing XVII, Vol. 8180, pp. 818002.

  • Alparone, L., Baronti, S., Garzelli, A., & Nencini, F. (2004). A global quality measurement of Pan- sharpened multipsectral imagery. IEEE Geoscience and Remote Sensing Letters, 1(4), 313–317.

    Article  Google Scholar 

  • Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., & Nencini, F. (2008). Multispectral and Panchromatic data fusion assessment wothout reference. Photogrammetry Engineering and Remote Sensing, 74(2), 193–200.

    Article  Google Scholar 

  • Candes, E. J., & Damanet, L. (2005). The curvelet representation of wave propagators is optimally sparse. Communications on Pure and Applied Mathematics, 58(11), 1472–1528.

    Article  Google Scholar 

  • Candes, E. J., Demanet, L., Donoho, D., & Ying, L. (2006). Fast discrete curvelet transforms (FDCT). Pasadena: Caltech.

    Google Scholar 

  • Fallah, M., Yakhdani, & Azizi, A. (2010). Quality assessment of image fusion techniques for multi sensor high resolution satellite images (case study: IRSP5 and IRSP6 Satellite images). In ISPRS TC VII Symposium, Vienna, Austria, pp. 205–209.

  • Garzelli, A., & Nencini, F. (2009). Hypercomplex quality assessment of Multi/Hyperspectral images. IEEE Geoscience and Remote Sensing Letters, 6(4), 662–665.

    Article  Google Scholar 

  • Garzelli, A., Benelli, G., Barni, M., & Magini, C. (2001). Improving wavelet based merging of panchromatic and multispectral images by contextual information. In Proc. of SPIE Image and Signal Processing for Remote Sensing VI, Vol. 4170, pp. 82–91.

  • Golibagh, A., & Yazdi, M. (2009). A novel image fusion method using curvelet transform based on linear dependency test. In International conference on digital image processing. Bangkok, Thailand, pp. 351–354.

  • Hong, G., & Zhang, Y. (2007). Comparison and improvement of Wavelet-based image fusion. International Journal of Remote Sensing, 29, 673–691.

    Article  Google Scholar 

  • Kruse, F., Lefkoff, A., Boardman, J., Heidebrecht, K., Shapiro, A., Barloon, P., & Goetz, A. (1993). The spectral image processing system (SIPS) - interactive visualization and analysis of imaging spectrometer data. Remote Sensing of Environment, 44, 145–163.

    Article  Google Scholar 

  • Li, J. (2000). Spatial quality evaluation of fusion of different resolution images. In International archives of photogrammetry and remote sensing, XXXIII, Part B2, Amsterdam, pp. 339–346.

  • Lillo-Savedra, M., & Gonzalo, C. (2006). Spectral or spatial quality for fused satellite imagery? A trade-off solution using the wavelet à trous algorithm. International Journal of Remote Sensing, 27, 1453–1464.

    Article  Google Scholar 

  • Nencini, F., Garzelli, A., Baronti, S., & Alparone, L. (2006). Remote sensing image fusion. Informaion Fusion, 8, 143–156.

    Article  Google Scholar 

  • Rao, C. V., Reddy, P. S., Jain, D. S., & Rao, K. M. M. (2007). Quantitative value addition analysis of multisensory data fusion. The ICFAI Journal of Earth Sciences, 1, 82–96.

    Google Scholar 

  • Rao, C. V., Rao, K. M. M., Reddy, P. S., & Pujari, G. (2008). A novel method for enhancement of radiometric resolution using image fusion. International Journal of Applied Earth Observation and Geoinformation, 10, 165–174.

    Article  Google Scholar 

  • Starck, J. L., Candes, E. J., & Donoho, D. L. (2002). The Curvelet transform for image denoising. IEEE Transactions on Image Processing, 11, 670–684.

    Article  Google Scholar 

  • Wald, L. (2000). Quality of high resolution synthesized: Is there a simple criterion?. In Proceedings of the International Conference on Fusion of Earth Data, SEE/URISCA, France, pp. 99–105.

  • Wang, & Bovik. (2002). Universal image quality index. IEEE Singal Processing Letters, 9, 81–84.

    Article  Google Scholar 

  • Yang, W., & Gong, Y. (2012). Multi-spectral and panchromatic images fusion based on PCA and fractional spline wavelet. International Journal of Remote Sensing, 33, 7060–7074.

    Article  Google Scholar 

  • Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T. (2012). Coupled dictionary training for image super-resolution. Image Processing, IEEE Transactions on, 21(8), 3467–3478.

  • Ying, L., Xu, X., Bai, B-D., & Zhang, Y.N. (2008). Remote sensing image fusion based on Fast Discrete Curvelet Transform. In International conference on machine learning and cybernetics, Kumming, China.

  • Zhang, Y. (2002). Problems in the fusion of commercial high-resolution satellite images as well as Landsat 7 images and initial solutions. International Archives of Photogrammetry and Remote Sensing (IAPRS), GeoSpatial Theory, Processing and Applications, 34(Pt. 4). [CD-ROM].

  • Zhou, J., Civico, D. L., & Silander, J. A. (1998). A Wavelet Transform method to merge Landsat TM and SPOT Panchromatic data. International Journal of Remote Sensing, 19(4), 743–757.

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported under Technology Development Project (TDP) at National Remote Sensing Centre, ISRO, Department of Space, Government of India.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to C. V. Rao.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rao, C.V., Rao, J.M., Kumar, A.S. et al. High Spatial and Spectral Details Retention Fusion and Evaluation. J Indian Soc Remote Sens 44, 167–175 (2016). https://doi.org/10.1007/s12524-015-0467-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12524-015-0467-z

Keywords

Navigation