Skip to main content
SpringerLink
Log in

Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

Hyperspectral images have a higher spectral resolution (i.e., a larger number of bands covering the electromagnetic spectrum), but a lower spatial resolution with respect to multispectral or panchromatic acquisitions. For increasing the capabilities of the data in terms of utilization and interpretation, hyperspectral images having both high spectral and spatial resolution are desired. This can be achieved by combining the hyperspectral image with a high spatial resolution panchromatic image. These techniques are generally known as pansharpening and can be divided into component substitution (CS) and multi-resolution analysis (MRA) based methods. In general, the CS methods result in fused images having high spatial quality but the fused images suffer from spectral distortions. On the other hand, images obtained using MRA techniques are not as sharp as CS methods but they are spectrally consistent. Both substitution and filtering approaches are considered adequate when applied to multispectral and PAN images, but have many drawbacks when the low-resolution image is a hyperspectral image. Thus, one of the main challenges in hyperspectral pansharpening is to improve the spatial resolution while preserving as much as possible of the original spectral information. An effective solution to these problems has been found in the use of hybrid approaches, combining the better spatial information of CS and the more accurate spectral information of MRA techniques. In general, in a hybrid approach a CS technique is used to project the original data into a low dimensionality space. Thus, the PAN image is fused with one or more features by means of MRA approach. Finally the inverse projection is used to obtain the enhanced image in the original data space. These methods, permit to effectively enhance the spatial resolution of the hyperspectral image without relevant spectral distortions and on the same time to reduce the computational load of the entire process. In particular, in this paper we focus our attention on the use of Nonlinear Principal Component Analysis (NLPCA) for the projection of the image into a low dimensionality feature space. However, if on one hand the NLPCA has been proved to better represent the intrinsic information of hyperspectral images in the feature space, on the other hand an analysis of the impact of different fusion techniques applied to the nonlinear principal components in order to define the optimal framework for the hybrid pansharpening has not been carried out yet. More in particular, in this paper we analyze the overall impact of several widely used MRA pansharpening algorithms applied in the nonlinear feature space. The results obtained on both synthetic and real data demonstrate that an accurate selection of the pansharpening method can lead to an effective improvement of the enhanced hyperspectral image in terms of spectral quality and spatial consistency, as well as a strong reduction in the computational time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Aiazzi, B., Alparone, L., Baronti, S., & Garzelli, A. (2002). Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis. IEEE Transactions on Geoscience and Remote Sensing, 40, 2300–2312.

    Article  Google Scholar 

  • Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2006). MTF-tailored multiscale fusion of high-resolution MS and Pan imagery. Photogrammetric Engineering and Remote Sensing, 72(5), 591–596.

    Article  Google Scholar 

  • Alparone, L., Wald, L., Chanussot, J., Thomas, C., Gamba, P., & Bruce, L. M. (2007). Comparison of pansharpening algorithms: Outcome of the 2006 grs-s data fusion contest. IEEE Geoscience and Remote Sensing Society, 45(10), 3012–3021.

    Article  Google Scholar 

  • Amolins, K., Zhang, Y., & Dare, P. (2007). Wavelet based image fusion techniques–An introduction, review and comparison. ISPRS Journal of Photogrammetric, 62(4), 249–263.

    Article  Google Scholar 

  • Amro, I., Mateos, J., Vega, M., Molina, R., & Katsaggelos, A. K. (2011). A survey of classical methods and new trends in pansharpening of multispectral images. EURASIP Journal on Advances in Signal Processing, 79, 1–22.

    Google Scholar 

  • Bishop, C. (1995). Neural networks for pattern recognition. London: Oxford University Press.

    MATH  Google Scholar 

  • Burt, P., & Adelson, E. (1983). The laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31(4), 532–540.

    Article  Google Scholar 

  • Cavalli, R. M., Licciardi, G., & Chanussot, J. (2012). Detection of anomalies produced by buried archaeological structures using nonlinear principal component analysis applied to airborne hyperspectral image. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 6, 1–12.

    Google Scholar 

  • Chavez, P. S., Sides, S. C., & Anderson, J. A. (1991). Comparison of three different methods to merge multiresolution and multispectral data: Landsat tm and spot panchromatic. Photogrammetric Engineering and Remote Sensing, 57(3), 295–303.

    Google Scholar 

  • Cottrell G.W., Munro, P., Zipser, D. (1987). Learning internal representations from gray-scale images: An example of extensional programming. In Proceedings of conferences of the cognitive science society.

  • Cybenko, G. (1989). Approximations by superpositions of sigmoidal functions. Mathematics of Control, Signals, and Systems, 2(4), 303–314.

    Article  MathSciNet  MATH  Google Scholar 

  • Garguet-Duport, N., Girel, J., Chassery, J.-M., & Patou, G. (1996). The use of multiresolution analysis and wavelets transform for merging spot panchromatic and multispectral image data. Photogrammetric Engineering and Remote Sensing, 62(9), 1057–1066.

    Google Scholar 

  • Gonzalez-Audicana, M., Otazu, X., Fors, O., & Seco, A. (2005). Comparison between mallat’s and the a trous discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images. International Journal of Remote Sensing, 26(3), 595–614.

    Article  Google Scholar 

  • Haydn, R., Dalke, G. W., Henkel, J., & Bare, J. E. (1982). Application of the IHS color transform to the processing of multisensor data and image enhancement. Proceedings of international symposium of remote sensing of arid (pp. 599–616). Cairo, Egypt: Semi-Arid Lands.

    Google Scholar 

  • Khan, M. M., Chanussot, J., Condat, L., & Montanvert, A. (2008). Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique. IEEE Geoscience and Remote Sensing Letters, 5, 98–102.

    Article  Google Scholar 

  • Kohonen, T. (2001). Self-organizing maps (3rd ed.). Berlin: Springer.

    Book  MATH  Google Scholar 

  • Kramer, M. A. (1991). Nonlinear principal component analysis using autoassociative neural networks. AIChE Journal, 37, 233–243.

    Article  Google Scholar 

  • Lee, J., & Lee, C. (2010). Fast and efficient panchromatic sharpening. IEEE Transactions on Geoscience and Remote Sensing, 48(1), 155–163.

    Article  Google Scholar 

  • Licciardi, G. A., & Del Frate, F. (2011). Pixel unmixing in hyperspectral data by means of neural networks. IEEE Transactions on Geoscience and Remote Sensing, 49(11), 4163–4172.

    Article  Google Scholar 

  • Licciardi, G.A., Khan, M.M., Chanussot, J. (2012). Fusion of hyperspectral and panchromatic images: A hybrid use of indusion and nonlinear pca. In Image processing (ICIP), International Conference on 2012 19th IEEE, pp. 2133–2136.

  • Licciardi, G. A., Khan, M. M., Chanussot, J., Montanvert, A., Condat, L., & Jutten, C. (2011). Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear pca band reduction. IEEE Internation Geoscience and Remote Sensing Symposium (IGARSS), 2011, 1783–1786.

    Google Scholar 

  • Licciardi, G., Khan, M. M., Chanussot, J., Montanvert, A., Condat, L., & Jutten, C. (2012). Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear pca band reduction. EURASIP Journal of Advances in Signal Processing, 2012, 207.

    Article  Google Scholar 

  • Licciardi, G., Marpu, P.R., Benediktsson, J.A., Chanussot, J. (2011). Extended morphological profiles using auto-associative neural networks for hyperspectral data classification. In Hyperspectral image and signal processing: Evolution in remote sensing (WHISPERS), 2011 3rd Workshop on, pp. 1–4.

  • Licciardi, G., Marpu, P. R., Chanussot, J., & Benediktsson, J. A. (2012). Linear versus nonlinear pca for the classification of hyperspectral data based on the extended morphological profiles. IEEE Geoscience and Remote Sensing Letters, 9, 447–451.

    Article  Google Scholar 

  • Liu, J. G. (2000). Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details. International Journal of Remote Sensing, 21(18), 3461–3472.

    Article  Google Scholar 

  • Loncan, L., Almeida, L. B., Bioucas-Dias, J., Briottet, X., Chanussot, J., Dubigeon, N., et al. Introducing hyperspectral pansharpening. Accepted for publication on IEEE Geoscience and Remote Sensing Magazine.

  • Nunez, J., Otazu, X., Fors, O., Prades, A., Pala, V., & Arbiol, R. (1999). Multiresolution-based image fusion with additive wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1204–1211.

    Article  Google Scholar 

  • Otazu, X., Gonzalez-Audicana, M., Fors, O., & Nunez, J. (2005). Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 43(10), 2376–2385.

    Article  Google Scholar 

  • Ranchin, T., & Wald, L. (2000). Fusion of high spatial and spectral resolution images: The arsis concept and its implementation. Photogrammetric Engineering and Remote Sensing, 66(1), 49–61.

    Google Scholar 

  • Saul, L. K., & Roweis, S. T. (2004). Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research, 4(2), 119–155.

    MathSciNet  MATH  Google Scholar 

  • Scholkopf, B., Smola, A. J., & Muller, K.-R. (1998). Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10, 1299–1319.

    Article  Google Scholar 

  • Shah, V. P., Younan, N. H., & King, R. L. (2008). An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1323–1335.

    Article  Google Scholar 

  • Soille, P. (1999). Morphological image analysis: Principles and applications. Berlin: Springer.

    Book  MATH  Google Scholar 

  • Tenenbaum, J., de Silva, V., & Langford, J. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500), 2319–2323.

    Article  Google Scholar 

  • Thomas, C., Ranchin, T., Wald, L., & Chanussot, J. (2008). Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1301–1312.

    Article  Google Scholar 

  • Tu, T. M., Huang, P. S., Hung, C. L., & Chang, C. P. (2004). A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geoscience and Remote Sensing Letters, 1(4), 309–312.

    Article  Google Scholar 

  • Tu, T. M., Su, S. C., Shyu, H. C., & Huang, P. S. (2001). A new look at ihs-like image fusion methods. Information Fusion, 2(3), 177–186.

    Article  Google Scholar 

  • Vivone, G., Alparone, L., Chanussot, J., Dalla Mura, M., Garzelli, A., Licciardi, G., et al. (2014). A critical comparison among pansharpening algorithms. IEEE Transactions on Geoscience and Remote Sensing, 53(5), 2565.

    Article  Google Scholar 

  • Ward, L. (2002). Data fusion: Definitions and architectures-fusion of images of different spatial resolutions. Paris, France: ENSMP.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. GIPSA-Lab, Grenoble Institute of Technology, Grenoble, France

    Giorgio Licciardi, Mauro Dalla Mura & Jocelyn Chanussot

  2. Universitá di Salerno, Fisciano, Italy

    Gemine Vivone & Rocco Restaino

Authors
  1. Giorgio Licciardi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gemine Vivone
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mauro Dalla Mura
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rocco Restaino
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jocelyn Chanussot
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Giorgio Licciardi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Licciardi, G., Vivone, G., Mura, M. et al. Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications. Multidim Syst Sign Process 27, 807–830 (2016). https://doi.org/10.1007/s11045-015-0359-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-015-0359-y

Keywords

Search

Navigation