Journal of Signal Processing Systems

, Volume 65, Issue 3, pp 509–523 | Cite as

Super Resolution of Multispectral Images using ℓ1 Image Models and Interband Correlations

  • Miguel Vega
  • Javier Mateos
  • Rafael Molina
  • Aggelos K. Katsaggelos


In this paper we propose a novel super-resolution based algorithm for the pansharpening of multispectral images. Within the Bayesian formulation, the proposed methodology incorporates prior knowledge on the expected characteristics of multispectral images; that is, it imposes smoothness within each band by means of the energy associated with the ℓ1 norm of vertical and horizontal first order differences of image pixel values and also takes into account the correlation among the bands of the multispectral image. The observation process is modeled using the sensor characteristics of both panchromatic and multispectral images. The method is tested on real and synthetic images, compared with other pansharpening methods, and the quality of the results assessed both qualitatively and quantitatively.


Pansharpening Super-resolution Multispectral images Bayesian approach Variational methods ℓ1 image models Interband correlations 


  1. 1.
    Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., & Selva, M. (2006). MTF-tailored multiscale fusion of high-resolution MS and Pan imagery. Photogrammetric Engineering & Remote Sensing, 72(5), 591–596.Google Scholar
  2. 2.
    Aiazzi, B., Alparone, L., Baronti, S., Pippi, I., & Selva, M. (2002). Generalised Laplacian pyramid-based fusion of MS + P image data with spectral distortion minimisation. ISPRS International Archives of Photogrammetry and Remote Sensing, 34, 3–6.Google Scholar
  3. 3.
    Alparone, L., Wald, L., Chanussot, J., Thomas, C., Gamba, P., & Bruce, L. M. (2007). Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience and Remote Sensing, 45(10), 3012–3020.CrossRefGoogle Scholar
  4. 4.
    Bioucas-Dias, J., Figueiredo, M., & Oliveira, J. (2006). Total-variation image deconvolution: A majorization-minimization approach. In Proc. of the 2006 int. conf. on acoustics, speech and signal processing (ICASSP’2006) (Vol. 2, pp. II–861–II–864).Google Scholar
  5. 5.
    Carper, W. J., Lillesand, T. M., & Kiefer, R. W. (1990). The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photographic Engineering & Remote Sensing, 56(4), 459–467.Google Scholar
  6. 6.
    Cook, M. K., Peterson, B. A., Dial, G., Gibson, L., Gerlach, F. W., Hutchins, K. S., et al. (2001). IKONOS technical performance assessment. Proceedings of SPIE, 4381, 94–108.CrossRefGoogle Scholar
  7. 7.
    Khan, M. M., Alparone, L., & Chanussot, J. (2009). Pansharpening quality assessment using the modulation transfer functions of instruments. IEEE Transactions on Geoscience and Remote Sensing, 47(11), 3880–3891.CrossRefGoogle Scholar
  8. 8.
    Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Lange, K. (2004). Optimization. In Springer texts in statistic. New York: Springer Verlag.Google Scholar
  10. 10.
    Lillo-Saavedra, M., & Gonzalo, C. (2007). Multispectral images fusion by a joint multidirectional and multiresolution representation. International Journal of Remote Sensing, 28(18), 4065–4079.CrossRefGoogle Scholar
  11. 11.
    Molina, R., Vega, M., Mateos, J., & Katsaggelos, A. K. (2008). Variational posterior distribution approximation in Bayesian super resolution reconstruction of multispectral images. Applied and Computational Harmonic Analysis, 24(2), 251–267.MathSciNetzbMATHCrossRefGoogle Scholar
  12. 12.
    Nuñez, J., Otazu, X., Fors, O., Prades, A., Pala, V., & Arbiol, R. (1999). Multiresolution-based image fusion with additive wavelet decomposition. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1204–1211.CrossRefGoogle Scholar
  13. 13.
    Otazu, X., Gonzalez-Audicana, M., Fors, O., & Nuñez, J. (2005). Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience and Remote Sensing, 43(10), 2376–2385.CrossRefGoogle Scholar
  14. 14.
    Price, J. C. (1999). Combining multispectral data of different spatial resolution. IEEE Transactions on Geoscience and Remote Sensing, 37(3), 1199–1203.CrossRefGoogle Scholar
  15. 15.
    Shah, V. P., Younan, N. H., & King, R. L. (2008). An efficient pan-sharpening method via a combined adaptive pca approach and contourlets. IEEE Transactions on Geoscience and Remote Sensing, 46(5), 1323–1335.CrossRefGoogle Scholar
  16. 16.
    Vega, M., Molina, R., & Katsaggelos, A. K. (2009). L1 prior majorization in Bayesian image restoration. In 16th Int. Conf. on Digital Signal Processing.Google Scholar
  17. 17.
    Vijayaraj, V. (2004). A quantitative analysis of pansharpened images. Master’s thesis, Mississippi St. University.Google Scholar
  18. 18.
    Wald, L., Ranchin, T., & Mangolini, M. (1997). Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images. Photogrammetric Engineering & Remote Sensing, 63(6), 691–699.Google Scholar
  19. 19.
    Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Miguel Vega
    • 1
  • Javier Mateos
    • 2
  • Rafael Molina
    • 2
  • Aggelos K. Katsaggelos
    • 3
  1. 1.Dept. de Lenguajes y Sistemas InformáticosUniversidad de GranadaGranadaSpain
  2. 2.Dept. de Ciencias de la Computación e I. A.Universidad de GranadaGranadaSpain
  3. 3.Dept. of Electrical Engineering and Computer ScienceNorthwestern UniversityEvanstonUSA

Personalised recommendations