Multimedia Tools and Applications

, Volume 78, Issue 6, pp 7563–7578 | Cite as

Pansharpening with support vector transform and semi-nonnegative matrix factorization

  • Hong LiEmail author
  • Weibin Li
  • Shuying Liu


This paper attempts to reduce the spectral distortion and enhance the spatial information of fused images. For this purpose, the author presented a novel pansharpening method based on support vector transform (SVT) and semi-nonnegative matrix factorization (semi-NMF). The proposed method involves three steps. In step one, SVT was performed on panchromatic and multispectral images. In step two, the low-frequency components were processed by semi-NMF-based fusion rule, while the high-frequency components were treated by the regional energy-weighted fusion rule. In step three, the fused images were reconstructed by the fused high-frequency and low-frequency components. After that, the proposed method was compared with other related methods through experiments on several datasets collected from QuickBird and GeoEye-1. The comparison shows that the proposed method outperforms the compared approaches. The research findings shed new light on the preservation of spatial and spectral information in image fusion.


Pansharpening Panchromatic and multispectral images Nonnegative matrix factorization (NMF) Support vector transform (SVT) 



The authors would like to thank the anonymous reviewers and the editor for suggesting various changes. And this work was supported by the National Natural Science Foundation of China (No. 81473559), the Natural Science Basic Research Plan in Shaanxi Province of China (No. 2017JM6086), the Science Basic Research Program in Shaanxi Province of China (No. 16JK1823), the Innovation Program in Shaanxi Province of China (No. 2018KRM145), the Science Basic Research Program in Xianyang Normal University of China (No. XSYK18012).


  1. 1.
    Akula RT, Gupta R, Devi MRV (2012) An efficient pan-sharpening technique by merging two hybrid approaches. Procedia Engineering 30(9):535–541CrossRefGoogle Scholar
  2. 2.
    Alparone L, Baronti S, Garzelli A, Nencini F (2004) A global quality measurement of pan-sharpened multispectral imagery. IEEE Geoscience & Remote Sensing Letters 1(4):313–317CrossRefGoogle Scholar
  3. 3.
    Alparone L, Wald L, Chanussot J, Thomas C, Gamba P, Bruce LM (2007) Comparison of pansharpening algorithms: outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience & Remote Sensing 45(10):3012–3021CrossRefGoogle Scholar
  4. 4.
    Bovolo F, Bruzzone L, Capobianco L, Garzelli A, Marchesi S, Nencini F (2010) Analysis of the effects of pansharpening in change detection on VHR images. IEEE Geoscience & Remote Sensing Letters 7(1):53–57CrossRefGoogle Scholar
  5. 5.
    Ding C, Li T, Jordan MI (2010) Convex and semi-nonnegative matrix factorizations. IEEE Transactions on Pattern Analysis & Machine Intelligence 32(1):45–55CrossRefGoogle Scholar
  6. 6.
    Garzelli A, Nencini F (2006) Pan-sharpening of very high resolution multispectral images using genetic algorithms. Int J Remote Sens 27(15):3273–3292CrossRefGoogle Scholar
  7. 7.
    Ghahremani M, Ghassemian H (2016) A compressed-sensing-based pan-sharpening method for spectral distortion reduction. IEEE Transactions on Geoscience & Remote Sensing 54(4):2194–2206CrossRefGoogle Scholar
  8. 8.
    Guo R, Zhang L, Xing M, Li J (2010) Polarimetric SAR image fusion using nonnegative matrix factorisation and improved-RGB model. Electron Lett 46(20):1399–1401CrossRefGoogle Scholar
  9. 9.
    Hoyer PO (2002) Non-negative sparse coding. Neural Networks for Signal Processing, 2002. Proceedings of the 2002, IEEE Workshop on. IEEE, 2002: 557–565Google Scholar
  10. 10.
    Jiang C, Zhang H, Shen H, Zhang L (2014) Two-step sparse coding for the pan-sharpening of remote sensing images. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7(5):1792–1805CrossRefGoogle Scholar
  11. 11.
    Johnson BA, Tateishi R, Hoan NT (2013) A hybrid pansharpening approach and multiscale object-based image analysis for mapping diseased pine and oak trees. Int J Remote Sens 34(20):6969–6982CrossRefGoogle Scholar
  12. 12.
    Karathanassi V, Kolokousis P, Ioannidou S (2007) A comparison study on fusion methods using evaluation indicators. Int J Remote Sens 28(10):2309–2341CrossRefGoogle Scholar
  13. 13.
    Laben CA, Brower BV. (2000) Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. U.S. Patent 6011875, Jan. 4Google Scholar
  14. 14.
    Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefGoogle Scholar
  15. 15.
    Li S, Yang B (2011) A new pan-sharpening method using a compressed sensing technique. IEEE Transactions on Geoscience & Remote Sensing 49(2):738–746CrossRefGoogle Scholar
  16. 16.
    Li SZ, Hou XW, Zhang HJ, Cheng Q (2001) Learning spatially localized, parts-based representation. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. IEEE, 2001: I-207-I-212 vol.1Google Scholar
  17. 17.
    Li S, Yin H, Fang L (2013) Remote sensing image fusion via sparse representations over learned dictionaries. IEEE Transactions on Geoscience & Remote Sensing 51(9):4779–4789CrossRefGoogle Scholar
  18. 18.
    Li H, Liu F, Yang S, Zhang K, Su X, Jiao L (2016) Refined pan-sharpening with NSCT and hierarchical sparse autoencoder. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 9(12):5715–5725CrossRefGoogle Scholar
  19. 19.
    Li H, Liu F, Zhang K (2016) Remote sensing image fusion based on sparse non-negative matrix factorization. Journal of Xidian University 43(2):193–198Google Scholar
  20. 20.
    Liu Y, Liao Y, Tang L, Tang F, Liu W (2016) General subspace constrained non-negative matrix factorization for data representation. Neurocomputing 173(1):224–232CrossRefGoogle Scholar
  21. 21.
    Miao Q, Wang B (2005) A novel algorithm of multi-sensor image fusion using non-negative matrix factorization. Journal of Computer Aided Design & Computer Graphics 17(9):2029–2032Google Scholar
  22. 22.
    Otazu X, Audicana MG, Fors O, Nunez J (2010) Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience & Remote Sensing 43(10):2376–2385CrossRefGoogle Scholar
  23. 23.
    Psjr C, Sides SC, Anderson JA (1991) Comparison of three different methods to merge multiresolution and multispectral data: landsat TM and SPOT panchromatic. Photogramm Eng Remote Sens 57(3):265–303Google Scholar
  24. 24.
    Ranchin T, Wald L (2000) Fusion of high spatial and spectral resolution images: the arsis concept and its implementation. Photogramm Eng Remote Sens 66(2):49–61Google Scholar
  25. 25.
    Rong KX, Jiao LC, Wang S, Liu F (2017) Pansharpening based on low-rank and sparse decomposition. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7(12):4793–4805CrossRefGoogle Scholar
  26. 26.
    Samat A, Gamba P, Liu S, Du P, Abuduwaili J (2016) Jointly informative and manifold structure representative sampling based active learning for remote sensing image classification. IEEE Transactions on Geoscience & Remote Sensing 54(11):6803–6817CrossRefGoogle Scholar
  27. 27.
    Shah VP, Younan NH, King RL (2008) An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets. IEEE Transactions on Geoscience & Remote Sensing 46(5):1323–1335CrossRefGoogle Scholar
  28. 28.
    Shah VP, Younan NH, King R (2008) Pan-sharpening via the contourlet transform. Geoscience and Remote Sensing Symposium, 2007. IGARSS 2007. IEEE International. IEEE, 2008: 310–313Google Scholar
  29. 29.
    Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRefGoogle Scholar
  30. 30.
    Thomas C, Ranchin T, Wald L, Chanussot J (2008) Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics. IEEE Transactions on Geoscience & Remote Sensing 46(5):1301–1312CrossRefGoogle Scholar
  31. 31.
    Tu TM, Su SC, Shyu HC, Huang PS (2001) A new look at IHS-like image fusion methods. Information Fusion 2(3):177–186CrossRefGoogle Scholar
  32. 32.
    Tu TM, Huang PS, Hung CL, Chang CP (2004) A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geoscience & Remote Sensing Letters 1(4):309–312CrossRefGoogle Scholar
  33. 33.
    Vivone G, Alparone L, Chanussot J, Mura MD, Garzelli A, Licciardi GA, Restaino R, Wald L (2015) A critical comparison among pansharpening algorithms. IEEE Transactions on Geoscience & Remote Sensing 53(5):2565–2586CrossRefGoogle Scholar
  34. 34.
    Wang Z, Bovik AC (2002) A universal image quality index. IEEE Signal Processing Letters 9(3):81–84CrossRefGoogle Scholar
  35. 35.
    Wang Z, Yu X, Zhang L (2008) A remote sensing image fusion algorithm based on constrained nonnegative matrix factorization. Journal of Beijing Normal University 4(4):672–676Google Scholar
  36. 36.
    Wang N, Du B, Zhang L (2013) An endmember dissimilarity constrained non-negative matrix factorization method for hyperspectral unmixing. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 6(2):554–569CrossRefGoogle Scholar
  37. 37.
    Wang WQ, Jiao LC, Yang SY, Rong KX (2015) Distributed compressed sensing-based pan-sharpening with hybrid dictionary. Neurocomputing 155(5):320–333CrossRefGoogle Scholar
  38. 38.
    Xu R, Li Y, Xing M (2013) Fusion of multi-aspect radar images via sparse non-negative matrix factorisation. Electron Lett 49(25):1635–1637CrossRefGoogle Scholar
  39. 39.
    Yang XH, Jiao LC (2008) Fusion algorithm for remote sensing images based on nonsubsampled contourlet transform. Acta Automat Sin 34(3):274–281CrossRefGoogle Scholar
  40. 40.
    Yang SY, Wang M, Jiao LC (2012) Contourlet hidden markov tree and clarity-saliency driven PCNN based remote sensing images fusion. Appl Soft Comput 12(1):228–237CrossRefGoogle Scholar
  41. 41.
    Yang SY, Wang M, Jiao LC (2012) Fusion of multispectral and panchromatic images based on support value transform and adaptive principal component analysis. Information Fusion 13(3):177–184CrossRefGoogle Scholar
  42. 42.
    Yang S, Zhang K, Wang M (2017) Learning low-rank decomposition for pan-sharpening with spatial-spectral offsets. IEEE Transactions on Neural Networks & Learning Systems 99:1–11. CrossRefGoogle Scholar
  43. 43.
    Yi Y, Shi Y, Zhang H, Wang J, Kong J (2015) Label propagation based semi-supervised non-negative matrix factorization for feature extraction. Neurocomputing 149(2):1021–1037CrossRefGoogle Scholar
  44. 44.
    Yin H, Li S (2015) Pansharpening with multiscale normalized nonlocal means filter: a two-step approach. IEEE Transactions on Geoscience & Remote Sensing 53(10):5734–5745CrossRefGoogle Scholar
  45. 45.
    Yuhas R, Goetz AFH, Boardman JW (1992) Descrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. Proceedings of Summaries 4th JPL Airborne Earth Science Workshop, 1992Google Scholar
  46. 46.
    Zhan Y, Chen L, Jia J, Zhao Z (2014) Multi-focus image fusion based on non-negative matrix factorization and difference images. Signal Process 105(12):84–97CrossRefGoogle Scholar
  47. 47.
    Zhang L, Zhang L, Tao D, Huang X (2011) A multifeature tensor for remote-sensing target recognition. IEEE Geoscience & Remote Sensing Letters 8(2):374–378CrossRefGoogle Scholar
  48. 48.
    Zhang K, Wang M, Yang SY, Xing YH, Qu R (2016) Fusion of panchromatic and multispectral images via coupled sparse non-negative matrix factorization. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 9(12):5740–5747CrossRefGoogle Scholar
  49. 49.
    Zhu XX, Bamler R (2013) A sparse image fusion algorithm with application to pan-sharpening. IEEE Transactions on Geoscience & Remote Sensing 51(5):2827–2836CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Computer ScienceXianYang Normal UniversityXianYangChina

Personalised recommendations