Skip to main content
SpringerLink
Log in

Hyperspectral image super-resolution reconstruction based on image partition and detail enhancement

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The hyperspectral image (HSI) super-resolution reconstruction has attracted much attention and been used widely in various study fields due to its low requirements on hardware in practice. However, most of the hyperspectral image super-resolution reconstruction studies apply one strategy for images with varying complexity of spatial information. This is not conducive to the improvement of Image processing efficiency and the extraction of complex details. Given the above, a new method named MSDESR (multilevel streams and detail enhancement) is proposed to reconstruct HSI by using partition reconstruction and detail enhancement. The MSDESR consists of a sub-map shunt block, a high-low-frequency information extraction with detail enhancement block, and a partition image reconstruction block. Firstly, the sub-map shunt block is designed to pre-classify hyperspectral images. The images are divided into complex and simple parts according to the spatial information distribution of the reconstructed sub-map. Secondly, the multiscale Retinex with detail enhancement algorithm is constructed to purify high-frequency noise-contaminated and enhance the image details by separating the samples into high- and low-frequency information. Finally, branching networks of different complexities are designed to reconstruct the images with high credibility and clear content. In this paper, datasets of QUST-1, Pavia University, Chikusei, the Washington DC Mal and XiongAn are applied in the experiments. The results show that MSDESR outperforms state-of-the-art CNN-based methods in terms of quantitative metrics, visual quality, and computational effort, with a 4.18% and 9.35% improvement in SRE and MPSNR metrics, and a 37% saving in FLOPs. Overall, the MSDESR performs well in hyperspectral image super-resolution reconstruction, which is time saving and preserves the details of spatial information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

Data are available on request to the authors.

References

  • Akgun T, Altunbasak Y, Mersereau RM (2005) Super-resolution reconstruction of hyperspectral images. IEEE Trans Image Process 14(11):1860–1875

    Article  Google Scholar 

  • Cordero-Martínez R, Sánchez D, Melin P (2022) Hierarchical genetic optimization of convolutional neural models for diabetic retinopathy classification. Int J Hybrid Intell Syst

  • Dong W, Zhou C, Wu F et al (2021) Model-guided deep hyperspectral image super-resolution. IEEE Trans Image Process 30:5754–5768

    Article  Google Scholar 

  • Dong C, Loy CC, Tang X (2016) Accelerating the super-resolution convolutional neural network. In: European conference on computer vision. Springer, Cham, 391–407

  • Dong W, Qu J, Zhang T et al. (2022) Context-aware guided attention based cross-feedback dense network for hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens

  • Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: 2009 IEEE 12th international conference on computer vision. IEEE, 349–356

  • Gou S, Liu S, Yang S et al (2014) Remote sensing image super-resolution reconstruction based on nonlocal pairwise dictionaries and double regularization. IEEE J Sel Topics Appl Earth Obs Remote Sens 7(12):4784–4792

    Article  Google Scholar 

  • Guo JM, Markoni H, Lee JD (2021) BARNet: Boundary aware refinement network for crack detection. IEEE Trans Intell Transp Syst

  • Daihong J, Sai Z, Lei D et al (2022) Multi-scale generative adversarial network for image super-resolution. Soft Comput 26(8):3631–3641

    Article  Google Scholar 

  • Huang G, Liu Z, Van Der Maaten L et al (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 4700–4708

  • Jiang K, Wang Z, Yi P et al (2019) Edge-enhanced GAN for remote sensing image superresolution. IEEE Trans Geosci Remote Sens 57(8):5799–5812

    Article  Google Scholar 

  • Jiang J, Sun H, Liu X et al (2020) Learning spatial-spectral prior for super-resolution of hyperspectral imagery. IEEE Trans Comput Imag 6:1082–1096

    Article  Google Scholar 

  • Kim Y, Koh Y J, Lee C et al (2015) Dark image enhancement based onpairwise target contrast and multi-scale detail boosting. In: 2015 IEEE international conference on image processing (ICIP). IEEE, 1404–1408

  • Kong X, Zhao H, Qiao Y et al (2021) ClassSR: a general framework to accelerate super-resolution networks by data characteristic. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 12016–120252

  • Kwan C, Choi JH, Chan SH et al (2018) A super-resolution and fusion approach to enhancing hyperspectral images. Remote Sens 10(9):1416

    Article  Google Scholar 

  • Lai WS, Huang JB, Ahuja N et al (2017) Deep laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 624–632

  • Land EH (1964) The retinex. Am Sci 52(2):247–264

    Google Scholar 

  • Li Y, Du Z, Wu S et al (2021) Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance. ISPRS J Photogramm Remote Sens 182:14–36

    Article  Google Scholar 

  • Li Q, Yuan Y, Wang Q (2022) Hyperspectral image super-resolution via multi-domain feature learning. Neurocomputing 472:85–94

    Article  Google Scholar 

  • Li X, You A, Zhu Z, et al. (2020) Semantic flow for fast and accurate scene parsing. In: European conference on computer vision. Springer, Cham, 775–793

  • Ma X, Wang Q, Tong X (2022) A spectral grouping-based deep learning model for haze removal of hyperspectral images. ISPRS J Photogramm Remote Sens 188:177–189

    Article  Google Scholar 

  • Mao Q, Wang S, Wang S et al (2018) Enhanced image decoding via edge-preserving generative adversarial networks. In: 2018 IEEE international conference on multimedia and Expo (ICME). IEEE, 1–6

  • Qi Y, Yang Z, Lian J et al (2021) A new heterogeneous neural network model and its application in image enhancement. Neurocomputing 440:336–350

    Article  Google Scholar 

  • Romano Y, Isidoro J, Milanfar P (2016) RAISR: rapid and accurate image super resolution. IEEE Trans Comput Imag 3(1):110–125

    Article  MathSciNet  Google Scholar 

  • Sun W, Yang G, Ren K et al (2021) A label similarity probability filter for hyperspectral image postclassification. IEEE J Sel Topics Appl Earth Obs Remote Sens 14:6897–6905

    Article  Google Scholar 

  • Varela-Santos S, Melin P (2021) A new approach for classifying coronavirus COVID-19 based on its manifestation on chest X-rays using texture features and neural networks. Inf Sci 545:403–414

    Article  MathSciNet  Google Scholar 

  • Veganzones MA, Simoes M, Licciardi G et al (2015) Hyperspectral super-resolution of locally low rank images from complementary multisource data. IEEE Trans Image Process 25(1):274–288

    Article  MathSciNet  MATH  Google Scholar 

  • Wan W, Guo W, Huang H et al (2020) Nonnegative and nonlocal sparse tensor factorization-based hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens 58(12):8384–8394

    Article  Google Scholar 

  • Wang X, Ma J, Jiang J (2021) Hyperspectral image super-resolution via recurrent feedback embedding and spatial–spectral consistency regularization. IEEE Trans Geosci Remote Sens 60:1–13

    Google Scholar 

  • Wang X, Ma J, Jiang J et al (2022) Dilated projection correction network based on autoencoder for hyperspectral image super-resolution. Neural Netw 146:107–119

    Article  Google Scholar 

  • Wertheimer D, Tang L, Hariharan B (2021) Few-shot classification with feature map reconstruction networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 8012–8021

  • Xue J et al (2021) Spatial-spectral structured sparse low-rank representation for hyperspectral image super-resolution. IEEE Trans Image Process 30:3084–3097

    Article  MathSciNet  Google Scholar 

  • Yu K, Dong C, Lin L et al (2018) Crafting a toolchain for image restoration by deep reinforcement learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2443–2452

  • Yu J, Fan Y, Yang J et al (2018) Wide activation for efficient and accurate image super-resolution[J]. arXiv:1808.08718

  • Zhang Y, Li X, Zhou J (2019) Sftgan: a generative adversarial network for pan-sharpening equipped with spatial feature transform layers. J Appl Remote Sens 13(2):026507

    Article  Google Scholar 

  • Zhang Y, Li K, Li K et al (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European conference on computer vision (ECCV), 286–301

  • Zhao M, Ning J, Hu J et al (2021) Hyperspectral image super-resolution under the guidance of deep gradient information. Remote Sens 13(12):2382

    Article  Google Scholar 

Download references

Funding

Shandong Province Demonstration Base Project of Postgraduate Joint Training for Industry-Education Integration and Youth Project of Shandong Provincial Natural Science Foundation. Grant numbers are (2020–19) and (ZR2021QC120).

Author information

Authors and Affiliations

  1. College of Information Science and Technology, Qingdao University of Science and Technology, Qingdao, 266061, Shandong, China

    Yinghao Xu, Yuchao Lv, Xijun Zhu, Sifan Liu, Yuanyuan Sun & Yimin Wang

Authors
  1. Yinghao Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuchao Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xijun Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sifan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuanyuan Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yimin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuanyuan Sun.

Ethics declarations

Conflict of interest

All of the authors declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by Oscar Castillo.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Y., Lv, Y., Zhu, X. et al. Hyperspectral image super-resolution reconstruction based on image partition and detail enhancement. Soft Comput 27, 13461–13476 (2023). https://doi.org/10.1007/s00500-022-07723-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-022-07723-3

Keywords

Search

Navigation