Multiple dictionary pairs learning and sparse representation-based infrared image super-resolution with improved fuzzy clustering
Exploring sparse representation to enhance the resolution of infrared image has attracted much attention in the last decade. However, conventional sparse representation-based super-resolution aim at learning a universal and efficient dictionary pair for image representation. However, considering that a large number of different structures exist in an image, it is insufficient and unreasonable to present various image structures with only one universal dictionary pair. In this paper, we propose an improved fuzzy clustering and weighted scheme reconstruction framework to solve this problem. Firstly, the training patches are divided into multiple clusters by joint learning multiple dictionary pairs with improved fuzzy clustering method. The goal of joint learning is to learn the multiple dictionary pairs which could collectively represent all the training patches with smallest reconstruction error. So that the learned dictionary pairs are more precise and mutually complementary. Then, high-resolution (HR) patches are estimated according to several most accurate dictionary pairs. Finally, these estimated HR patches are integrated together to generate a final HR patch by a weighted scheme. Numerous experiments demonstrate that this framework outperforms some state-of-art super-resolution methods in both quantitatively and perceptually.
KeywordsMulti-sensor Super-resolution Sparse representation Infrared image Dictionary learning Multiview representation Fuzzy clustering theory
The research is sponsored by the National Natural Science Foundation of China (Nos. 61701327, 61711540303 and 61473198), also is supported by the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD) Fund, Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology(CICAEET) Fund.
Compliance with ethical standards
Conflict of interest
All the authors declare that they have no conflict of interest.
- Chang H, Yeung DY, Xiong Y (2004) Super-resolution through neighbor embedding. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, vol 1, pp I-275–I-282Google Scholar
- Gu B, Sun X, Sheng VS (2016) Structural minimax probability machine. IEEE Trans Neural Netw Learn Syst PP(99):1–11Google Scholar
- Li X (2005) Demosaicing by successive approximation. IEEE Trans Image Process A Publ IEEE Signal Process Soc 14(3):370–379Google Scholar
- Monaci G, Vandergheynst P (2004) Learning structured dictionaries for image representation. In: International conference on image processing, 2004, vol 4. ICIP ’04. IEEE, pp 2351–2354Google Scholar
- Wang J, Li T, Shi Y-Q, Lian S, Ye J (2016) Forensics feature analysis in quaternion wavelet domain for distinguishing photographic images and computer graphics. Multimed Tools Appl. doi: 10.1007/11042-016-4153-0
- Yang X, Liu K, Gan Z, Yan B (2016) Multiscale and multitopic sparse representation for multisensor infrared image superresolution. J Sens 1–14:2015Google Scholar
- Zhang K, Gao X, Li X, Tao D (2011) Partially supervised neighbor embedding for example-based image super-resolution. 5(2):230–239Google Scholar
- Zhangjie F, Xinle W, Guan C, Sun X, Ren K (2016) Toward efficient multi-keyword fuzzy search over encrypted outsourced data with accuracy improvement. IEEE Trans Inf Forens Secur 11(12):1–1Google Scholar