Sensing and Imaging

, 20:18 | Cite as

Image Super-Resolution Reconstruction: A Granular Computing Approach from the Viewpoint of Cognitive Psychology

  • Hongbing LiuEmail author
  • Xiaoyu Diao
  • Huaping Guo
Original Paper


Image super-resolution reconstruction is the current research focus and important field of digital image processing, and widely applied in public security, medical diagnosis, etc. Inspired by the idea of granular computing, we explore the granular computing models and algorithms of image super-resolution reconstruction integrating theories and methods of computer science, mathematics, and cognitive psychology. The research includes the following aspects. (1) The granulation method of image is proposed to transform the image space into granularity space. (2) The join operator and the meet operator between two granules are designed for the fuzzy inclusion measure mu and sigma between two granules, are used to realize the transformation between two granularity spaces with different granularities, to obtain the prior knowledge to guide the design of image super-resolution reconstruction algorithms. (3) According to up–down and bottom-up computing models, the granular computing algorithms of image super-resolution reconstruction are designed to realize the transformation from granularity space to image space in terms of the prior knowledge. Research can be summarized for learning process and reconstruction process, the learning process obtains the prior knowledge of image by granulation and forms granular computing model, and the reconstruction process reconstructs the high-resolution image of the given low-resolution image by granulation and the obtained prior knowledge. The feasibility of the preliminary study was verified by experiments. The research aims to build image super-resolution reconstruction models and algorithms satisfying human cognition.


Image super-resolution reconstruction Granular computing High-resolution image Low-resolution image 


Authors’ Contribution

Data curation, Huaping Guo; Methodology, Hongbing Liu; Validation, Xiaoyu Diao.


This work was supported in part by the Natural Science Foundation of China (61501393) and the Natural Science Foundation of Henan Province of China (182300410145, 182102210132).

Compliance with Ethical Standards

Conflicts of interest

The authors declare that they have no conflict of interest.


  1. 1.
    Song, Q., Xiong, R., Liu, D., Xiong, Z., Wu, F., & Gao, W. (2018). Fast image super-resolution via local adaptive gradient field sharpening transform. IEEE Transactions on Image Processing, 27(4), 1966–1980.MathSciNetCrossRefGoogle Scholar
  2. 2.
    Betzig, E., Patterson, G. H., Sougrat, R., Lindwasser, O. W., Olenych, S., Bonifacino, J. S., et al. (2006). Imaging intracellular fluorescent proteins at nanometer resolution. Science, 313(5793), 1642–1645.CrossRefGoogle Scholar
  3. 3.
    Roweis, S., & Saul, L. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500), 2323–2326.CrossRefGoogle Scholar
  4. 4.
    Zou, Z., & Shi, Z. (2018). Random access memories: A new paradigm for target detection in high resolution aerial remote sensing images. IEEE Transactions on Image Processing, 27(3), 1100–1111.MathSciNetCrossRefGoogle Scholar
  5. 5.
    Solso, R., MacLin, O., & MacLin, M. (2010). Cognitive psychology (Z. Shao, Trans.). Beijing: China Machine Press, pp. 1–200.Google Scholar
  6. 6.
    Galotti, K. (2016). Cognitive psychology: In and out of the laboratory (G. Wu, Trans.). Beijing: China Machine Press, pp. 1–156.Google Scholar
  7. 7.
    Zhang, L., & Zhang, B. (2011). Fuzzy inclusion quotient space and fuzzy subset. Science China Information Sciences, 41(1), 1–11.Google Scholar
  8. 8.
    Yao, Y. (2016). Three-way decisions and cognitive computing. Cognitive Computation, 8(4), 543–554.CrossRefGoogle Scholar
  9. 9.
    Zhao, L., Yao, Y., & Zhang, L. (2017). Measurement of general granules. Information Science, 415, 128–141.CrossRefGoogle Scholar
  10. 10.
    Yang, J., Wright, J., Huang, T., & Ma, Y. (2010). Image super-resolution via sparse representation. IEEE Transactions on Image Process, 19(11), 2861–2873.MathSciNetCrossRefGoogle Scholar
  11. 11.
    Wang, Z., Yang, Y., Wang, Z., Chang, S., Yang, J., & Huang, T. S. (2015). Learning super-resolution jointly from external and internal examples. IEEE Transactions on Image Processing, 24(11), 4359–4371.MathSciNetCrossRefGoogle Scholar
  12. 12.
    Liu, D., Wang, Z., Wen, B., Yang, J., Han, W., & Huang, T. S. (2016). Robust single image super-resolution via deep networks with sparse prior. IEEE Transactions on Image Processing, 25(7), 3194–3207.MathSciNetCrossRefGoogle Scholar
  13. 13.
    Yang, W., Feng, J., Yang, J., Zhao, F., Liu, J., Guo, Z., et al. (2017). Deep edge guided recurrent residual learning for image super-resolution. IEEE Transactions on Image Processing, 26(12), 5895–5907.MathSciNetCrossRefGoogle Scholar
  14. 14.
    Zhao, Y., Wang, R., Jia, W., Yang, J., Wang, W., & Gao, W. (2018). Local patch encoding-based method for single image super-resolution. Information Science, 433–434, 292–305.MathSciNetCrossRefGoogle Scholar
  15. 15.
    Protter, M., Elad, M., Takeda, H., & Milanfar, P. (2009). Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Transactions on Image Processing, 18(1), 36–51.MathSciNetCrossRefGoogle Scholar
  16. 16.
    Elad, M., & Datsenko, D. (2009). Example-based regularization deployed to super-resolution reconstruction of a single image. The Computer Journal, 52(1), 15–30.CrossRefGoogle Scholar
  17. 17.
    Adler, A., Hel-Or, Y., & Elad, M. (2010). A shrinkage learning approach for single image super-resolution with overcomplete representations. In ECCV, pp. 622–635.Google Scholar
  18. 18.
    Peleg, T., & Elad, M. (2014). A statistical prediction model based on sparse representations for single image super-resolution. IEEE Transactions on Image Processing, 23(6), 2569–2582.MathSciNetCrossRefGoogle Scholar
  19. 19.
    Agustsson, E., Timofte, R., & Gool, L. V. (2017). Anchored regression networks applied to age estimation and super resolution. In ICCV, pp. 1652–1661.Google Scholar
  20. 20.
    Dai, D., Timofte, R., & Gool, L. V. (2015). Jointly optimized regressors for image super-resolution. Computer Graphics Forum, 34(2), 95–104.CrossRefGoogle Scholar
  21. 21.
    Kaburlasos, V. G., Papadakis, S. E., & Amanatiadis, A. (2012). Binary image 2D shape learning and recognition based on lattice-computing (LC) techniques. Journal of Mathematical Imaging and Vision, 42(2–3), 118–133.MathSciNetCrossRefGoogle Scholar
  22. 22.
    Papakostas, G. A., Kaburlasos, V. G., & Pachidis, T. P. (2013). Thermal infrared face recognition based on lattice computing (LC) techniques. In FUZZ-IEEE, pp. 1–6.Google Scholar
  23. 23.
    Papakostas, G. A., & Kaburlasos V. G. (2014). Lattice computing (LC) meta-representation for pattern classification. In FUZZ-IEEE, pp. 39–44.Google Scholar
  24. 24.
    Kaburlasos, V. G., Papadakis, S. E., & Papakostas, G. A. (2013). Lattice computing extension of the FAM neural classifier for human facial expression recognition. IEEE Transactions on Neural Networks and Learning Systems, 24(10), 1526–1538.CrossRefGoogle Scholar
  25. 25.
    Kaburlasos, V. G., & Kehagias, A. (2014). Fuzzy inference system (FIS) extensions based on the lattice theory. IEEE Transactions on Fuzzy Systems, 22(3), 531–546.CrossRefGoogle Scholar
  26. 26.
    Kaburlasos, V. G., & Papakostas, G. A. (2015). Learning distributions of image features by interactive fuzzy lattice reasoning in pattern recognition applications. IEEE Computational Intelligence Magazine, 10(3), 42–51.CrossRefGoogle Scholar
  27. 27.
    Kaburlasos, V. G. (2006). Towards a unified modeling and knowledge representation based on lattice theory. In Studies in computational intelligence, Vol. 27, Springer.Google Scholar
  28. 28.
    Li, J., Huang, C., Qi, J., Qian, Y., & Liu, W. (2017). Three-way cognitive concept learning via multi-granularity. Information Sciences, 378, 244–263.CrossRefGoogle Scholar
  29. 29.
    Li, J., Mei, C., Xu, W., & Qian, Y. (2015). Concept learning via granular computing: A cognitive viewpoint. Information Sciences, 298, 447–467.MathSciNetCrossRefGoogle Scholar
  30. 30.
    Ju, H., Pedrycz, W., Li, H., Ding, W., Yang, X., & Zhou, X. (2019). Sequential three-way classifier with justifiable granularity. Knowledge-Based Systems, 163, 103–119.CrossRefGoogle Scholar
  31. 31.
    Qian, Y., Cheng, H., Wang, J., Liang, J., Pedrycz, W., & Dang, C. (2017). Grouping granular structures in human granulation intelligence. Information Sciences, 382–383, 150–169.CrossRefGoogle Scholar
  32. 32.
    Wang, W., Pedrycz, W., & Liu, X. (2015). Time series long-term forecasting model based on information granules and fuzzy clustering. Engineering Applications of Artificial Intelligence, 41, 17–24.CrossRefGoogle Scholar
  33. 33.
    Yang, X., Yu, F., & Pedrycz, W. (2017). Long-term forecasting of time series based on linear fuzzy information granules and fuzzy inference system. International Journal of Approximate Reasoning, 81, 1–27.MathSciNetCrossRefGoogle Scholar
  34. 34.
    Timofte, R., Agustsson, E., et al. (2017). NTIRE 2017 challenge on single image super-resolution: Methods and results. In CVPR, pp. 1110–1121.Google Scholar
  35. 35.
    Agustsson, E., Timofte, R., et al. (2017). NTIRE 2017 challenge on single image super-resolution: dataset and study. In CVPR, pp. 1122–1131.Google Scholar
  36. 36.
    Timofte, R., Smet, V. D., & Gool, L. V. (2014). A+: Adjusted anchored neighborhood regression for fast super-resolution. In ACCV, pp. 111–126.Google Scholar
  37. 37.
    Bevilacqua, M., Roumy, A., Guillemot, C., & Alberi-Morel, M. L. (2012). Low complexity single-image super-resolution based on nonnegative neighbor embedding. In BMVC, pp. 1–10.Google Scholar
  38. 38.
    Chang, H., Yeung, D. Y., & Xiong, Y. (2004). Super-resolution through neighbor embedding. In CVPR, pp. 275–282.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Center of ComputingXinyang Normal UniversityXinyangPeople’s Republic of China
  2. 2.School of Computer and Information TechnologyXinyang Normal UniversityXinyangPeople’s Republic of China

Personalised recommendations