Skip to main content
SpringerLink
Log in

Adaptive fractional masks and super resolution based approach for image enhancement

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents an image enhancement technique based on super-resolution approach. The method uses fractional filters and reconstructs the output image by projection on convex sets (POCS) method. First, we generate a reference frame by using low-resolution frames and enhanced it by an adaptive fractional mask. Then the speed-up robust feature (SURF) is used to find the matching between low-resolution frames and the reference frame. Finally, the residuals between matching are reduced by the POCS reconstruction approach. To recover the high-frequency components, we have used a fractional integral mask in the POCS reconstruction process. We have compared the experimental results with some other existing methods from literature. Simulation results show that the proposed approach is efficient and returns a good quality image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. In the experiments, we have taken the value of parameter p as 1.01.

References

  1. Acton ST (1998) On fuzzy nonlinear regression for image enhancement. J Math Imaging Vis 8(3):239–253

    Article  MathSciNet  Google Scholar 

  2. Agrawal OP (2010) Generalized variational problems and Euler–Lagrange equations. Comput Math Appl 59(5):1852–1864

    Article  MathSciNet  Google Scholar 

  3. Anbarjafari G, Demirel H (2010) Image super resolution based on interpolation of wavelet domain high frequency subbands and the spatial domain input image. ETRI J 32(3):390–394

    Article  Google Scholar 

  4. Arqub OA, Al-Smadi M (2018) Atangana–Baleanu fractional approach to the solutions of Bagley–Torvik and Painlevé equations in Hilbert space. Chaos Solitons Fract 117:161–167

    Article  Google Scholar 

  5. Arqub OA, Maayah B (2018) Numerical solutions of integrodifferential equations of Fredholm, operator type in the sense of the Atangana–Baleanu fractional operator. Chaos Solitons Fract 117:117–124

    Article  MathSciNet  Google Scholar 

  6. Arqub OA, Maayah B (2019) Fitted fractional reproducing kernel algorithm for the numerical solutions of ABC–Fractional Volterra, integro-differential equations. Chaos Solitons Fract 126:394–402

    Article  MathSciNet  Google Scholar 

  7. Arqub OA, Maayah B (2019) Modulation of reproducing kernel Hilbert space method for numerical solutions of Riccati and Bernoulli equations in the Atangana-Baleanu fractional sense. Chaos Solitons Fract 125:163–170

    Article  MathSciNet  Google Scholar 

  8. Bay H, Tuytelaars T, Van Gool L (2006) Surf: Speeded up robust features. In European conference on computer vision. Springer, pp 404–417

  9. Bedi SS, Khandelwal R (2013) Various image enhancement techniques-a critical review. Int J Adv Res Comput Commun Eng 2(3):1605–1609

    Google Scholar 

  10. Celik T (2014) Spatial entropy-based global and local image contrast enhancement. IEEE Trans Image Process 23(12):5298–5308

    Article  MathSciNet  Google Scholar 

  11. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In European Conference on Computer Vision, pages 184–199. Springer

  12. Elad M, Hel-Or Y (2001) A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur. IEEE Trans Image Process 10(8):1187–1193

    Article  Google Scholar 

  13. Fan C, Zhu J, Gong J, Cuiling K (2006) POCS Super-resolution sequence image reconstruction based on improvement approach of keren registration method. In: 2006 ISDA’06. Sixth International Conference on Intelligent Systems Design and Applications, vol 2. IEEE, pp 333–337

  14. Farsiu S, Robinson D, Elad M, Milanfar P (2004) Advances and challenges in super-resolution. Int J Imaging Syst Technol 14(2):47–57

    Article  Google Scholar 

  15. Geng L, Ji Z, Yuan Y, Yin Y (2018) Fractional-order sparse representation for image denoising. IEEE/CAA J Autom Sin 5(2):555–563

    Article  MathSciNet  Google Scholar 

  16. Gonzalez RC, Woods RE (2002) Digital image processing, 2nd edn. Publishing House of Electronics Industry, Beijing

    Google Scholar 

  17. Greenberg S, Aladjem M, Kogan D (2002) Fingerprint image enhancement using filtering techniques. Real-Time Imaging 8(3):227–236

    Article  Google Scholar 

  18. Hao N, Liao H, Qiu Y, Yang J (2016) Face super-resolution reconstruction and recognition using non-local similarity dictionary learning based algorithm. IEEE/CAA J Autom Sin 3(2):213–224

    Article  MathSciNet  Google Scholar 

  19. Hwang JW, Lee HS (2004) Adaptive image interpolation based on local gradient features. IEEE Signal Process Lett 11(3):359–362

    Article  Google Scholar 

  20. Ko Sx-J, Lee YH (1991) Center weighted median filters and their applications to image enhancement. IEEE Trans Circ Syst 38(9):984–993

    Article  Google Scholar 

  21. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken AP, Tejani A, Totz J, Wang Z et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. CVPR 2:4

    Google Scholar 

  22. Lee J-S (1980) Digital image enhancement and noise filtering by use of local statistics. IEEE Transactions on Pattern Analysis & Machine Intelligence PAMI-2 (2):165–168

  23. Lei J, Zhang S, Li L, Xiao J, He W (2018) Super-resolution enhancement of uav images based on fractional calculus and pocs. Geo-Spatial Inf Sci 21(1):56–66

    Article  Google Scholar 

  24. Li B, Xie W (2015) Adaptive fractional differential approach and its application to medical image enhancement. Comput Electr Eng 45:324–335

    Article  Google Scholar 

  25. Li B, Xie W (2016) Image denoising and enhancement based on adaptive fractional calculus of small probability strategy. Neurocomputing 175:704–714

    Article  Google Scholar 

  26. Lowe DG (1999) Object recognition from local scale-invariant features. In Computer vision 1999 The Proceedings of the seventh IEEE International Conference on vol 2. IEEE, pp 1150–1157

  27. Mistry D, Banerjee A (2017) Comparison of feature detection and matching approaches: SIFT and SURF. GRD J-Glob Res Dev J Eng 2(4):7–13

    Google Scholar 

  28. Mitra SK, Li H, Lin I-S, Yu T-h (1991) A new class of nonlinear filters for image enhancement. In: 1991. ICASSP-91. International Conference on Acoustics, Speech, and Signal Processing. IEEE, pp 2525–2528

  29. Neumann L, Čadík M, Nemcsics A (2007) An efficient perception-based adaptive color to gray transformation. In: Proceedings of the Third Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging. Eurographics Association, pp 73–80

  30. Ng MK, Yau AC (2005) Super-resolution image restoration from blurred low-resolution images. J Math Imaging Vis 23(3):367–378

    Article  MathSciNet  Google Scholar 

  31. Panda SS, Prasad MSR, Jena G (2011) POCS based super-resolution image reconstruction using an adaptive regularization parameter. arXiv:1112.1484

  32. Pandey RK, Agrawal OP (2015) Numerical scheme for a quadratic type generalized isoperimetric constraint variational problems with A-operator. Journal of Computational and Nonlinear Dynamics 10(2) 021003 (1–6).

  33. Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, ter Haar Romeny, B, Zimmerman JB, Zuiderveld K (1987) Adaptive histogram equalization and its variations. Comput Vis Graph Image Process 39(3):355–368

    Article  Google Scholar 

  34. Pu Y-, Zhou J-L, Yuan X (2010) Fractional differential mask: a fractional differential-based approach for multiscale texture enhancement. IEEE Trans Image Process 19(2):491–511

    Article  MathSciNet  Google Scholar 

  35. Rajan D, Chaudhuri S (2002) An MRF-based approach to generation of super-resolution images from blurred observations. J Math Imaging Vis 16(1):5–15

  36. Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (CLAHE) for real-time image enhancement. J VLSI Signal Process Syst Signal Image Video Technol 38(1):35–44

  37. Shih FY (2010) Image processing and pattern recognition: fundamentals and techniques. Wiley, New York

  38. Shukla AK, Pandey RK, Yadav S (2018) Salt and pepper noise removal algorithm based on generalized fractional operator. Int J Pure Appl Math 119(16):5147–5158

    Google Scholar 

  39. Shukla AK, Pandey RK, Yadav S, Pachori RB (2019) Generalized fractional filter-based algorithm for image denoising Circuits, Systems, and Signal Processing, pp 1–28

  40. Singh KK, Bajpai MK, Pandey RK (2018) A novel approach for enhancement of geometric and contrast resolution properties of low contrast images. IEEE/CAA J Autom Sin 5(2):628–638

    Article  Google Scholar 

  41. Sun J, Xu Z, Shum H-Y (2008) Image super-resolution using gradient profile prior. In: 2008. CVPR 2008. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 1–8

  42. Tanveer M (2015) Newton method for implicit Lagrangian twin support vector machines. Int J Mach Learn Cybern 6(6):1029–1040

    Article  Google Scholar 

  43. Tanveer M, Richhariya B, Khan R U, Rashid A H, Khanna P, Prasad M, LIN CT (2019) Machine learning techniques for the diagnosis of Alzheimer’s disease: A review. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)

  44. Tanveer M, Tiwari A, Choudhary R, Jalan S (2019) Sparse pinball twin support vector machines. Appl Soft Comput 78:164–175

    Article  Google Scholar 

  45. Wang W, Yuan X (2017) Recent advances in image dehazing. IEEE/CAA J Autom Sin 4(3):410–436

    Article  MathSciNet  Google Scholar 

  46. Wang X, Chen L (2017) An effective histogram modification scheme for image contrast enhancement. Signal Process Image Commun 58:187–198

    Article  Google Scholar 

  47. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13 (4):600–612

    Article  Google Scholar 

  48. Xiao B, Tang H, Jiang Y, Li W, Wang G (2018) Brightness and contrast controllable image enhancement based on histogram specification. Neurocomputing 275:2798–2809

    Article  Google Scholar 

  49. Yang J, Wright J, Huang TS, Ma Y (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873

    Article  MathSciNet  Google Scholar 

  50. Yu W, Chen Q, Zhang B (1999) Image enhancement based on equal area dualistic sub-image histogram equalization method. IEEE Trans Consum Electron 45 (1):68–75

    Article  Google Scholar 

Download references

Acknowledgments

The authors sincerely thank the Editor and reviewers for their constructive comments to improve the quality of the manuscript.

Author information

Authors and Affiliations

  1. Department of Mathematical Sciences, Indian Institute of Technology (BHU), Varanasi, 221005, India

    Anil K. Shukla, Rajesh K. Pandey & Swati Yadav

  2. Center for Advanced Biomaterials and Tissue Engineering, Indian Institute of Technology (BHU), Varanasi, 221005, India

    Rajesh K. Pandey

Authors
  1. Anil K. Shukla
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajesh K. Pandey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Swati Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajesh K. Pandey.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

1.1 A Performance of the proposed algorithm with different filters

To show the effectiveness of the proposed fractional masks in the designed algorithm, we have presented the experimental results in Table 7 and Fig. 12. The results are obtained by replacing the discussed fractional filters with different filters, such as average filter, median filter, and the Gaussian smoothing filter in the proposed algorithm.

Table 7 The objective quality assessment of proposed algorithm with different filters
Full size table
Fig. 12
figure 12

Enhancement results of the proposed algorithm with different filters: First row presents the result obtained by with average filter; Second row presents the results obtained with median filter; Third row presents the results obtained with the Gaussian smoothing filter; Fourth row presents the results obtained with the proposed fractional filters

Full size image

In the proposed super-resolution based algorithm, fractional filters are part of the designed algorithm. However, the developed algorithm can work with other known filters also. To show the importance of the designed fractional masks in the introduced algorithm, we have depicted the results with different filters in Table 7. It is observed that the proposed algorithm gives better results in terms of entropy and contrast when it is applied with introduced fractional masks. The SSIM of the proposed algorithm is higher when it is used with average, median, and the Gaussian smoothing filters. However, the proposed algorithm, when it is applied with designed fractional masks, returns the high-quality enhanced image (Fig. 12). The image obtained by the proposed algorithm, when it is used with other filters such as average, median, and the Gaussian smoothing, is faded and returns the low values of entropy and the contrast ratio in comparison with introduced fractional masks. These results show the importance of the discussed fractional masks in the proposed algorithm of super-resolution.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shukla, A.K., Pandey, R.K. & Yadav, S. Adaptive fractional masks and super resolution based approach for image enhancement. Multimed Tools Appl 80, 30213–30236 (2021). https://doi.org/10.1007/s11042-020-08968-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-08968-6

Keywords

Search

Navigation