Skip to main content

Frequency roughness analysis in image processing and game design

Abstract

With the continuous progress of science and technology, image processing techniques have been used increasingly in recent years. Image processing plays an indispensable role in the fields of computer vision, artificial intelligence, pattern recognition, and related fields. Improvements in basic algorithms and the development of new algorithms have resulted in considerable innovation and progress. This paper is devoted to finding new game applications in a branch of image processing. It introduces an analysis model proposed by the author and discusses the relationship between roughness in the frequency domain and visual image interpretation. By using the concept of roughness, we separated the image features into meaningful information and residual information and analysed the image in the frequency domain. The results were compared with those of traditional image processing methods. The starting point is the visual identification of a feature based on human interpretation. The image information was separated into meaningful features and the residual component to reduce the redundancy of the model. This allowed for a sparse representation of the feature information in the image. By analysing the meaningful features and residual components of an image separately, we established a relationship between the results and the original images. Parameters such as texture, morphology, and the degree of blurring were considered and we developed a parameter called “frequency roughness”. The algorithm incorporates the concepts of frequency and roughness and the roughness is determined in the frequency domain. The frequency roughness algorithm successfully separated the rough features in the frequency domain and calculated the residual value in an image. This model provided more accurate image processing results than comparable methods. This paper includes an analysis and game applications of the proposed model for de-blurring, image enhancement, recognition, and other image processing tasks. Some game applications were successful, whereas others require further investigation.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

References

  1. Aihara, K. (1997). Chaos in neural networks. Impact of Chaos on Science & Society, pp 110–126.

  2. Chen, V., & Ling, H. (2015). Joint time-frequency analysis for radar signal and image processing. IEEE Signal Processing Magazine, 16(2), 81–93.

    Article  Google Scholar 

  3. Chen, V., & Ling, H. (2015). Joint time-frequency analysis for radar signal and image processing. IEEE Signal Processing Magazine, 16(2), 81–93.

    Article  Google Scholar 

  4. Cui, X., Huang, J., Zhang, S., & et al (2012). Background subtraction using low rank and group sparsity constraints. In Computer Vision – ECCV 2012 (pp. 612–625). Berlin, Heidelberg: Springer.

  5. Gao, J., Wang, H., & Shen, H. (2020). Machine learning based workload prediction in cloud computing. In 29th international conference on computer communications and networks (ICCCN). https://doi.org/10.1109/icccn49398.2020.9209730.

  6. Hong, L., Wan, Y., & Jain, A. (1998). Fingerprint image enhancement: Algorithm and performance evaluation. IEEE Transactions on Pattern Analysis & Machine Intelligence.

  7. Kingsbury, N. (2003). Design of Q-shift complex wavelets for image processing using frequency domain energy minimization. In International conference on image processing. IEEE.

  8. Kubota, A., & Takahashi, K. (2004). Eurographics symposium on rendering. Computer Graph Forum.

  9. Kubota, A., Smolic, A., Magnor, M., Tanimoto, M., Chen, T., & Zhang, C. (2007). Multiview imaging and 3DTV. IEEE Signal Processing Magazine, 24(6), 10.

    Article  Google Scholar 

  10. Loan, C.F.V. (2011). Computational frameworks for the fast fourier transform. Computational frameworks for the fast fourier transform.

  11. Li, J., Cao, W., & Tian, X. (2018). Topographic surface roughness analysis based on image processing of terrestrial planet. Cluster Computing.

  12. Li, X., & Li, J. (2018). A suspected lunar volcano identification algorithm based on convolutional neural network by the rapid location of light shadow impacts. Concurrency and Computation Practice and Experience, 31(6), e4727.

    MathSciNet  Google Scholar 

  13. Li, J., & Tian, X. (2016). Analysis of all-in-focus image processing in image restoration. Multimedia Tools & Applications.

  14. Le, N.T., Wang, J.-W., Wang, C.-C., & Nguyen, T.N. (2019). Automatic defect inspection for coated eyeglass based on symmetrized energy analysis of color channels. Symmetry, 11, 1518. https://doi.org/10.3390/sym11121518.

    Article  Google Scholar 

  15. Loey, M., Manogaran, G., & Khalifa, N.E. (2020). A deep transfer learning model with classical data augmentation and CGAN to detect COVID-19 from chest CT radiography digital images. Neural Computing and Applications. https://doi.org/10.1007/s00521-020-05437-x.

  16. Mallat, S. (2009). A wavelet tour of signal processing.

  17. Meyer, Y. (2006). Oscillating patterns in some nonlinear evolution equations. In Mathematical foundation of turbulent viscous flows (pp. 101–187). Berlin, Heidelberg: Springer.

  18. Marton, F. (2011). A real-time coarse-to-fine multiview capture system for all-in-focus rendering on a light- field display. In 3DTV Conf: True Vision-Capture, Transmission Display of 3D Video (3DTV-CON) (pp. 1–4).

  19. Mahmood, M.T., & Choi, T.-S. (2010). PCA-based method for 3D shape recovery of microscopic objects from image focus using discrete cosine transform. Optics Letter 35(8).

  20. Osher, S., Solé, A., & Vese, L. (2002). Image decomposition and restoration using total variation minimization and the norm. SIAM Journal on Multiscale Modeling & Simulation, 1(3), 349–370.

    MathSciNet  Article  Google Scholar 

  21. Pertuz, S., & Puig, D. (2013). Generation of all-in-focus images by noise-robust selective fusion of limited depth- of-field images. IEEE Transactions on Image Processing 22(3).

  22. Rubinstein, R., Bruckstein, A.M., & Elad, M. (2010). Dictionaries for sparse representation modeling. Proceedings of the IEEE, 98(6), 1045–1057.

    Article  Google Scholar 

  23. Smolic, A. (2011). 3D video and free viewpoint video-From capture to display.

  24. Song, X., Wang, S., Liu, S., El-Latif, A.A., & Niu, X. (2013). A dynamic watermarking scheme for quantum images using quantum wavelet transform. Quantum Information Processing, 12(12), 3689–3706. https://doi.org/10.1007/s11128-013-0629-2.

    MathSciNet  Article  Google Scholar 

  25. Starck, J.L., Elad, M., & Donoho, D.L. (2005). Image decomposition via the combination of sparse representations and a variational approach. Piscataway: IEEE Press.

    Book  Google Scholar 

  26. Starck, J.L., Candes, E.J., & Donoho, D.L. (2002). The curvelet transform for image denoising. IEEE Transactions on Image Processing, 11(6), 670–684.

    MathSciNet  Article  Google Scholar 

  27. Wang, J., Li, J., Liu, B., & et al. (2015). 3D simulation model of lunar crater based on single ccd image. Netherlands: Atlantis Press. https://doi.org/10.2991/iset-15.2015.1.

    Book  Google Scholar 

Download references

Acknowledgements

This work is supported by the Science and Technology Development Fund of Macao (No. 0038/2020/A1). Faculty of Humanities and Arts, Macau University of science and Technology, Macau, China.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Jiaqi Li.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Li, J. Frequency roughness analysis in image processing and game design. J Intell Inf Syst (2021). https://doi.org/10.1007/s10844-021-00669-2

Download citation

Keywords

  • Image processing
  • Frequency analysis
  • Frequency roughness
  • Image enhancement
  • Game design