Skip to main content
Log in

Research and Development of the Method for Automating the Diagnostic Analysis of Human Fundus Images Produced by Optical Coherent Tomography Angiography

  • SELECTED PAPERS OF THE 8th INTERNATIONAL WORKSHOP “IMAGE MINING. THEORY AND APPLICATIONS”
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

This article presents the results of the joint work of specialists in the field of image analysis and ophthalmologists on the task of analyzing images obtained by the method of optical coherence tomography angiography. A descriptive algorithmic scheme for analyzing images obtained using optical coherence tomography angiography is built to automate the detection of pathological changes in the morphometric characteristics of the fundus. The algorithmic scheme is based on the methods of image processing, analysis, and recognition. The previously developed feature space is supplemented and modified, based on which it is possible to identify pathological changes in the structure of the choroid plexuses of the human retina. It was possible to improve the accuracy of classifying images of healthy and pathological eyes, as well as significantly increasing the accuracy of classification of borderline cases. Software is created that makes it possible to accurately carry out differential diagnostics of the normal state of vessels from the pathological one in the offline mode, which increases its diagnostic value. It is planned to achieve higher classification accuracy results for all three cases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.

Similar content being viewed by others

REFERENCES

  1. N. Cheung, P. Mitchell, and T. Y. Wong, “Diabetic retinopathy,” Lancet 376, 124–146 (2010). https://doi.org/10.1016/S0140-6736(09)62124-3

    Article  Google Scholar 

  2. Z. Chu, J. Lin, C. Gao, C. Xin, Q. Zhang, C.-Li Chen, L. Roisman, G. Gregori, P. J. Rosenfeld, and R. K. Wang, “Quantitative assessment of the retinal microvasculature using optical coherence tomography angiography,” J. Biomed. Opt. 21, 066008 (2016). https://doi.org/10.1117/1.JBO.21.6.066008

    Article  Google Scholar 

  3. I. Dedov, M. Shestakova, and O. Vikulova, “Epidemiology of diabetes mellitus in Russian Federation: Clinical and statistical report according to the federal diabetes registry,” Diabetes Mellitus 20 (1), 13–41 (2017). https://doi.org/10.14341/DM8664

    Article  Google Scholar 

  4. D. S. Fong, J. Gottlieb, F. L. Ferris, and R. Klein, “Understanding the value of diabetic retinopathy screening,” Arch. Ophthalmol. 119, 758–760 (2001). https://doi.org/10.1001/archopht.15.758

    Article  Google Scholar 

  5. D. Gildea, “The diagnostic value of optical coherence tomography angiography indiabetic retinopathy: A systematic review,” Int. Ophthalmol. 39, 2413–2433 (2019). https://doi.org/10.1007/s10792-018-1034-8

    Article  Google Scholar 

  6. I. B. Gurevich, D. V. Harazishvili, O. Salvetti, A. A. Trykova, and I. A. Vorob’ev, “Elements of the information technology of cytological specimens analysis: Taxonomy and factor analysis,” Pattern Recognit. Image Anal. 16, 114–116 (2006). https://doi.org/10.1134/S1054661806010366

    Article  Google Scholar 

  7. I. B. Gurevich, V. V. Yashina, S. V. Ablameyko, A. M. Nedzved, A. M. Ospanov, A. T. Tleubaev, A. A. Fedorov, and N. A. Fedoruk, “Development and experimental investigation of mathematical methods for automating the diagnostics and analysis of ophthalmological images,” Pattern Recognit. Image Anal. 28, 612–636 (2018). https://doi.org/10.1134/S1054661818040120

    Article  Google Scholar 

  8. I. B. Gurevich, V. V. Yashina, A. A. Fedorov, A. M. Nedzved, and A. T. Tleubaev, “Development, investigation, and software implementation of a new mathematical method for automatizing analysis of corneal endothelium images,” Pattern Recognit. Image Anal. 27, 550–559 (2017). https://doi.org/10.1134/S1054661817030130

    Article  Google Scholar 

  9. I. B. Gurevich, V. V. Yashina, A. A. Fedorov, A. M. Nedzved, and A. M. Ospanov, “Development, investigation, and software implementation of a new mathematical method for automated identification of the lipid layer state by the images of eyelid intermarginal space,” Pattern Recognit. Image Anal. 27, 538–549 (2017). https://doi.org/10.1134/S1054661817030129

    Article  Google Scholar 

  10. I. B. Gurevich, Yu. I. Zhuravlev, A. A. Myagkov, Yu. O. Trusova, and V. V. Yashina, “On basic problems of image recognition in neurosciences and heuristic methods for their solution,” Pattern Recognit. Image Anal. 25, 132–160 (2015). https://doi.org/10.1134/S105466181501006X

    Article  Google Scholar 

  11. I. Gurevich and V. Yashina, “Basic models of descriptive image analysis,” in Pattern Recognition. ICPR Int. Workshops and Challenges. ICPR 2021, Ed. by A. Del Bimbo, Lecture Notes in Computer Science, Vol. 12665 (Springer, Cham, 2021), pp. 275–288. https://doi.org/10.1007/978-3-030-68821-9_26

    Book  Google Scholar 

  12. I. B. Gurevich, M. V. Budzinskaya, V. V. Yashina, A. M. Nedzved, A. T. Tleubaev, V. G. Pavlov, and D. V. Petrachkov, “A new method for automating the diagnostic analysis of human fundus images obtained using optical coherent tomography angiography,” Pattern Recognit. Image Anal. 31, 513–528 (2021). https://doi.org/10.1134/S1054661821030111

    Article  Google Scholar 

  13. T. Hirano, K. Hoshiyama, K. Hirabayashi, M. Wakabayashi, Yu. Toriyama, M. Tokimitsu, and T. Murata, “Vitreoretinal interface slab in OCT angiography for detecting diabetic retinal neovascularization,” Ophthalmol. Retina 4, 588–594 (2020). https://doi.org/10.1016/j.oret.2020.01.004

    Article  Google Scholar 

  14. T. Hirano, J. Kitahara, Yu. Toriyama, H. Kasamatsu, T. Murata, S. Sadda, “Quantifying vascular density and morphology using different swept-source optical coherence tomography angiographic scan patterns in diabetic retinopathy,” Br. J. Ophthalmol. 103, 216–221 (2019). https://doi.org/10.1136/bjophthalmol-2018-311942

    Article  Google Scholar 

  15. J. V. B. Soares, J. J. G. Leandro, R. M. Cesar, H. F. Jelinek, and M. J. Cree, “Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification,” IEEE Trans. Med. Imaging 25, 1214–1222 (2006). https://doi.org/10.1109/TMI.2006.879967

    Article  Google Scholar 

  16. O. V. Nedzvedz, S. V. Ablameyko, I. B. Gurevich, and V. V. Yashina, “A new method for automazing of stem cell populations investigation based on the integral optical flow of a video sequence analysis,” Pattern Recognit. Image Anal. 27, 599–609 (2017). https://doi.org/10.1134/S1054661817030221

    Article  Google Scholar 

  17. A. Olvera-Barrios, T. F. Heeren, K. Balaskas, R. Chambers, L. Bolter, C. Egan, A. Tufail, and J. Anderson, “Diagnostic accuracy of diabetic retinopathy grading by an artificial intelligence-enabled algorithm compared with a human standard for wide-field true-colour confocal scanning and standard digital retinal images,” Br. J. Ophthalmol. 105, 265–270 (2020). https://doi.org/10.1136/bjophthalmol-2019-315394

    Article  Google Scholar 

  18. N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Syst., Man, Cybern. 9, 62–66 (1979). https://doi.org/10.1109/TSMC.1979.4310076

    Article  Google Scholar 

  19. J. Sauvola and M. Pietikäinen, “Adaptive document image binarization,” Pattern Recognit. 33, 225–236 (2000). https://doi.org/10.1016/S0031-3203(99)00055-2

    Article  Google Scholar 

  20. S. H. Sinclair and C. Delvecchio, “The internist’s role in managing diabetic retinopathy: Screening for early detection,” Cleveland Clin. J. Med. 71, 151–159 (2004). https://doi.org/10.3949/ccjm.71.2.151

    Article  Google Scholar 

  21. L. G. Shapiro and G. C. Stockman, Computer Vision (Prentice Hall, Englewood, N.J., 2001).

    Google Scholar 

  22. R. F. Spaide, J. G. Fujimoto, N. K. Waheed, S. R. Sadda, and G. Staurenghi, “Optical coherence tomography angiography,” Prog. Retinal Eye Res. 64, 1–55 (2018). https://doi.org/10.1016/j.preteyeres.2017.11.003

    Article  Google Scholar 

  23. R. F. Spaide, “Volume-rendered optical coherence tomography of diabetic retinopathy pilot study,” Am. J. Ophthalmol. 160, 1200–1210 (2015). https://doi.org/10.1016/j.ajo.2015.09.010

    Article  Google Scholar 

  24. G. R. Untracht, R. S. Matos, N. Dikaios, M. Bapir, A. K. Durrani, T. Butsabong, P. Campagnolo, D. D. Sampson, C. Heiss, and D. M. Sampson, “OCTAVA: An open-source toolbox for quantitative analysis of optical coherence tomography angiography images,” PLoS ONE 16, e0261052 (2021). https://doi.org/10.1371/journal.pone.0261052

    Article  Google Scholar 

  25. K. A. Vermeer, F. M. Vos, H. G. Lemij, and A. M. Vossepoel, “A model based method for retinal blood vessel detection,” Comput. Biol. Med. 34, 209–219 (2004). https://doi.org/10.1016/S0010-4825(03)00055-6

    Article  Google Scholar 

  26. S. Vujosevic, S. J. Aldington, P. Silva, C. Hernández, P. Scanlon, T. Peto, and R. Simó, “Screening for diabetic retinopathy: New perspectives and challenges,” Lancet Diabetes Endocrinol. 8, 337–347 (2020). https://doi.org/10.1016/S2213-8587(19)30411-5

    Article  Google Scholar 

  27. X. Yao, M. N. Alam, D. Le, and D. Toslak, “Quantitative optical coherence tomography angiography: A review,” Exp. Biol. Med. 245, 301–312 (2020). https://doi.org/10.1177/1535370219899893

    Article  Google Scholar 

  28. B. Zhang, L. Zhang, L. Zhang, and F. Karray, “Retinal vessel extraction by matched filter with first-order derivative of Gaussian,” Comput. Biol. Med. 40, 438–445 (2010). https://doi.org/10.1016/j.compbiomed.2010.02.008

    Article  Google Scholar 

Download references

Funding

This study was partially supported by the Russian Foundation for Basic Research (grant no. 20-07-01031).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to I. B. Gurevich, V. V. Yashina or A. T. Tleubaev.

Ethics declarations

COMPLIANCE WITH ETHICAL STANDARDS

This article is an entirely original work of its authors; it has not been published before and will not be sent to other publications unless the PRIA Editorial Board decides not to accept it for publication.

Conflict of Interest

The authors declare that they have no conflicts of interest.

Additional information

Igor B. Gurevich. Born August 24, 1938. Dr.-Eng. diploma engineer (Automatic Control and Electrical Engineering), 1961, National Research University “Moscow Power Engineering Institute, Moscow, USSR; Cand. Sci. (Mathematical Ccybernetics), 1975, Moscow Institute of Physics and Technology (National Research University), Moscow, USSR. Leading Researcher at the Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Moscow, Russia. He has worked since 1960 to date as an engineer, researcher, and lecturer in industry, research institutions, medicine, and universities, and since 1985 in the USSR/Russian Academy of Sciences. Area of expertise: mathematical theory of image analysis, image-mining, image understanding, mathematical theory of pattern recognition, theoretical computer science, medical informatics, applications of pattern recognition and image analysis techniques in biology, medicine and in automation of scientific research, and knowledge-based systems.

I.B. Gurevich proposed, proved, and developed with his pupils the descriptive approach to image analysis and recognition (DAIA). Within DAIA a new class of image algebra was introduced, defined, and investigated (descriptive image algebras); new types of image models were introduced, classified, and investigated; axioms of descriptive theory of image analysis were introduced; a common model of image recognition process was defined and investigated; new settings of image analysis and recognition problems were introduced; the notion of image equivalence was introduced and investigated; new classes of image recognition algorithms were defined and investigated; and an image formalization space was introduced, defined, and investigated.

The listed results were used in the development of software kits for image analysis and recognition, as well as for the solution of important and difficult applied problems of automated biomedical image analysis.

I.B. Gurevich is the author of 2 monographs and 307 papers in peer reviewed journals and proceedings indexed in the Web of Science, Scopus, and the Russian Science Citation Index on the platform of the Web of Science, 31 invited papers at international conferences, and holder of 8 patents. Web of Science: 22 papers; Scopus: 76 papers and 287 citations in 148 documents; Hirsh index, 10; Russian Science Citation Index on the platform of Web of Science: 129 papers; 910 citations; and Hirsh index, 11.

Vice-Chairman of the National Committee for Pattern Recognition and Image Analysis of the Russian Academy of Sciences, Member of the International Association for Pattern Recognition (IAPR) Governing Board (representative from RF), and IAPR Fellow. He has been the PI of 63 R&D projects as part of national and international research programs. Vice-Editor-in-Chief of the Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications, the international journal of the RAS, member of editorial boards of several international scientific journals, and member of the program and technical committees of many international scientific conferences. Teaching experience: Moscow State University, RF (Assistant Professor), Dresden Technical University, Germany (Visiting Professor), and George Mason University, United States (Research Fellow). He was supervisor of 6 PhD students and many graduate and master students.

Vera V. Yashina. Born September 13, 1980. Diploma in mathematics, Moscow State University (2002). Cand. Sci. (Theoretical Foundations of Informatics), 2009, Dorodnicyn Computing Center of the Russian Academy of Sciences, Moscow. Leading Researcher at the Department “Recognition, security and analysis of information” at the Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Moscow. She has worked from 2001 to date at the Russian Academy of Sciences. Scientific expertise: mathematical theory of image analysis, image algebras, models, and medical informatics.

Her main results were obtained in the mathematical theory of image analysis: descriptive image algebras with one ring were defined, classified, and investigated; a new topological image formalization space was specified and investigated; and descriptive generating trees were defined, classified, and investigated. The listed results were applied in biomedical imaging analysis.

She is the scientific secretary of the National Committee for Pattern Recognition and Image Analysis of the Presidium of the Russian Academy of Sciences. She is a member of the Educational and Membership Committees of the International Association for Pattern Recognition. She is a Vice Chair of Technical Committee no. 16 “Algebraic and Discrete Mathematical Techniques in Pattern Recognition and Image Analysis” of the International Association for Pattern Recognition. She has been a member of many R&D projects as part of national and international research programs. Member of the Editorial Board of Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications, the international journal of the RAS. Author of 79 papers in peer-reviewed journals, as well as conference and workshop proceedings. Web of Science: 11 papers; Hirsh index, 4; Scopus: 40 papers, 162 citations in 75 papers; Hirsh index, 8; Russian Science Citation Index on the platform of the Web of Science: 56 papers; 255 citations; Hirsh index, 9. She has received several awards for presenting the best young scientist papers at international conferences. Teaching experience: Moscow State University, Moscow, Russia. She has supervised several graduate and master’s students.

Adil T. Tleubaev. Born February 13, 1994. Graduated from Moscow State University in computational mathematics and cybernetics in 2018. Research interests: pattern recognition, image analysis, machine learning

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gurevich, I.B., Yashina, V.V. & Tleubaev, A.T. Research and Development of the Method for Automating the Diagnostic Analysis of Human Fundus Images Produced by Optical Coherent Tomography Angiography. Pattern Recognit. Image Anal. 32, 533–544 (2022). https://doi.org/10.1134/S1054661822030154

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661822030154

Keywords:

Navigation