Abstract
This article presents the results of the joint work of specialists in the field of image analysis and ophthalmologists on the task of analyzing images obtained by the method of optical coherence tomography angiography. A descriptive algorithmic scheme for analyzing images obtained using optical coherence tomography angiography is built to automate the detection of pathological changes in the morphometric characteristics of the fundus. The algorithmic scheme is based on the methods of image processing, analysis, and recognition. The previously developed feature space is supplemented and modified, based on which it is possible to identify pathological changes in the structure of the choroid plexuses of the human retina. It was possible to improve the accuracy of classifying images of healthy and pathological eyes, as well as significantly increasing the accuracy of classification of borderline cases. Software is created that makes it possible to accurately carry out differential diagnostics of the normal state of vessels from the pathological one in the offline mode, which increases its diagnostic value. It is planned to achieve higher classification accuracy results for all three cases.
Similar content being viewed by others
REFERENCES
N. Cheung, P. Mitchell, and T. Y. Wong, “Diabetic retinopathy,” Lancet 376, 124–146 (2010). https://doi.org/10.1016/S0140-6736(09)62124-3
Z. Chu, J. Lin, C. Gao, C. Xin, Q. Zhang, C.-Li Chen, L. Roisman, G. Gregori, P. J. Rosenfeld, and R. K. Wang, “Quantitative assessment of the retinal microvasculature using optical coherence tomography angiography,” J. Biomed. Opt. 21, 066008 (2016). https://doi.org/10.1117/1.JBO.21.6.066008
I. Dedov, M. Shestakova, and O. Vikulova, “Epidemiology of diabetes mellitus in Russian Federation: Clinical and statistical report according to the federal diabetes registry,” Diabetes Mellitus 20 (1), 13–41 (2017). https://doi.org/10.14341/DM8664
D. S. Fong, J. Gottlieb, F. L. Ferris, and R. Klein, “Understanding the value of diabetic retinopathy screening,” Arch. Ophthalmol. 119, 758–760 (2001). https://doi.org/10.1001/archopht.15.758
D. Gildea, “The diagnostic value of optical coherence tomography angiography indiabetic retinopathy: A systematic review,” Int. Ophthalmol. 39, 2413–2433 (2019). https://doi.org/10.1007/s10792-018-1034-8
I. B. Gurevich, D. V. Harazishvili, O. Salvetti, A. A. Trykova, and I. A. Vorob’ev, “Elements of the information technology of cytological specimens analysis: Taxonomy and factor analysis,” Pattern Recognit. Image Anal. 16, 114–116 (2006). https://doi.org/10.1134/S1054661806010366
I. B. Gurevich, V. V. Yashina, S. V. Ablameyko, A. M. Nedzved, A. M. Ospanov, A. T. Tleubaev, A. A. Fedorov, and N. A. Fedoruk, “Development and experimental investigation of mathematical methods for automating the diagnostics and analysis of ophthalmological images,” Pattern Recognit. Image Anal. 28, 612–636 (2018). https://doi.org/10.1134/S1054661818040120
I. B. Gurevich, V. V. Yashina, A. A. Fedorov, A. M. Nedzved, and A. T. Tleubaev, “Development, investigation, and software implementation of a new mathematical method for automatizing analysis of corneal endothelium images,” Pattern Recognit. Image Anal. 27, 550–559 (2017). https://doi.org/10.1134/S1054661817030130
I. B. Gurevich, V. V. Yashina, A. A. Fedorov, A. M. Nedzved, and A. M. Ospanov, “Development, investigation, and software implementation of a new mathematical method for automated identification of the lipid layer state by the images of eyelid intermarginal space,” Pattern Recognit. Image Anal. 27, 538–549 (2017). https://doi.org/10.1134/S1054661817030129
I. B. Gurevich, Yu. I. Zhuravlev, A. A. Myagkov, Yu. O. Trusova, and V. V. Yashina, “On basic problems of image recognition in neurosciences and heuristic methods for their solution,” Pattern Recognit. Image Anal. 25, 132–160 (2015). https://doi.org/10.1134/S105466181501006X
I. Gurevich and V. Yashina, “Basic models of descriptive image analysis,” in Pattern Recognition. ICPR Int. Workshops and Challenges. ICPR 2021, Ed. by A. Del Bimbo, Lecture Notes in Computer Science, Vol. 12665 (Springer, Cham, 2021), pp. 275–288. https://doi.org/10.1007/978-3-030-68821-9_26
I. B. Gurevich, M. V. Budzinskaya, V. V. Yashina, A. M. Nedzved, A. T. Tleubaev, V. G. Pavlov, and D. V. Petrachkov, “A new method for automating the diagnostic analysis of human fundus images obtained using optical coherent tomography angiography,” Pattern Recognit. Image Anal. 31, 513–528 (2021). https://doi.org/10.1134/S1054661821030111
T. Hirano, K. Hoshiyama, K. Hirabayashi, M. Wakabayashi, Yu. Toriyama, M. Tokimitsu, and T. Murata, “Vitreoretinal interface slab in OCT angiography for detecting diabetic retinal neovascularization,” Ophthalmol. Retina 4, 588–594 (2020). https://doi.org/10.1016/j.oret.2020.01.004
T. Hirano, J. Kitahara, Yu. Toriyama, H. Kasamatsu, T. Murata, S. Sadda, “Quantifying vascular density and morphology using different swept-source optical coherence tomography angiographic scan patterns in diabetic retinopathy,” Br. J. Ophthalmol. 103, 216–221 (2019). https://doi.org/10.1136/bjophthalmol-2018-311942
J. V. B. Soares, J. J. G. Leandro, R. M. Cesar, H. F. Jelinek, and M. J. Cree, “Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification,” IEEE Trans. Med. Imaging 25, 1214–1222 (2006). https://doi.org/10.1109/TMI.2006.879967
O. V. Nedzvedz, S. V. Ablameyko, I. B. Gurevich, and V. V. Yashina, “A new method for automazing of stem cell populations investigation based on the integral optical flow of a video sequence analysis,” Pattern Recognit. Image Anal. 27, 599–609 (2017). https://doi.org/10.1134/S1054661817030221
A. Olvera-Barrios, T. F. Heeren, K. Balaskas, R. Chambers, L. Bolter, C. Egan, A. Tufail, and J. Anderson, “Diagnostic accuracy of diabetic retinopathy grading by an artificial intelligence-enabled algorithm compared with a human standard for wide-field true-colour confocal scanning and standard digital retinal images,” Br. J. Ophthalmol. 105, 265–270 (2020). https://doi.org/10.1136/bjophthalmol-2019-315394
N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Trans. Syst., Man, Cybern. 9, 62–66 (1979). https://doi.org/10.1109/TSMC.1979.4310076
J. Sauvola and M. Pietikäinen, “Adaptive document image binarization,” Pattern Recognit. 33, 225–236 (2000). https://doi.org/10.1016/S0031-3203(99)00055-2
S. H. Sinclair and C. Delvecchio, “The internist’s role in managing diabetic retinopathy: Screening for early detection,” Cleveland Clin. J. Med. 71, 151–159 (2004). https://doi.org/10.3949/ccjm.71.2.151
L. G. Shapiro and G. C. Stockman, Computer Vision (Prentice Hall, Englewood, N.J., 2001).
R. F. Spaide, J. G. Fujimoto, N. K. Waheed, S. R. Sadda, and G. Staurenghi, “Optical coherence tomography angiography,” Prog. Retinal Eye Res. 64, 1–55 (2018). https://doi.org/10.1016/j.preteyeres.2017.11.003
R. F. Spaide, “Volume-rendered optical coherence tomography of diabetic retinopathy pilot study,” Am. J. Ophthalmol. 160, 1200–1210 (2015). https://doi.org/10.1016/j.ajo.2015.09.010
G. R. Untracht, R. S. Matos, N. Dikaios, M. Bapir, A. K. Durrani, T. Butsabong, P. Campagnolo, D. D. Sampson, C. Heiss, and D. M. Sampson, “OCTAVA: An open-source toolbox for quantitative analysis of optical coherence tomography angiography images,” PLoS ONE 16, e0261052 (2021). https://doi.org/10.1371/journal.pone.0261052
K. A. Vermeer, F. M. Vos, H. G. Lemij, and A. M. Vossepoel, “A model based method for retinal blood vessel detection,” Comput. Biol. Med. 34, 209–219 (2004). https://doi.org/10.1016/S0010-4825(03)00055-6
S. Vujosevic, S. J. Aldington, P. Silva, C. Hernández, P. Scanlon, T. Peto, and R. Simó, “Screening for diabetic retinopathy: New perspectives and challenges,” Lancet Diabetes Endocrinol. 8, 337–347 (2020). https://doi.org/10.1016/S2213-8587(19)30411-5
X. Yao, M. N. Alam, D. Le, and D. Toslak, “Quantitative optical coherence tomography angiography: A review,” Exp. Biol. Med. 245, 301–312 (2020). https://doi.org/10.1177/1535370219899893
B. Zhang, L. Zhang, L. Zhang, and F. Karray, “Retinal vessel extraction by matched filter with first-order derivative of Gaussian,” Comput. Biol. Med. 40, 438–445 (2010). https://doi.org/10.1016/j.compbiomed.2010.02.008
Funding
This study was partially supported by the Russian Foundation for Basic Research (grant no. 20-07-01031).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
COMPLIANCE WITH ETHICAL STANDARDS
This article is an entirely original work of its authors; it has not been published before and will not be sent to other publications unless the PRIA Editorial Board decides not to accept it for publication.
Conflict of Interest
The authors declare that they have no conflicts of interest.
Additional information
Igor B. Gurevich. Born August 24, 1938. Dr.-Eng. diploma engineer (Automatic Control and Electrical Engineering), 1961, National Research University “Moscow Power Engineering Institute, Moscow, USSR; Cand. Sci. (Mathematical Ccybernetics), 1975, Moscow Institute of Physics and Technology (National Research University), Moscow, USSR. Leading Researcher at the Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Moscow, Russia. He has worked since 1960 to date as an engineer, researcher, and lecturer in industry, research institutions, medicine, and universities, and since 1985 in the USSR/Russian Academy of Sciences. Area of expertise: mathematical theory of image analysis, image-mining, image understanding, mathematical theory of pattern recognition, theoretical computer science, medical informatics, applications of pattern recognition and image analysis techniques in biology, medicine and in automation of scientific research, and knowledge-based systems.
I.B. Gurevich proposed, proved, and developed with his pupils the descriptive approach to image analysis and recognition (DAIA). Within DAIA a new class of image algebra was introduced, defined, and investigated (descriptive image algebras); new types of image models were introduced, classified, and investigated; axioms of descriptive theory of image analysis were introduced; a common model of image recognition process was defined and investigated; new settings of image analysis and recognition problems were introduced; the notion of image equivalence was introduced and investigated; new classes of image recognition algorithms were defined and investigated; and an image formalization space was introduced, defined, and investigated.
The listed results were used in the development of software kits for image analysis and recognition, as well as for the solution of important and difficult applied problems of automated biomedical image analysis.
I.B. Gurevich is the author of 2 monographs and 307 papers in peer reviewed journals and proceedings indexed in the Web of Science, Scopus, and the Russian Science Citation Index on the platform of the Web of Science, 31 invited papers at international conferences, and holder of 8 patents. Web of Science: 22 papers; Scopus: 76 papers and 287 citations in 148 documents; Hirsh index, 10; Russian Science Citation Index on the platform of Web of Science: 129 papers; 910 citations; and Hirsh index, 11.
Vice-Chairman of the National Committee for Pattern Recognition and Image Analysis of the Russian Academy of Sciences, Member of the International Association for Pattern Recognition (IAPR) Governing Board (representative from RF), and IAPR Fellow. He has been the PI of 63 R&D projects as part of national and international research programs. Vice-Editor-in-Chief of the Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications, the international journal of the RAS, member of editorial boards of several international scientific journals, and member of the program and technical committees of many international scientific conferences. Teaching experience: Moscow State University, RF (Assistant Professor), Dresden Technical University, Germany (Visiting Professor), and George Mason University, United States (Research Fellow). He was supervisor of 6 PhD students and many graduate and master students.
Vera V. Yashina. Born September 13, 1980. Diploma in mathematics, Moscow State University (2002). Cand. Sci. (Theoretical Foundations of Informatics), 2009, Dorodnicyn Computing Center of the Russian Academy of Sciences, Moscow. Leading Researcher at the Department “Recognition, security and analysis of information” at the Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, Moscow. She has worked from 2001 to date at the Russian Academy of Sciences. Scientific expertise: mathematical theory of image analysis, image algebras, models, and medical informatics.
Her main results were obtained in the mathematical theory of image analysis: descriptive image algebras with one ring were defined, classified, and investigated; a new topological image formalization space was specified and investigated; and descriptive generating trees were defined, classified, and investigated. The listed results were applied in biomedical imaging analysis.
She is the scientific secretary of the National Committee for Pattern Recognition and Image Analysis of the Presidium of the Russian Academy of Sciences. She is a member of the Educational and Membership Committees of the International Association for Pattern Recognition. She is a Vice Chair of Technical Committee no. 16 “Algebraic and Discrete Mathematical Techniques in Pattern Recognition and Image Analysis” of the International Association for Pattern Recognition. She has been a member of many R&D projects as part of national and international research programs. Member of the Editorial Board of Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications, the international journal of the RAS. Author of 79 papers in peer-reviewed journals, as well as conference and workshop proceedings. Web of Science: 11 papers; Hirsh index, 4; Scopus: 40 papers, 162 citations in 75 papers; Hirsh index, 8; Russian Science Citation Index on the platform of the Web of Science: 56 papers; 255 citations; Hirsh index, 9. She has received several awards for presenting the best young scientist papers at international conferences. Teaching experience: Moscow State University, Moscow, Russia. She has supervised several graduate and master’s students.
Adil T. Tleubaev. Born February 13, 1994. Graduated from Moscow State University in computational mathematics and cybernetics in 2018. Research interests: pattern recognition, image analysis, machine learning
Rights and permissions
About this article
Cite this article
Gurevich, I.B., Yashina, V.V. & Tleubaev, A.T. Research and Development of the Method for Automating the Diagnostic Analysis of Human Fundus Images Produced by Optical Coherent Tomography Angiography. Pattern Recognit. Image Anal. 32, 533–544 (2022). https://doi.org/10.1134/S1054661822030154
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S1054661822030154