Abstract
Introduction
Phoropters are widely accepted for clinical use in refraction examination and visual function assessment. This study assessed the reliability of the new Inspection Platform of Visual Function (IPVF) in comparison with the conventional equipment phoropter (TOPCON VT-10) in visual function assessment.
Methods
This prospective study enrolled 80 eyes of 80 healthy subjects. The horizontal phoria at distance and near (Phoria_D and Phoria_N, respectively) was measured with the von Graefe method, negative/positive relative accommodation (NRA/PRA) was measured with the positive/negative lens method, and accommodative amplitude (AMP) was measured with the minus lens method. Data of three consecutive measurements with each instrument were evaluated using the intraclass correlation coefficient (ICC) for repeatability, and the agreement of the two instruments was evaluated using a Bland–Altman plot.
Results
The ICCs of the three consecutive measurements for phoria, NRA/PRA, and AMP using the IPVF instrument were high (0.87–0.96), indicating high repeatability. The ICCs of the three consecutive measurements using the phoropter were high (0.914–0.983) for phoria, NRA, and AMP, indicating high repeatability, while that of PRA was 0.732 (between 0.4 and 0.75), indicating acceptable repeatability. The 95% limits of agreement of phoria, NRA/PRA, and AMP were narrow, indicating good agreement between the two instruments.
Conclusion
The repeatability of both instruments was high, and the IPVF instrument was slightly better in terms of PRA repeatability than the phoropter. The agreement of phoria, NRA/PRA, and AMP measured by the new IPVF instrument and phoropter was also satisfactory.
Plain Language Summary
Nonstrabismic binocular dysfunctions (NBD) are common vision abnormalities. The relevant indicators involved in NBD are accommodative anomalies, convergence and divergence anomalies, and phoria. Convergence and divergence anomalies are disorders of binocular vision that result in either a failure of fusion or an inability to accurately integrate and stabilize retinal images from both eyes into a single representation. Phoria is the tendency of the eyes not to be directed towards the point of fixation, manifested in the absence or prevention of fusion. Measurement of accommodation and phoria are two particularly important components of comprehensive eye examination. Phoropter is widely used in ophthalmic clinics and optical stores for refraction examination and visual function assessment. It largely depends on the examiner’s training, skill, and experience, which leads to high inter-examiner variability. In large-scale eye screening or busy hospital hours, examinees have to be inspected one by one using traditional instruments, which can be time consuming and tiring for optometrists, and can cause long queuing time for examinees. In this study, we evaluated the possibility of an alternative automatic diagnostic instrument for the assessment of binocular visual function. The platform is a new type of intelligent visual function inspection equipment with good reliability, and could be an alternative for clinicians to obtain visual function measurements with improved efficiency and fewer subjective errors. The use of this automatic instrument can avoid inter-examiner variability, helping to resolve the shortage problem of optometrists in China and offer a better testing service to eye examinees.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Phoropters are widely accepted for clinical use in refraction examination and visual function assessment. It can be time-consuming and tiring for optometrists. |
The repeatability of the new Inspection Platform of Visual Function (IPVF) and the conventional equipment phoropter were high, and the IPVF instrument was slightly better in terms of positive relative accommodation (PRA) repeatability than the phoropter. |
The agreement of phoria, negative relative accommodation (NRA)/PRA, and AMP measured by the new IPVF instrument and phoropter was also satisfactory. |
The IPVF instrument could be an alternative for clinicians to obtain visual function measurements with improved efficiency and fewer subjective errors. |
Introduction
Nonstrabismic binocular dysfunctions are common vision abnormalities, with a prevalence of 2–61.7% for accommodative insufficiency and that of 2.25–33% for convergence insufficiency [1]. They have been studied since the 1980s [1,2,3]. Their relevant indicators are accommodative anomalies, convergence and divergence anomalies, and phoria [1, 2, 4, 5]. Measurements of accommodation and phoria are important components of comprehensive eye examinations. Accommodation is the ability of the eyes to change the refractive power to focus objects on the retina at varying distances [6]. Phoria is the tendency of the eyes to not be directed towards the point of fixation, manifested in the absence or prevention of fusion. Amplitude of accommodation (AMP) is usually measured using the minus lens and push-up or push-down methods [7, 8]. Clinical measurement methods for phoria include the von Graefe, Maddox rod, Maddox wing, Thorington, and modified Thorington methods. These methods largely depend on the examiner’s training, skills, and experience, which leads to high inter-examiner variability [9, 10].
Phoropters are widely accepted for clinical use in refraction examination and visual function assessment. They are used by optometrists with professional training. In large-scale eye screening or busy hospital hours, patients must be inspected individually using conventional instruments, which can be time consuming and tiring for optometrists and cause long queuing time for patients.
The aim of this study was to evaluate the possibility of an alternative automatic diagnostic instrument to assess binocular visual function. Using this automatic instrument can avoid inter-examiner variability, helping to resolve the shortage of optometrists, and offer a better testing service to eye examinees. The Inspection Platform of Visual Function (IPVF, Youyan Zhiqiang, China) is a newly developed visual function measurement and diagnosis equipment that can automatically perform visual function tests, including Worth 4 Dot, stereopsis, phoria, range of positive/negative fusional vergence, vergence facility, negative/positive relative accommodation (NRA/PRA), accommodative response, accommodative amplitude (AMP), accommodative facility, and accommodation convergence/accommodation tests. Owing to time constraints, only the measurements of Phoria_D, Phoria_N, NRA/PRA, and AMP were included in this study. We assessed whether the repeatability of the inspection platform was equal to or better than that of the conventional equipment. Additionally, we evaluated whether the new and conventional equipment could yield consistent measurement results in the same visual function tests.
Methods
Study Population
This study followed the tenets of the Declaration of Helsinki, and approval of the experimental protocol was obtained from the ethics committee of the Eye Hospital of Wenzhou Medical University (approval No. 2022. 013). Healthy volunteers aged 18–25 years were enrolled. All participants provided consent before enrollment in the study. Inclusion criteria were: best-corrected Snellen visual acuity ≥ 1.0, no manifest strabismus/intermittent exotropia, no history of ocular trauma, no ocular diseases except refractory errors (confirmed using slit-lamp biomicroscopes by an ophthalmologist), no diabetes mellitus, and no current medication potentially affecting accommodation, such as topiramate, topical atropine, pilocarpine, or tropicamide.
Devices
Conventional manual measurements were performed using a phoropter (TOPCON VT-10, Japan). The phoropter is a commonly used instrument for eye examinations. The phoropter used in this study was manually operated. It could perform the following tests: Worth 4-dot, stereopsis, phoria, positive/negative fusion vergence, accommodative function (NRA/PRA; accommodative response, AMP), and accommodation convergence/accommodation.
The IPVF instrument consists of four parts: a lens unit (a standard refractor head controlled by an electric motor), an optotype unit (that can switch between distance and near modes under the control of the electric motor), a control pad, and an integrated device (Fig. 1). The first three parts are connected to the integrated device. The lens unit provides the lens used for all tests. The optotype unit is used to display targets at a distance of 40 cm or 5 m. The control pad uses voice to guide participants to the control handle or press buttons and receive feedback. The integrated device is the core control unit of the platform, and its core functions are as follows: to provide guidance to participants through voice prompts or graphical display, to integrate the functions of the lens and optotype units, to receive feedback from participants and adjust the test procedures accordingly, and to record and analyze the test data.
Procedures
The same examiner with professional training worked on both the IPVF instrument and the phoropter. The same optometrist performed three consecutive tests. Whether the two instruments were used first for a participant was random. The participants were provided with 5 min to rest their eyes between tests. All participants were refractively corrected at distance. During the tests, 40 cm was used for close distance, and 5 m was used for long distance. The optotype used in NRA, PRA, and AMP tests corresponded to one line above the best-corrected visual acuity of the participant. The pupil distance was adjusted according to the test distance.
Using the phoropter, Phoria_D and Phoria_N were measured with the von Graefe method. A prism of 12 ∆BI in the right eye and 6 ∆BU in the left eye was used to split the target into two parts. The prismatic degree of the right eye was reduced at a rate of 2 ∆/s until the participant could align the two targets vertically. The final prismatic degree used was the participant’s phoria. The total value of the positive/negative lens added to both eyes to achieve the last clear vision before continuous blurriness was the participant’s NRA/PRA. The AMP of the right eye (ODAMP) was measured using the minus lens method. The sum of the negative lens used to reach the last clear vision before an unrecoverable blurriness plus 2.5 D was the final AMP.
Using the IPVF instrument, automatic measurements of Phoria_D, Phoria_N, NRA/PRA, and AMP were performed with the platform real-time interaction with the participant. During the testing process, no assistance from optometrists was required. Measurement procedures using the platform followed the same principle as those used in the phoropter; however, the optometrist’s operation was replaced by the platform’s automatic control, which was guided by the platform’s interaction with the participant.
Statistical Analysis
Statistical analyses were performed using SPSS version 20.0 (SPSS, Inc., Chicago, IL, USA). The data of three consecutive measurements of Phoria_D and Phoria_N, NRA/PRA, and ODAMP by the phoropter and the IPVF were evaluated using the intraclass correlation coefficient (ICC) and within-subject standard deviation (Sw) for repeatability [11, 12]. Besides, the mean test values of the two instruments were evaluated using the Bland–Altman plot for agreement. The 95% limit of agreement (LoA) was defined as the mean ± 1.96 standard deviation of the differences [13, 14]. Medcalc version 19.2.6 (MedCalc Software bv, Ostend, Belgium) was used for power and sample size calculations. A sample size of 80 subjects was estimated to detect a difference between measurements of AMP in the two instruments, based on expected mean of differences 1.0 D and expected standard deviation of differences 0.397 D.
Results
Over 80 healthy participants aged 18–25 years were enrolled. The phoria test was performed for 25 male and 57 female participants. The NRA/PRA test was performed for 20 male and 60 female participants. The AMP test was performed for 23 male and 58 female participants.
Repeatability in the Measurements of Phoria, NRA/PRA, and ODAMP
Table 1 displays the results of the IPVF instrument, and Table 2 displays the results of the phoropter. The ICCs of the repeatability of the three consecutive measurements using the IPVF instrument were: Phoria_D, 0.958; Phoria_N, 0.964; NRA, 0.872; PRA, 0.937; and ODAMP, 0.929. The Sw of the repeatability of the three consecutive measurements using the IPVF instrument were: Phoria_D, 0.084; Phoria_N, 0.101; NRA, 0.014; PRA, 0.032; and ODAMP, 0.048. The ICCs of the repeatability of the three consecutive measurements using the phoropter were: Phoria_D, 0.978; Phoria_N, 0.983; NRA, 0.914; PRA, 0.732; and ODAMP, 0.952. The Sw of the repeatability of the three consecutive measurements using the phoropter were: Phoria_D, 0.047; Phoria_N, 0.079; NRA, 0.011; PRA, 0.065; and ODAMP, 0.036.
Agreement in the Measurements of Phoria, NRA/PRA, and ODAMP
The Bland–Altman plots were used to evaluate the agreement between the two instruments (Figs. 2, 3, 4, 5 and 6). The mean difference of the mean test values of phoria, NRA/PRA, and AMP between the two instruments were close to zero. Almost all dots in the Bland–Altman plots were plotted with the accepted threshold of 95% LoAs between the two instruments, and the 95% LoAs were all narrow.
Discussion
The IPVF is a newly developed visual function measurement and diagnostic instrument that can automatically measure visual function. However, no research has been conducted on its accuracy. In the present study, we compared the platform with the conventional equipment phoropter and concluded that the new instrument performed well in both repeatability and agreement tests.
A previous study with a similar age range (mean age: 24.3 years) as this study compared the repeatability of the AMP test using the minus lens methods and found that the coefficient of repeatability (COR) was ± 1.43 D [7]. Antona et al. [8]. also assessed the repeatability of the same methods of measuring AMP. Their results indicated that the COR was ± 2.52 D, drawing a conclusion with high repeatability. The current study demonstrated resembles results with the ICC almost close to 1. In addition, researchers have focused on the degree of repeatability of AMP using different methods (push-up, push-down, and minus lens methods) and discovered different conclusions [15, 16]. Therefore, further research is still needed to determine the repeatability of the IPVF for AMP measurement using push-up and push-down methods. Previous studies on the repeatability of phoria using von Graefe, Thorington, and modified Thorington methods showed a high repeatability, regardless of the test method used [17,18,19]. In the current study, high repeatability (ICC > 0.75) among the three consecutive measurements was achieved for all tests performed using the new instrument, with ICCs of Phoria_D and Phoria_N over 0.950 (0.958 and 0.964, respectively). When the phoropter was used, high repeatability was generated in Phoria_D, Phoria_N, NRA, and ODAMP, with ICCs over 0.90 (0.91–0.98), and a lower but acceptable repeatability in PRA (ICC = 0.73). The data described above indicate that the repeatability of all included tests using the new instrument was equal to or slightly better than that using the phoropter.
The measurement of visual function using the phoropter can be affected by the following factors: proficiency and operating standards of examiners, consistency and effectiveness of examination language, comprehensive ability of the participant, accuracy of participant feedback, the participant’s ability to accurately comprehend the examiner’s feedback, and the examiner’s ability to accurately calculate and record the test result. However, the standard operation and language protocol of the new instrument ensured that each test had the same tone of speaking, speed of voice prompt, and lens switch. In addition, in the program setting, each test was independent; therefore, it was not affected by the previous test. Instead of manual operation, the automatic program and instrument ensured a standard measurement procedure, consistent test language, accurate reception of the participant feedback, and precise calculation and recording of the test result. This might be the reason for the better repeatability of the PRA test by the platform than that of the phoropter.
The Bland–Altman plot is a commonly used and widely accepted method to test the agreement between two measurement methods [20]. Therefore, it was adopted to test the agreement between the new instrument and the phoropter. The maximum absolute 95% LoAs of Phoria_D, Phoria_N, NRA, PRA, and ODAMP were 5.682 Δ, 4.750 Δ, 0.564 D, 1.772 D, and 2.073 D, respectively (Table 3). The 95% LoAs were all narrow, indicating high agreement between the two instruments. Rami Aboumourad et al. used dynamic retinoscopy to obtain objective measures of AMP and compared them with the subjective push-up technique. Since the difference less than 2 D means no systematic bias, they concluded that the two techniques can be interchangeable in clinical use (range of 95% LoA: −1.87 to 1.92 D)[21]. In addition, compared with the study on assessing the agreement of four different methods used to determine the accommodative response [22], in which the 95% LoAs in the Bland–Altman plot in the accommodative response test was 0.87–1.74 D, the 95% LoA between the new instrument and the phoropter in the current study was similar. Because of the automaticity of the integrated platform, during the test the participant is only required to follow simple steps of operation, mostly pressing buttons on the control pad. The instrument provides clear and easy-to-follow instructions, and relatively reliable measurement results can be easily obtained. Phoropters are manually operated by an optometrist throughout the process. Multiple participants can be tested simultaneously, under the supervision of only one optometrist. Thus, the intelligent integrated platform may be more convenient.
This study had some limitations. In addition to examiner-related factors, the factors related to participants should be considered as well, because the participants’ comprehension and ability to provide accurate feedback, which depends on their age, education level, etc., also affect the accuracy of test results. The age range in this study was 18–25 years, and the interaction language was Mandarin. Whether the validity and reliability of the test results using the new instrument can be extended to a wider age range and to people who are accustomed to using other dialects requires further investigation. In the current study, a measurement of the time required for the examination was not done.
Conclusions
The intelligent integrated platform, in comparison with the phoropter, performed well in both repeatability and agreement tests. The platform is a new type of intelligent visual function inspection instrument with good reliability, and it could be an alternative for clinicians to obtain visual function measurements with improved efficiency and fewer subjective errors.
References
Cacho-Martínez P, García-Muñoz Á, Ruiz-Cantero MT. Do we really know the prevalence of accomodative and nonstrabismic binocular dysfunctions? J Optom. 2011;3(4):185–97.
Cacho-Martínez P, García-Muñoz Á, Ruiz-Cantero M. Is there any evidence for the validity of diagnostic criteria used for accommodative and nonstrabismic binocular dysfunctions? Journal of optometry. 2014;7(1):2–21.
Hokoda SC. General binocular dysfunctions in an urban optometry clinic. J Am Optom Assoc. 1985;56(7):560–2.
Tait EF. Accommodative convergence. Am J Ophthalmol. 1951;34(8):1093–107.
Zellers JA, Alpert TL, Rouse MW. A review of the literature and a normative study of accommodative facility. J Am Optom Assoc. 1984;55(1):31–7.
Hamasaki D, Ong J, Marg E. The amplitude of accommodation in presbyopia. Am J Optom Arch Am Acad Optom. 1956;33(1):3–14.
Rosenfield M, Cohen AS. Repeatability of clinical measurements of the amplitude of accommodation. Ophthalmic Physiol Opt. 1996;16(3):247–9.
Ingram RM, Gill LE, Goldacre MJ. Emmetropisation and accommodation in hypermetropic children before they show signs of squint—a preliminary analysis. Bull Soc Belge Ophtalmol. 1994;253:41–56.
Johns HA, Manny RE, Fern K, Hu YS. The intraexaminer and interexaminer repeatability of the alternate cover test using different prism neutralization endpoints. Optom Vis Sci. 2004;81(12):939–46.
Casillas Casillas E, Rosenfield M. Comparison of subjective heterophoria testing with a phoropter and trial frame. Optom Vis Sci. 2006;83(4):237–41.
Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.
Liljequist D, Elfving B, Skavberg RK. Intraclass correlation—a discussion and demonstration of basic features. PLoS ONE. 2019;14(7): e0219854.
Carkeet A. Exact parametric confidence intervals for Bland-Altman limits of agreement. Optom Vis Sci. 2015;92(3):e71-80.
McAlinden C, Khadka J, Pesudovs K. Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology. Ophthalmic Physiol Opt. 2011;31(4):330–8.
Chen AH, O’Leary DJ. Validity and repeatability of the modified push-up method for measuring the amplitude of accommodation. Clin Exp Optomet. 1998;81(2):63–71.
Rouse MW, Borsting E, Deland PN. Reliability of binocular vision measurements used in the classification of convergence insufficiency. Optom Vis Sci. 2002;79(4):254–64.
Facchin A, Maffioletti S. Comparison, within-session repeatability and normative data of three phoria tests. J Optom. 2021;14(3):263–74.
Goss D, Jennifer O, Reynolds L, Rebekah O, Todd E. Comparison of four dissociated phoria tests: reliability & correlation with symptom survey scores. J Behav Optom. 2010;21(4):99–104.
Cebrian JL, Antona B, Barrio A, Gonzalez E, Gutierrez A, Sanchez I. Repeatability of the modified Thorington card used to measure far heterophoria. Optom Vis Sci. 2014;91(7):786–92.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.
Aboumourad R, Anderson HA. Comparison of dynamic retinoscopy and autorefraction for measurement of Accommodative amplitude. Optom Vis Sci. 2019;96(9):670–7.
Antona B, Sanchez I, Barrio A, Barra F, Gonzalez E. Intra-examiner repeatability and agreement in accommodative response measurements. Ophthalmic Physiol Opt. 2009;29(6):606–14.
Acknowledgements
Funding
This work was supported in part by Science and Technology Planning Project of Zhejiang Province (Grant No. LGF19H120002); EYE & ENT Hospital of Fudan University High-level Talents Program (Grant No. 2021318); Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning. The funders had no role in study design, data collection and analysis, decision to publish, or reparation of the manuscript. The journal’s Rapid Service fee was funded by the authors.
Authorship
All authors conform to the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, account for the integrity of the whole work, and have approved the version to be published.
Author Contributions
Conception and design: Wei-Jun Cai, Sisi Lin, Jinhai Huang, Zhenguo Chen, Xiaomin Huang. Data collection: Wei-Jun Cai, Ruru Chen. Analysis and interpretation: Ran Zhuo, Xin Li, Jinjin Yu Jinhai Huang, Zhenguo Chen, Chenchen Xu, Xiaomin Huang. Drafting the manuscript: Wei-Jun Cai, Zhenguo Chen, Chenchen Xu, Xiaomin Huang. Review and editing: Ruru Chen, Ran Zhuo, Xin Li, Jinjin Yu, Jinhai Huang, Xiaomin Huang. All authors read and approved the final manuscript.
Disclosures
Wei-Jun Cai, Sisi Lin, Ruru Chen, Ran Zhuo, Xin Li, Jinjin Yu, Jinhai Huang, Zhenguo Chen, Chenchen Xu and Xiaomin Huang declare that they have no competing interests.
Compliance with Ethics Guidelines
The project conformed to the tenets of the Declaration of Helsinki and was granted ethical approval (Approval No. 2022. 013) from the ethics committee of the Eye Hospital of Wenzhou Medical University. Informed consent was given by all participants.
Data Availability
The other data generated during and/or analyzed during the current study are available from the corresponding author upon reasonable request.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
About this article
Cite this article
Cai, WJ., Lin, S., Chen, R. et al. Reliability and Agreement of an Integrated Platform for Intelligent Visual Function Measurement. Ophthalmol Ther 12, 1929–1937 (2023). https://doi.org/10.1007/s40123-023-00718-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40123-023-00718-9