Comparison of the NEI-VFQ and OSDI questionnaires in patients with Sjögren's syndrome-related dry eye
- 12k Downloads
To examine the associations between vision-targeted health-related quality of life (VT-HRQ) and ocular surface parameters in patients with Sjögren's syndrome, a systemic autoimmune disease characterized by dry eye and dry mouth.
Forty-two patients fulfilling European / American diagnostic criteria for Sjögren's syndrome underwent Schirmer testing without anesthesia, ocular surface vital dye staining; and measurement of tear film breakup time (TBUT). Subjects were administered the Ocular Surface Disease Index (OSDI) and the 25-item National Eye Institute Vision Functioning Questionnaire (NEI-VFQ). Main outcome measures included ocular surface parameters, OSDI subscales describing ocular discomfort (OSDI-symptoms), vision-related function (OSDI-function), and environmental triggers, and NEI-VFQ subscales.
Participants (aged 31–81 y; 95% female) all had moderate to severe dry eye. Associations of OSDI subscales with the ocular parameters were modest (Spearman r (ρ) < 0.22) and not statistically significant. Associations of NEI-VFQ subscales with the ocular parameters reached borderline significance for the near vision subscale with TBUT (ρ = 0.32, p = .05) and for the distance vision subscale with van Bijsterveld score (ρ = 0.33, p = .04). The strongest associations of the two questionnaires were for: ocular pain and mental function with OSDI-symptoms (ρ = 0.60 and 0.45, respectively); and general vision, ocular pain, mental function, role function, and driving with OSDI-function (ρ = 0.60, 0.50, 0.61, 0.64, 0.57, and 0.67, respectively).
Associations between conventional objective measures of dry eye and VT-HRQ were modest. The generic NEI-VFQ was similar to the disease-specific OSDI in its ability to measure the impact of Sjögren's syndrome-related dry eye on VT-HRQ.
List of abbreviations
Vision-targeted health-related quality of life
Tearfilm breakup time
Ocular Surface Disease Index
National Eye Institute Visual Function Questionnaire
Dry eye is a common disorder of the ocular surface and tear film and is estimated to affect from 2% to over 15% of persons in surveyed populations, depending on the definition used [1, 2, 3, 4, 5, 6]. Symptoms of dry eye are a major reason to seek ophthalmic care: a study by Nelson and co-workers found that 1.3% of Medicare patients had a primary diagnosis of keratoconjunctivitis sicca or dry eye . Dry eye can range from mild to severe disease; although the majority of patients with dry eye experience ocular discomfort without serious vision-threatening sequelae, severe dry eye can compromise corneal integrity by causing epithelial defects, stromal infiltration, and ulceration, and can result in visually significant scarring . Moderate to severe dry eye disease can adversely affect performance of visually demanding tasks due to pain and impaired vision . In addition, corneal surface irregularity due to epithelial desiccation, quantified by using corneal topography, can decrease visual acuity .
Patient-reported measurements used to evaluate the specific impact of eye disease and vision on symptoms (discomfort), functioning (the ability to carry out activities in daily life), and perceptions (concern about one's health) are referred to as vision-targeted health-related quality of life (VT-HRQ) instruments. Valid and reliable measurements of VT-HRQ have become essential to the assessment of disease status and treatment effectiveness in ocular disease . There are two general categories of VT-HRQ instruments: generic, which are designed to be used for a broad spectrum of visual disorders and ocular disease; and disease-specific, which are tailored toward particular aspects of a specific ocular disorder. In general, disease-specific instruments tend to be more sensitive than generic ones in detecting VT-HRQ impairments ; however, generic instruments allow comparisons across more diverse populations and diseases . In addition, generic instruments may be able to capture additional aspects of systemic disease, related to the ocular disorder in question, providing a broader characterization of health-related quality of life [14, 15]. There is therefore no clear-cut basis in a given study or population for choosing a generic versus a disease-specific measure: if possible, both should be utilized to determine whether one or the other is more consistent with clinical indicators, or if one appears to obtain additional, relevant information on patient status . However, it may be the case that weak-to-moderate associations between clinical indicators and quality-of-life measures indicates that the VT-HRQ measure is capturing elements of disease above and beyond those that can be measured clinically (for example, visual acuity may be good but a patient may have problems with functioning related to problems with contrast sensitivity or glare disability). Again, depending on the characterization of the disease desired and the goal of the study, a researcher might choose an instrument that either is or is not strongly correlated with clinical signs.
The measurement of the impact of dry eye on a patient's daily life, particularly symptoms of discomfort, is a critical aspect of characterizing the disease . Despite the fact that most studies have found weak or no correlations between symptoms and signs of dry eye [18, 19, 20], symptoms are often the motivation for seeking eye care and are therefore a critical outcome measure when assessing treatment effect , and hence are increasingly used as a surrogate for ocular surface disease in many epidemiologic studies. Indeed, recent studies have focused on developing more robust ways of measuring patient-reported symptoms of dry eye [21, 22, 23]. The Ocular Surface Disease Index (OSDI)©  was developed to quantify the specific impact of dry eye on VT-HRQ.
Sjögren's Syndrome is an autoimmune systemic disease characterized by dry mouth and dry eye signs and symptoms [25, 26]. Its manifestations include fatigue, arthritis, neuropathy, and pulmonary and renal disease. Histopathologic evidence of salivary gland inflammation and the presence of serum autoantibodies SSA or SSB are important diagnostic features of the disease . Sjögren's Syndrome has been stated to be the second most common autoimmune disease, ranking between rheumatoid arthritis and systemic lupus erythematosus . In the U.S., it is estimated that between 1 and 4 million persons (approximately 1–2 in 200) have Sjögren's Syndrome . Prevalence estimates for other countries range from 0.3 to 4.8% . Female gender and older age are known risk factors for Sjögren's syndrome . A wide range of studies have assessed the ocular manifestations of Sjögren's syndrome [31, 32, 33]; however, assessment of symptoms and quality of life have been limited and, in most cases, generic measures of well-being, psychological distress, and fatigue without ocular dimensions have been employed [34, 35, 36, 37, 38, 39, 40]. Further, while there are many published studies of VT-HRQ in mild to moderate dry eye, there are few publications on VT-HRQ in Sjögren's syndrome, which is characterized by dry eye causing significant ocular irritation as well as systemic disease factors that could have their own additional significant impact on VT-HRQ.
Our purpose in this study was to examine VT-HRQ in patients with primary Sjögren's syndrome, using a generic and a dry-eye-disease-specific instrument. We examined the associations of ocular surface parameters with the VT-HRQ scores, hypothesizing that the disease-specific instrument would be more closely related than the generic to the clinical markers of disease. We also examined the association of the generic and disease-specific VT-HRQ scores with each other.
The study protocol was approved by the National Eye Institute Internal Review Board. All patients completed an informed consent prior to examination. Consecutive patients with diagnosed primary Sjögren's syndrome were recruited from the NIH Clinical Center, Bethesda, MD. The diagnosis of primary Sjögren's syndrome was based on European-American criteria, which requires at least four of the following six features: signs and symptoms of dry eye and of dry mouth, histopathologic evidence of inflammation on minor salivary gland biopsy, and positive anti-Ro or anti-La antibodies.
Before the clinical examination, a trained interviewer administered two questionnaires (described further below) to measure VT-HRQ to each patient. The subsequent clinical examination included a comprehensive anterior segment evaluation, including slit lamp biomicroscopy, evaluation of lid margin thickness and hyperemia, conjunctival erythema, chemosis, tear film debris and mucus, and extent of meibomian gland plugging. Tests of tear function and ocular surface status were performed as described below.
The OSDI  (provided by Allergan, Inc. Irvine, CA) was used to quantify the specific impact of dry eye on VT-HRQ. This disease-specific questionnaire includes three subscales: ocular discomfort (OSDI-symptoms), which includes symptoms such as gritty or painful eyes; functioning (OSDI-function), which measures limitation in performance of common activities such as reading and working on a computer; and environmental triggers (OSDI-triggers), which measures the impact of environmental triggers, such as wind or drafts, on dry eye symptoms. The questions are asked with reference to a one-week recall period. Possible responses refer to the frequency of the disturbance: none of the time, some of the time, half of the time, most of the time, or all of the time. Responses to the OSDI were scored using the methods described by the authors . Subscale scores were computed for OSDI-symptoms, OSDI-function, and OSDI-triggers, as well as an overall averaged score. OSDI subscale scores can range from 0 to 100, with higher scores indicating more problems or symptoms. However, we subtracted the OSDI overall and subscale scores from 100, so that lower scores would indicate more problems or symptoms.
The 25-item NEI Visual Function Questionnaire (NEI-VFQ) [41, 42] is a non-disease-specific (i.e., "generic") instrument designed to measure the impact of ocular disorders on VT-HRQ. Depending on the item, responses to the NEI-VFQ pertain to either frequency or severity of a symptom or functioning problem. A recall period is not specified in the questionnaire. Responses to the NEI-VFQ were scored using the methods described by the authors . Subscale scores for general vision, ocular pain, near vision, distance vision, social functioning, mental functioning, role functioning, dependency, driving, color vision, and peripheral vision, as well as an overall score, were computed. The NEI-VFQ scores can range from 0–100, with lower scores indicating more problems or symptoms.
Schirmer tests of tear production without and with anesthesia were performed by inserting a Schirmer tear test sterile strip (35 mm, Alcon Laboratories, Inc, Fort Worth, TX) into the inferior fornix, at the junction of the middle and lateral third of the lower eyelid margin, for 5 minutes with the eyes closed. The extent of wetting was measured by referring to the ruler provided by the manufacturer on the envelope containing the strips. Possible scores range from 0 to 35 mm, with lower scores indicating greater abnormality in tear production. This test was repeated after instillation of topical anesthetic, 0.5% proparacaine . A Schirmer without anesthesia score of ≤ 5 mm in at least one eye is one required element of dry eye, as defined by the European-American Sjögren's syndrome diagnostic criteria .
The assessment of ocular surface damage was performed by a cornea specialist using vital dye staining with 2% unpreserved sodium fluorescein and then 5% lissamine green dye. The corneal, temporal, and nasal regions of the conjunctiva were scored individually from 0–5 (for fluorescein) and 0–5 (for lissamine green) using the Oxford grading scheme . The Oxford score was derived by adding the scores for corneal fluorescein and nasal plus temporal conjunctival lissamine green staining. Total Oxford score could range from 0–15. The van Bijsterveld score  (VB) was assessed using lissamine green staining of the cornea (0–3) and conjunctiva (0–3). Total VB score could range from 0–9. For all staining tests, higher scores indicate worse ocular surface damage.
Tear film stability was assessed using fluorescein tear film breakup time (TBUT). Five microliters of 2% sodium fluorescein was instilled into the inferior fornix and the patient was asked to blink several times. Using the cobalt blue filter and slit lamp biomicroscopy, the duration of time required for the first area of tear film breakup after a complete blink was determined. If the TBUT was less than 10 seconds, the test was repeated for a total of 3 values and the average was calculated.
For analysis, for each individual, the maximum (worse) score for the two eyes was used for Oxford score and VB, and the minimum (worse) score for the two eyes was used for Schirmer with and without anesthesia and for TBUT. TBUT values greater than or equal to 10 seconds  were coded as 10 (normal) and < 10 seconds was defined as abnormal. Schirmer without anesthesia score result of ≤ 5 mm or VB ≥ 4 were used as objective evidence of dry eye, following the European / American criteria for the diagnosis of dry eye for Sjogren's syndrome .
Hypotheses of specific associations were formulated based on the areas and domains assessed by the two VT-HRQ instruments. Scatterplots and Spearman's correlation coefficient (ρ)  were used to examine associations between pairs of variables. Multiple linear regression  was used to assess the strength of association between pairs of variables while adjusting for confounders (e.g., age).
Characteristics of participants
Characteristics of participants (n = 42)
Mean, sd [range]
54.9 (12.7) [31–81]
20/20 + OU
20/20+, better eye
20/25+, better eye
<20/25, better eye
Vital dye staining
7.2 (3.4) [1–14]
Van Bijsterveld score**
5.3 (2.7) [0–9]
Tear film break-up time (s)**
2.9 (1.7) [1–8]
< 5 sec
Schirmer without anesthesia (mm)
4.9 (5.4) [0–20]
Meibomian gland disease**
European-American dry eye criteria
Association of OSDI© with ocular surface parameters
Association of OSDI (scores subtracted from 100) with ocular surface parameters (Spearman ρ)
van Bijsterveld score
Tear film breakup time
Schirmer without anesthesia score
Schirmer with anesthesia score
Mean (sd); % floor
62.5 (25.7); 12%
78.2 (21.4); 21%
60.2 (34.3); 24%
70.0 (20.2); 10%
Association of NEI-VFQ with ocular surface parameters
Association of NEI-VFQ with ocular surface parameters (Spearman ρ)
van Bijsterveld score
Tear film breakup time
Schirmer without anesthesia score
Schirmer with anesthesia score
Mean (sd); % floor
78.6 (12.8); 14%
66.7 (22.2); 12%
80.4 (19.4); 26%
80.2 (18.4); 24%
96.1 (11.2); 83%
83.1 (17.5); 17%
73.2 (25.4); 29%
94.4 (10.5); 74%
84.9 (15.5); 38%
91.7 (19.6); 79%
83.6 (12.8); 2%
Association of OSDI© with NEI-VFQ subscales
Associations of OSDI© subscales (subtracted from 100) with NEI-VFQ subscales (Spearman ρ).
OSDI Visual function
OSDI Environmental triggers
Table 4 shows that, in fact, several other significant associations not conjectured in our original hypotheses were observed. In particular, the OSDI-function subscale, in addition to the associations hypothesized above, showed substantial and statistically significant associations with ocular pain (r = 0.50), mental function (r = 0.61), role function (r = 0.64), and dependency (r = 0.42). The OSDI-symptoms subscale showed a moderate and statistically significant association with NEI-VFQ mental health (r = 0.45). The overall OSDI scale showed significant associations with NEI-VFQ general vision (r = 0.51, ocular pain (r = 0.62), mental and role functioning (r = 0.53 and 0.48, respectively), and driving (r = 0.61).
We compared subscale scores for an ocular surface disease-specific instrument (OSDI) with a generic VT-HRQ instrument (NEI-VFQ-25) in patients with a systemic autoimmune disease associated with moderate to severe dry eye. We found that patients with primary Sjögren's syndrome had OSDI scores (mean, 30, before subtraction from 100) similar to those previously published  for moderate to severe dry eye patients (mean score was 36 for severe cases). Despite the fact that all of our patients had Sjögren's syndrome, with moderate to severe dry eye, we found that correlations of ocular surface parameters with VT-HRQ (i.e., patient-reported) parameters tended to be weak or nonexistent, consistent with several other studies demonstrating poor correlations between signs and symptoms of dry eye [18, 19, 20]. Indeed, contrary to our expectations, NEI-VFQ correlations with objective ocular surface parameters tended to be higher than those of OSDI, although all were relatively modest (all < 0.35) and none reached statistical significance.
One explanation could be that the nature of the items for each of these instruments is quite different. The OSDI queries the frequency of a symptom or difficulty with an activity, over a one week recall period. The NEI-VFQ incorporates questions both the frequency and intensity of symptoms and their impact on activities, with no specified recall period. Perhaps this added element of capturing both the frequency and intensity of a symptom or impact accounts for some of the differences we found. For subscales that are similar, agreement was higher but still moderate, possibly due to differences in the nature of the questions or response options. The OSDI is targeted to assess how much the symptoms of dry eye affect the patient's current status (i.e., in the past week), whereas the NEI-VFQ may be more suited to capturing the overall impact of a chronic ocular disease on VT-HRQ.
In this group of primary Sjögren's syndrome patients, associations between subscales of the NEI-VFQ and OSDI were moderate to strong (< 0.70) and in hypothesized directions. Significant associations were seen between OSDI and NEI-VFQ overall scales; OSDI-symptoms and NEI-VFQ ocular pain; and OSDI-function and NEI-VFQ general vision and driving. This suggests that both instruments are capturing important aspects of VT-HRQ. It is not surprising that the highest correlations were observed between subscales with similar domains, which serves to validate the use of alternate methodologies. On the other hand, it is counter-intuitive that the generic and disease-specific instruments appeared similar (or that the generic seemed to do a little better) with respect to their association with objectively measured clinical signs of dry eye, as the NEI-VFQ was designed to capture broader aspects of VT-HRQ. For the NEI-VFQ, we found moderate correlations (greater than 0.3) of distance vision with VB and near vision with TBUT. This was surprising, as one may have expected that subscales measuring ocular discomfort or pain (i.e., more disease-specific for dry eye) would have the strongest correlations with clinical measures of dry eye. Clinical signs of dry eye include measures of tear production, ocular surface staining, and tear film break-up; visual acuity and other aspects of visual function are not generally as widely used. However, some investigators have reported that visual acuity in dry eye patients is correlated with decreased spatial contrast sensitivity  and is functionally reduced with sustained eye opening due to increased surface irregularity which can be detected with corneal topography [53, 10], which could explain our finding of moderate associations of ocular surface measures with near and distance vision. It has been proposed  that "subtle visual disturbance" is an important reason for dry eye patients to seek care. Indeed, improvement in blurred vision symptoms was one of the most frequently reported benefits of topical cyclosporine treatment for dry eye in a large, multicenter clinical trial . The impact of the quality of vision or functional visual acuity on VT-HRQ has not been a focus of studies of the subjective aspects of dry eye. Our data indicate that the impact of dry eye on VT-HRQ is only partially accounted for by ocular pain in patients with severe dry eye, such as in Sjogren's syndrome.
Would we expect the associations to be different in Sjögren's patients? Sjögren's syndrome is an autoimmune exocrinopathy and effects of its systemic nature and chronicity on dry eye may have been more readily captured by the NEI-VFQ's ability to measure both frequency and intensity of problems with VT-HRQ. In contrast, although the OSDI includes items to measure function, responses are limited to the frequency of problems. Because the type of dry eye in Sjögren's syndrome is more likely to be severe, and all patients in our study had Sjögren's-related dry eye, we speculated that somewhat stronger associations between signs and symptoms might be observed. On the other hand, ocular surface inflammation and decreased corneal sensation are features of severe dry eye which might alter a patient's perception of symptoms of ocular irritation and might be the cause of weaker correlations between signs and symptoms [48, 55]. Indeed, reduced corneal sensation could provide inadequate feedback through the ophthalmic nerve to the central nervous system, resulting in less efferent stimulation to the lacrimal gland with reduced tear production and promotion of a vicious cycle. In addition, meibomian gland dysfunction plays a key role in dry eye in Sjögren's syndrome . Therefore, aqueous and evaporative tear deficiency may combine to produce a particularly diseased ocular surface.
In addition to clinical signs, it is important to include assessments of VT-HRQ and visual function to fully characterize the impact of dry eye on health status. The correlation between signs and VT-HRQ are modest at best, indicating that VT-HRQ is capturing an additional component of disease that is not captured by the clinical assessment. This does not necessarily mean that the measures of VT-HRQ or the methods of detecting clinical signs are deficient, but rather that VT-HRQ is an additional element of the overall impact of this disease process on affected individuals. Furthermore, in diseases with systemic manifestations, such as Sjögren's syndrome, that may have an influence on quality of life independent of dry eye symptoms, appropriate tests of VT-HRQ are critical to completely characterize quality of life in these patients. It may also be valuable to explore possible differences in associations of clinical signs with VT-HRQ in patient populations with different manifestations or causes of dry eye.
We thank Shirley Greishaber, RN, for her assistance with interviewing the participants, and the staff of the NIH Sjogren's Syndrome Clinic, including Rose Anne Leakan, RN, Vidya Sankar, DDS, and Stanley Pillemer, MD, for evaluating and referring participants to the study.
- 12.Damiano AM, Steinberg EP, Cassard SD, Bass EB, Diener-West M, Legro MW, Tielsch J, Schein OD, Javitt J, Kolb M: Comparison of generic versus disease-specific measures of functional impairment in patients with cataract. Med Care 1995,33(4 Suppl):AS120–130.Google Scholar
- 14.Ware JE Jr: Measures for a new era of health assessment. In Measuring Functioning and Well-Being. The Medical Outcomes Study Approach (Edited by: Stewart AL, Ware JE Jr). The RAND Corporation, Duke University Press 1992, 6–7.Google Scholar
- 15.Patrick DL, Erickson P: Health Status and Health Policy. Allocating Resources to Health Care Oxford University Press 1993, 114–142.Google Scholar
- 17.McMonnies CW: Key questions in a dry eye history. J Am Optom Assoc 1986, 57: 512–517.Google Scholar
- 22.Bandeen-Roche K, Munoz B, Tielsch JM, West SK, Schein OD: Self-reported assessment of dry eye in a population-based setting. Invest Ophthalmol Vis Sci 1997, 38: 2469–2475.Google Scholar
- 26.Friedlaender MH: Ocular manifestations of Sjögren's syndrome: keratoconjunctivitis sicca. Rheum Dis Clin North Am 1992, 18: 591–608.Google Scholar
- 28.National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS), National Institutes of Health, Public Health Service, U.S. Department of Health and Human Services: Sjögren's syndrome 2001. NIH Publication No. 01–4861Google Scholar
- 30.Bell M, Askari A, Bookman A, Frydrych S, Lamont J, McComb J, Muscoplat C, Slomovic A: Sjögren's syndrome: a critical review of clinical management. J Rheumatol 26: 2051–2061.Google Scholar
- 32.Kalk WW, Mansour K, Vissink A, Spijkervet FK, Bootsma H, Kallenberg CG, Roodenburg JL, Nieuw Amerongen AV: Oral and ocular manifestations in Sjögren's syndrome. J Rheumatol 2002, 29: 924–930.Google Scholar
- 35.Hay KD, Morton RP, Wall CR: Quality of life and nutritional studies in Sjögren's syndrome patients with xerostomia. N Z Dent J 2001, 97: 128–131.Google Scholar
- 36.Valtysdottir ST, Gudbjornsson B, Hallgren R, Hetta J: Psychological well-being in patients with primary Sjögren's syndrome. Clin Exp Rheumatol 2000, 18: 597–600.Google Scholar
- 38.Valtysdottir ST, Gudbjornsson B, Lindqvist U, Hallgren R, Hetta J: Anxiety and depression in patients with primary Sjögren's syndrome. J Rheumatol 2000, 27: 165–169.Google Scholar
- 40.Sutcliffe N, Stoll T, Pyke S, Isenberg DA: Functional disability and end organ damage in patients with systemic lupus erythematosus (SLE), SLE and Sjögren's syndrome (SS), and primary SS. J Rheumatol 1998, 25: 63–68.Google Scholar
- 43.RAND Corporation: The VFQ. [http://www.rand.org/health/surveys/vfq25/scoring.pdf]
- 44.Lemp MA: Evaluation and differential diagnosis of keratoconjunctivitis sicca. J Rheumatol Suppl 2000, 61: 11–14.Google Scholar
- 49.Vitali C, Bombardieri S, Jonsson R, Moutsopoulos HM, Alexander EL, Carsons SE, Daniels TE, Fox PC, Fox RI, Kassan SS, Pillemer SR, Talal N, Weisman MH, European Study Group on Classification Criteria for Sjogren's Syndrome: Classification criteria for Sjögren's syndrome: a revised version of the European criteria proposed by the American-European Consensus Group. Ann Rheum Dis 2002, 61: 554–558. 10.1136/ard.61.6.554PubMedCentralCrossRefGoogle Scholar
- 50.Armitage P, Berry G: Statistical Methods in Medical Research 3 Edition Blackwell Scientific Publications 1994, 464–465.Google Scholar
- 51.Kahn HA, Sempos CT: Statistical Methods in Epidemiology. Monographs in Epidemiology and Biostatistics Oxford University Press 1989, 12: 137–147.Google Scholar
This article is published under license to BioMed Central Ltd. This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.