Abstract
In many studies, assessments of change in self-report measures such as health-related quality of life must account for potential response shift, including reconceptualization and changes in internal standards of measurement. Objective: The objective of our study was to compare healthy controls and individuals with stroke on the extent to which changes in internal standards and reconceptualization of health related quality of life (HRQL) occurs over the first 6 months post-stroke. Methods: Confirmatory factor analysis was used to assess invariance of the SF-36 measurement model over time among 238 individuals with stroke and 392 controls, separately. This procedure assessed changes over time in the factor loadings, variances, and covariances of responses, and compared the extent of change between individuals with stroke and those in the control group. In addition a multisample comparison was made between individuals with stroke and members of the control group at the first evaluation in order to assess invariance of the SF-36 measurement model between the groups. The controls were considered to be a ‘proxy’ for the stroke cohort prior to the stroke. Results: We found no evidence of reconceptualization and changes in internal standards over time when the groups were assessed separately. There was a significant difference in the factor covariances (reconceptualization) between the two groups at the time of the first evaluation. However, measurement error was also significant for this comparison. Conclusion: This study indicates that the improvement in HRQL over time is real rather than a result of reconceptualization or a recalibration. If response shift does occur with stroke it is likely to be mediated by the event itself and not the recovery process.
Similar content being viewed by others
References
LS Williams M Weinberger LE Harris DO Clark J Biller (1999) ArticleTitleDevelopment of a stroke-specific quality of life scale. Stroke 30 IssueID7 1362–1369
PW Duncan GP Samsa M Weinberger et al. (1997) ArticleTitleHealth status of individuals with mild stroke. Stroke 28 IssueID4 740–745
R Haan Particlede N Aaronson M Limburg RL Hewer Crevel H van (1993) ArticleTitleMeasuring quality of life in stroke. Stroke 24 IssueID2 320–327
RB King (1996) ArticleTitleQuality of life after stroke. Stroke 27 IssueID9 1467–1472
PW Duncan D Wallace SM Lai D Johnson S Embretson LJ Laster (1999) ArticleTitleThe Stroke Impact Scale Version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke 30 IssueID10 2131–2140
PJ Allison D Locker JS Feine (1997) ArticleTitleQuality of life: A dynamic construct. Soc Sci Med 45 IssueID2 221–230
LJ Cronbach L Furby (1970) ArticleTitleHow should we measure ‘change’–Or should we? Psychol Bull 74 68–80
MA Sprangers CE Schwartz (1999) ArticleTitleIntegrating response shift into health-related quality of life research: A theoretical model. Soc Sci Med 48 IssueID11 1507–1515
RT Golembiewski S Yeager (1975) ArticleTitleMeasuring change and persistence in human affairs: Types of change generated by OD designs. J Appl Behav Sci 12 IssueID2 133–157
NE Mayo (1993) ArticleTitleEpidemiology and recovery. Phys Med Reh: State Art Rev 7 IssueID1 1–25
PW Duncan LB Goldstein RD Horner PB Landsman GP Samsa DB Matchar (1994) ArticleTitleSimilar motor recovery of upper and lower extremities after stroke. Stroke 25 IssueID6 1181–1188
D Wade HR Langton (1987) ArticleTitleFunctional abilities after stroke: The first three months. J Neurol Neurosur Psych 50 177–182
CE Schwartz MAG Sprangers (2000) Adaptation to Changing Health: Response Shift in Quality-of-life research EditionNumber1 American Psychological Association Washington, DC
TO engs M Yu E Luistro (2001) ArticleTitleHealth-related quality of life after stroke–A comprehensive review. Stroke 32 IssueID4 964–971
IS Breetvelt FS Dam ParticleVan (1991) ArticleTitleUnderreporting by cancer patients: The case of response-shift. Soc Sci Med 32 IssueID9 981–987
InstitutionalAuthorNameStatistics Canada (1999) How healthy are Canadians? Government of Canada Ottawa 9–119
SD Decker R Schulz (1985) ArticleTitleCorrelates of life satisfaction and depression in middle-aged and elderly spinal cord-injured persons. Am J Occup Ther 39 IssueID11 740–745
RE Millsap B Sandra (1988) ArticleTitleAlpha, beta, and gamma change in evaluation research: A structural equation approach. J Appl Psychol 73 IssueID3 574–584
P Norman (1996) ArticleTitleThe interpretation of change in verbal reports: Implications for health psychology. Psychol Health 11 IssueID2 301–314
N Schmitt (1982) ArticleTitleThe use of analysis of covariance structures to assess beta and gamma change. Source. Mult Behav Res 17 IssueID3 343–358
WA Randolph (1989) ArticleTitleHow can OD consultants and researchers assess gamma change? A comparison of two analytical procedures. J Manage 15 IssueID4 633–648
Millsap RE, Sandra B. Alpha, beta, and gamma change in evaluation research: A structural equation approach. J Appl Psychol 1988; 73(3).
J Schaubroeck (1989) ArticleTitleConfirmatory factor analytic procedures for assessing change during organizational entry. J Appl Psychol 74 IssueID6 892–900
RB Kline (1998) Principles and Practice of Structural Equation Modeling. The Guilford Press New York
MK Lindell (1980) ArticleTitleEquivocality of factor incongruence as an indicator of type of change in OD Interventions. Acad Manage Rev 5 IssueID1 105–107
CE Schwartz MA Sprangers (1999) ArticleTitleMethodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med 48 IssueID11 1531–1548
J Bernhard A Lowy R Maibach C Hurny (2001) ArticleTitleResponse shift in the perception of health for utility evaluation: An explorative investigation. Eur J Cancer 37 IssueID14 1729–1735
MA Sprangers FS Dam ParticleVan J Broersen et al. (1999) ArticleTitleRevealing response shift in longitudinal research on fatigue–the use of the thentest approach. Acta Oncol 38 IssueID6 709–718 Occurrence Handle10.1080/028418699432860 Occurrence Handle1:STN:280:DyaK1MvltVGqtA%3D%3D Occurrence Handle10522761
D Postulart EM Adang (2000) ArticleTitleResponse shift and adaptation in chronically ill patients. Med Decis Making 20 IssueID2 186–193
NE Mayo S Wood-Dauphinee R Cote L Durcan J Carlton (2001) ArticleTitleActivity, participation, and quality of life six months post-stroke. Arch Phys Med Rehab 83 1035–1042
JE Ware SuffixJr KK Snow M Kosinski B Gandek (1993) Health Survey: Manual & Interpretation Guide. The Health Institute, New England Medical Center Boston, MA
CA McHorney JE Ware SuffixJr JF Lu CD Sherbourne (1994) ArticleTitleThe MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 32 IssueID1 40–66 Occurrence Handle1:STN:280:ByuC3cvjs1M%3D Occurrence Handle8277801
CA McHorney JE Ware SuffixJr W Rogers AE Raczek JF Lu (1992) ArticleTitleThe validity and relative precision of MOS short- and long-form health status scales and Dartmouth COOP charts. Results from the Medical Outcomes Study. Med Care 30(Suppl 5) MS253–MS265
JE Brazier R Harper N Jones et al. (1992) ArticleTitleValidating the SF-36 health survey questionnaire: New outcome measure for primary care. Br Med J 305 160–164 Occurrence Handle1:STN:280:By2A1cnhtlw%3D
B Modan DK Wagener (1992) ArticleTitleSome epidemiological aspects of stroke: Mortality/morbidity trends, age, sex, race, socioeconomic status. Stroke 23 1230–1236
P Dorman J Slattery B Farrell M Dennis P Sandercock (1998) ArticleTitleQualitative comparison of the reliability of health status assessments with the EuroQol and SF-36 questionnaires after stroke. United Kingdom Collaborators in the International Stroke Trial. Stroke 29 IssueID1 63–68
JE Ware SuffixJr M Kosinski S–D Keller (1994) SF-36 Physical & Mental Scales: A User’s Manual. The Health Institute, New England Medical Center Boston, Massachusetts
PJ Dorman M Dennis P Sandercock (1999) ArticleTitleHow do scores on the EuroQol relate to scores on the SF-36 after stroke? Stroke 30 IssueID10 2146–2151
JJ Putten Particlevan der JC Hobart JA Freeman AJ Thompson (1999) ArticleTitleMeasuring change in disability after inpatient rehabilitation: Comparison of the responsiveness of the Barthel index and the Functional Independence Measure. J Neurol Neurosurg Psychiatr 66 IssueID4 480–484
RH Harwood S Ebrahim (2000) ArticleTitleA comparison of the responsiveness of the Nottingham extended activities of daily living scale, London handicap scale and the SF-36. Disabil Rehabil 22 786–793
C Anderson S Laubscher R Burns (1996) ArticleTitleValidation of the Short Form 36 (SF-36) health survey questionnaire among stroke patients. Stroke 27 IssueID10 1812–1816
CA McHorney JE Ware AE Raczek (1993) ArticleTitleThe MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and Clincal Tests of Validity in Measuring physical and mental health constructs. Med Care 31 247–263 Occurrence Handle1:STN:280:ByyC1MnisVI%3D Occurrence Handle8450681
R Cote RN Battista C Wolfson J Boucher J Adam V Hachinski (1989) ArticleTitleThe Canadian neurological scale: Validation and reliability assessment. Neurology 39 638–643
MF Folstein SE Folstein PR McHugh (1975) ArticleTitle‘Mini-mental state’. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12 IssueID3 189–198 Occurrence Handle10.1016/0022-3956(75)90026-6 Occurrence Handle1:STN:280:CSmD2s7mtVE%3D Occurrence Handle1202204
CV Granger BB Hamilton (1990) ArticleTitleMeasurement of stroke rehabilitation outcome in the 1980s. Stroke 21(Suppl 9) II46–II47
FI Mahoney DW Barthel (1965) ArticleTitleFunctional evaluation: The Barthel lndex. Md St Med J 14 61–65 Occurrence Handle1:STN:280:CCqD28zks1I%3D
SC Loewen BA Anderson (1988) ArticleTitleReliability of the Modified Motor Assessment Scale and the Barthel Index [see comments]. Phys Ther 68 IssueID7 1077–1081
D Shinar CR Gross JP Mohr et al. (1985) ArticleTitleInterobserver variability in the assessment of neurologic history and examination in the Stroke Data Bank. Arch Neurol 42 557–565
CW Roy J Togneri E Hay B Pentland (1988) ArticleTitleAn inter-rater reliability study of the Barthel Index. Int J Rehabil Res 11 IssueID1 67–70
CV Granger LS Dewis NC Peters CC Sherwood JE Barrett (1979) ArticleTitleStroke rehabilitation: Analysis of repeated Barthel index measures. Arch Phys MedRehabil 60 14–17
GE Gresham TF Phillips ML Labi (1980) ArticleTitleADL status in stroke: relative merits of three standard indexes. Arch Phys Med Rehabil 61 IssueID8 355–358
DT Wade Hewer R Langton (1987) ArticleTitleFunctional abilities after stroke: Measurement, natural history and prognosis. J Neurol Neurosurg Psychiatr 50 IssueID2 177–182
I Wellwood MS Dennis CP Warlow (1995) ArticleTitleA comparison of the Barthel Index and the OPCS disability instrument used to measure outcome after acute stroke. Age Ageing 24 54–57
I McDowell C Newell (1996) Measuring Health: A Guide to Rating Scales and Questionnaires EditionNumber2 Oxford University Press New York
SL Wood-Dauphinee MA Opzoomer JI Williams B Marchand WO Spitzer (1988) ArticleTitleAssessment of global function: The Reintegration to Normal Living Index. Arch Phys Med Rehabil 69 IssueID8 583–590
S Wood-Dauphinee JI Williams (1987) ArticleTitleReintegration to normal living as a proxy to quality of life. J Chron Dis 40 IssueID6 491–502
Bentler PM. EQS Structural Equation Program Manual. Encino, 1995.
RH Hoyle (1995) Structural Equation Modeling: Concepts, Issues, and Application. Sage Publications, c1995 Thousand Oaks
D Kaplan (1955) Structural Equation Modeling: Foundations and extensions. Sage Publications, c2000 Thousand Oaks, CA
LA Hayduk (1987) Structural Equation Modeling with LISREL: Essentials and Advances. Johns Hopkins University Press, c1987 Baltimore
KA Bollen (1989) Structural Equations with Latent Variables. Wiley and Sons New York
O Siddiqui MW Ali (1999) ArticleTitleLinear structural equation model in analyzing quality-of-life-data from clinical trials. J Biopharm Stat 9 IssueID4 661–681
A Satorra PM Bentler (1994) Corrections to test statistics and standard errors in covariance structure analysis. Eye Particlevon Alexander Clogg C Clifford (Eds) Latent Variables Analysis: Applications for Developmental Research. Sage Publications, Inc. Thousand Oaks, CA, US 399–419
PS Curran SG West JF Finch (1996) ArticleTitleThe Robustness of test Statistics to nonnormality and specification error in confirmatory factor analysis. Psychol Meth 1 16–29
Nevitt J, Hancock GR. Improving the root mean square error of approximation for nonnormal conditions in structural equation modeling. 2000; 68(3): 251–268.
KG oreskog D Sorbom (1979) Advances in Factor Analysis and Structural Equation Models. ABT Books Cambridge, MA
GB Jarnlo L Ceder KG Thorngren (1984) ArticleTitleEarly rehabilitation at home of elderly patients with hip fractures and consumption of resources in primary care. Scand J Prim Health Care 2 105–112
WM Hopman T Towheed T Anastassiades et al. (2000) ArticleTitleCanadian normative data for the SF-36 health survey. Can Med Assoc J 163 IssueID3 265–271
HS Jorgensen H Nakayama HO Raaschou et al. (1995) ArticleTitleOutcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen Stroke Study. Arch Phys Med Rehab 76 IssueID5 406–412
AA Armenakis JN Wilmoth (1977) ArticleTitleAn algorithm for assessing factor structure congruence. Educ Psychol Measure 37 IssueID1 213–214
WA Randolph DF Elloy (1989) ArticleTitleA comparison of two methods for evaluating the similarity of factor analytic solutions. J Manage 15 633–648
N Schmitt E Pulakos A Lieblein (1984) ArticleTitleComparison of three techniques to assess group-level beta and gamma change. J Appl Psychol 8 249–260
JR Terborg GS Howard SE Maxwell (1980) ArticleTitleEvaluating planned organizational change: A method for assessing alpha, beta, and gamma change. Acad Manage Rev 5 IssueID1 109–121
BO Muthen PJ Curran (1997) ArticleTitleGeneral longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychol Meth 2 IssueID4 371–402
JB Willett AG Sayer (1994) ArticleTitleUsing covariance structure-analysis to detect correlates and predictors of individual change over time. Psychol Bull 116 IssueID2 363–381
CA McHorney JE Ware ParticleJr AE Raczek (1993) ArticleTitleThe MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care 31 IssueID3 247–263 Occurrence Handle1:STN:280:ByyC1MnisVI%3D Occurrence Handle8450681
GE Simon DA Revicki L Grothaus M Vonkorff (1998) ArticleTitleSF-36 summary scores: are physical and mental health truly distinct? Med Care 36 IssueID4 567–572
MW Nortvedt T Riise K Myhr HI Nyland (2000) ArticleTitlePerformance of the SF-36, SF-12, and RAND-36 summary scales in a multiple sclerosis population. Med Care 38(28 ref) 1022–1028
University of Kansas Pepper Center for Aging. Stroke Toolbox. 2002. www2.kumc.edu/coa/Stroke_Toolbox/stroke-tool.htm.
S Ahmed NE Mayo S Wood-Dauphinee J Hanley (2001) ArticleTitleResponse Shift In The Assessment Of Health Related Quality of Life (HRQL) Post-Stroke. Qual Life Res 10 IssueID3 202–204
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ahmed, S., Mayo, N.E., Corbiere, M. et al. Change in quality of life of people with stroke over time: True change or response shift?. Qual Life Res 14, 611–627 (2005). https://doi.org/10.1007/s11136-004-3708-0
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11136-004-3708-0