Skip to main content
SpringerLink
Log in

Identifying response shift statistically at the individual level

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Objective

The purpose of this study was to explore whether a longitudinal comparison between reported and predicted health could be used as a method of identifying subjects who potentially experienced response shift.

Methods

A response-shift model was developed using data from a longitudinal study of stroke in which measures of stroke impact were made at study entry and at 1, 3, 6, and 12 months post stroke. Residuals from a random effects model were centered and used to create trajectories. This model was tested against a data set from a study in which the then-test had been administered. Twenty simulated data sets were also generated to examine how much of response shift could be attributed to random error.

Results

Group-based trajectory analysis identified seven trajectory groups. The majority (67%) of the 387 persons showed no response shift over time, whereas 15% lowered and 13% raised their health over time, disproportionally to that predicted.

Conclusion

Results of the validation studies were supportive that this methodology identifies response shift, but further research is required to compare results with other methodologies and other predictive models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Schwartz, C. E., & Sprangers, M. A. G. (2000).Adaptation to changing health response shift in quality-of-life research(1st ed). Washington, DC: American Psychological Association.

    Google Scholar 

  2. Sprangers, M. A., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science and Medicine, 48, 1507–1515.

    Article  PubMed  CAS  Google Scholar 

  3. Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14(3), 587–598.

    Article  PubMed  Google Scholar 

  4. Schwartz, C. E. (1999). Teaching coping skills enhances quality of life more than peer support: Results of a randomized trial with multiple sclerosis patients. Health Psychology, 18(3), 211–220.

    Article  PubMed  CAS  Google Scholar 

  5. Scott, J., & Rantz, M. (1997). Managing chronically ill older people in the midst of the health care revolution. Nursing Administration Quarterly, 21, 55–64.

    PubMed  CAS  Google Scholar 

  6. Visser, M. R., Smets, E. M., Sprangers, M. A., & De Haes, H. J. (2000). How response shift may affect the measurement of change in fatigue. Journal of Pain Symptom Manage, 20(1), 12–18.

    Article  CAS  Google Scholar 

  7. Ruta, D. A., Garratt, A. M., Leng, M., Russell, I. T., & MacDonald, L. M. (1994). A new approach to the measurement of quality of life. The Patient-Generated Index. Medical Care, 32(11), 1109–1126.

    Article  PubMed  CAS  Google Scholar 

  8. Howard, G. S. (1979). Response-shift bias: A source of contamination of self-report measures. Journal of Applied Psychology, 64(2), 144–150.

    Article  Google Scholar 

  9. Ahmed, S., Mayo, N. E., Wood-Dauphinee, S., Hanley, J. A., & Cohen, S. R. (2004). Response shift influenced estimates of change in health-related quality of life poststroke. Journal of Clinical Epidemiology, 57(6), 561–570.

    Article  PubMed  Google Scholar 

  10. Ahmed, S., Mayo, N. E., Wood-Dauphinee, S., Hanley, J. A., & Cohen, S. R. (2005). The structural equation modeling technique did not show a response shift, contrary to the results of the then test and the individualized approaches. Journal of Clinical Epidemiology, 58(11), 1125–1133.

    Article  PubMed  Google Scholar 

  11. Ahmed, S., Mayo, N. E., Wood-Dauphinee, S., Hanley, J. A., & Cohen, S. R. (2005). Using the Patient Generated Index to evaluate response shift post-stroke. Quality of Life Research, 14(10), 2247–2257.

    Article  PubMed  Google Scholar 

  12. Mayo, N. E., Wood-Dauphinee, S., Cote, R., Durcan, L., & Carlton, J. (2002). Activity, participation, and quality of life six months post-stroke. Archives of Physical Medicine and Rehabilitation, 83, 1035–1042.

    Article  PubMed  Google Scholar 

  13. Oort, F. J., Visser, M. R. M., & Sprangers, M. A. G. (2005). An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Quality of Life Research, 14, 599–609.

    Article  PubMed  Google Scholar 

  14. Ahmed, S., Mayo, N. E., Corbiere, M., Wood-Dauphinee, S., Hanley, J., & Cohen, R. (2005). Change in quality of life of people with stroke over time: True change or response shift? Quality of Life Research, 14(3), 611–627.

    Article  PubMed  Google Scholar 

  15. Brossart, D. F., Clay, D. L., & Willson, V. L. (2002). Methodological and statistical considerations for threats to internal validity in pediatric outcome data: Response shift in self-report outcomes. Journal of Pediatric Psychology, 27(1), 97–107.

    Article  PubMed  Google Scholar 

  16. Mayo, N. E., Nadeau, L., Ahmed, S., White, C., Grad, R., & Huang, A., et al. (2007). Bridging the gap: The effectiveness of teaming a stroke coordinator with patient’s personal physician on the outcome of stroke. Age and Ageing, 37(1), 32–38.

    Article  PubMed  Google Scholar 

  17. Schwartz, C., Bode, R., Repucci, N., Becker, J., Sprangers, M., & Fayers, P. (2006). The clinical significance of adaptation to changing health: A meta-analysis of response shift. Quality of Life Research, 15(9), 1533–1550.

    Article  PubMed  Google Scholar 

  18. EuroQol Group. (1990). EuroQol – a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy, 16(3), 199–208.

    Article  Google Scholar 

  19. Brooks, R. (1996). EuroQol: The current state of play. Health Policy, 37(1), 53–72.

    Article  PubMed  CAS  Google Scholar 

  20. Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. Journal of the American Medical Association, 273(1), 59–65.

    Article  PubMed  CAS  Google Scholar 

  21. World Health Organization. (2001). International classification of functioning, disability and health (2nd revision ed.). Geneva.

  22. Poissant, L., Mayo, N. E., Wood-Dauphinee, S., & Clarke, A. E. (2003). The development and preliminary validation of a Preference-Based Stroke Index (PBSI). Health Quality of Life Outcomes, 1(1), 43.

    Article  Google Scholar 

  23. Roccaforte, W. H., Burke, W. J., Bayer, B. L., & Wengel, S. P. (1992). Validation of a telephone version of the mini-mental state examination. Journal of the American Geriatrics Society, 40(7), 697–702.

    PubMed  CAS  Google Scholar 

  24. Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–198.

    Article  PubMed  CAS  Google Scholar 

  25. Ware, J. E., Jr., Kosinski, M., & Keller, S. D. (1994). SF-36 physical & mental scales: A user’s manual. Boston, Massachusetts: The Health Institute, New England Medical Center.

  26. Ware, J. E., Jr. (2000). SF-36 health survey update. Spine, 25(24), 3130–3139.

    Google Scholar 

  27. Ware, J.E., Jr., & Sherbourne, C. D. (1992). The MOS 36-item Short-Form Health Survey (SF-36): I. Conceptual framework and item selection. Medical Care, 30(6), 473–481.

    Google Scholar 

  28. Duncan, P. W., Wallace, D., Lai, S. M., Johnson, D., Embretson, S., & Laster, L. J. (1999). The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke, 30(10), 2131–2140.

    PubMed  CAS  Google Scholar 

  29. Duncan, P. W., Bode, R. K., Lai, S. M., & Perera, S. (2003). Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950–963.

    Article  PubMed  Google Scholar 

  30. Duncan, P. W., Lai, S. M., Tyler, D., Perera, S., Reker, D. M., & Studenski, S. (2002). Evaluation of proxy responses to the stroke impact scale. Stroke, 33(11), 2593–2599.

    Article  PubMed  Google Scholar 

  31. Côté, R., Battista, R. N., Wolfson, C., Boucher, J., Adam, J., & Hachinski, V. (1989). The Canadian Neurological Scale: validation and reliability assessment. Neurology, 39(5), 638–643.

    PubMed  Google Scholar 

  32. Côté, R., Hachinski, V. C., Shurvell, B. L., Norris, J. W., & Wolfson, C. (1986). The Canadian Neurological Scale: a preliminary study in acute stroke. Stroke, 17, 731–737.

    PubMed  Google Scholar 

  33. Charlson, M. E., Pompei, P., Ales, K. L., & MacKenzie, C. R. (1987). A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. Journal of Chronic Diseases, 40, 373–383.

    Article  PubMed  CAS  Google Scholar 

  34. Farivar, S. S., Cunningham, W. E., & Hays, R. D. (2007). Correlated physical and mental health summary scores for the SF-36 and SF-12 Health Survey, V.I. Health Quality of Life Outcomes, 5, 54.

    Article  Google Scholar 

  35. Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis modeling change and event occurrence. New York: Oxford University Press.

    Google Scholar 

  36. Shaw, J. W., Johnston, J. A., & Coons, S. J. (2005). US evaluation of the EQ-5D health states: Development and testing of the D1 valuation model. Medical Care, 43, 203–220.

    Article  PubMed  Google Scholar 

  37. Jones, B. L., Nagin, D. S., & Roeder, K. (2001). A SAS procedure based on mixture models for estimating developmental trajectories. Sociological Methods Research, 29(3), 374–393.

    Article  Google Scholar 

  38. Nagin, D. S., & Tremblay, R. E. (2001). Analyzing developmental trajectories of distinct but related behaviors: A group-based method. Psychological Methods, 6(1), 18–34.

    Article  PubMed  CAS  Google Scholar 

  39. Howard, G. S. (1979). Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23.

    Article  Google Scholar 

  40. Sprangers, M. A., Tempelaar, R., van den Heuvel, W. J., & de Haes, H. C. (2002). Explaining quality of life with crisis theory. Psycho-oncology, 11(5), 419–426.

    Article  PubMed  Google Scholar 

  41. Norman, G. (2003). Hi! How are you? Response shift, implicit theories and differing epistemologies. Quality of Life Research, 12, 239–249.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Division of Clinical Epidemiology, McGill University Health Center, Montreal, QC, Canada

    Nancy E. Mayo, Susan C. Scott & Nandini Dendukuri

  2. Department of Medicine and School of Physical and Occupational Therapy, McGill University, Montreal, QC, Canada

    Nancy E. Mayo & Sharon Wood-Dauphinee

  3. Department of Epidemiology and Biostatistics, McGill University, Montreal, QC, Canada

    Nancy E. Mayo, Nandini Dendukuri & Sharon Wood-Dauphinee

  4. Division of Clinical Epidemiology, R4.29, Royal Victoria Hospital, 687 Pine Avenue West, Montreal, QC, Canada, H3A 1A1

    Nancy E. Mayo

  5. School of Physical and Occupational Therapy, McGill University, Montreal, QC, Canada

    Sara Ahmed

Authors
  1. Nancy E. Mayo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susan C. Scott
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nandini Dendukuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sara Ahmed
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sharon Wood-Dauphinee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nancy E. Mayo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mayo, N.E., Scott, S.C., Dendukuri, N. et al. Identifying response shift statistically at the individual level. Qual Life Res 17, 627–639 (2008). https://doi.org/10.1007/s11136-008-9329-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-008-9329-2

Keywords

Search

Navigation