Advertisement

The structural and convergent validity of three commonly used measures of self-management in persons with neurological conditions

  • George KephartEmail author
  • Tanya L. Packer
  • Åsa Audulv
  • Grace Warner
Article

Abstract

Purpose

Self-management ability is commonly assessed in chronic disease research and clinical practice. The purpose of this study was to assess the structural and convergent validity of three commonly used self-management outcome measures in a sample of persons with neurological conditions.

Methods

We used data from a Canadian survey of persons with neurological conditions, which included three commonly used self-management measures: the Partners in Health Scale (PIH), the Patient Activation Measure (PAM), and the Self-Efficacy for Managing a Chronic Disease Scale (SEMCD). Confirmatory factor analysis was used to assess the structural and convergent validity of the three measures.

Results

When treated as single-factor constructs, none of the measurement models provided a good fit to the data. A four-domain version of the PIH was the best fitting model. Confirmatory factor analysis suggests that the three tools measure different, but correlated constructs.

Conclusions

While the PAM, PIH and SEMCD scales are all used as measures of patient self-management, our study indicates that they measure different, but correlated latent variables. None, when treated as single, uni-dimensional construct, provides an acceptable fit to our data. This is probably because self-management is multi-dimensional, as is consistently shown by qualitative evidence. While these measures may provide reliable summative measures, multi-dimensional scales are needed for clinical use and more detailed research on self-management.

Keywords

Self-management Self-care Patient activation Self-efficacy Confirmatory factor analysis Construct validity Structural validity Convergent validity 

Notes

Funding

The funding was provided by Public Health Agency of Canada, Nova Scotia Health Research Foundation (Grant No. PSO-DI-2015-10083), Institute of Health Services and Policy Research.

References

  1. 1.
    Jonkman, N. H., Schuurmans, M. J., Groenwold, R. H. H., Hoes, A. W., & Trappenburg, J. C. A. (2016). Identifying components of self-management interventions that improve health-related quality of life in chronically ill patients: Systematic review and meta-regression analysis. Patient Education and Counselling, 99(7), 1087–1098.CrossRefGoogle Scholar
  2. 2.
    Jonkman, N. H., Westland, H., Groenwold, R. H. H., Ågren, S., Anguita, M., Blue, L., Bruggink-André de la Porte P. W. F., DeWalt, D. A., Hebert, P. L., Heisler, M., Jaarsma, T., Kempen, G. I. J. M., Leventhal, M. E., Lok, D. J. A., Mårtensson, J., Muñiz, J., Peters-Klimm, O. H., Rich, F., Riegel, M. W., Strömberg, B., Tsuyuki, A., Trappenburg, R. T., Schuurmans, J. C. A., Hoes, M. J. (2016). What are effective program characteristics of self-management interventions in patients with heart failure? An individual patient data meta-analysis. Journal of Cardiac Failure, 22(11), 861–871.CrossRefGoogle Scholar
  3. 3.
    Newham, J. J., Presseau, J., Heslop-Marshall, K., Russell, S., Ogunbayo, O. J., Netts, P., Hanratty, B., & Kaner, E. (2017). Features of self-management interventions for people with COPD associated with improved health-related quality of life and reduced emergency department visits: A systematic review and meta-analysis. International Journal of Chronic Obstructive Pulmonary Disease, 12, 1705–1720.CrossRefGoogle Scholar
  4. 4.
    Ogunbayo, O. J., Russell, S., Newham, J. J., Heslop-Marshall, K., Netts, P., Hanratty, B., & Kaner, E. (2017). Understanding the factors affecting self-management of COPD from the perspectives of healthcare practitioners: A qualitative study. NPJ Primary Care Respiritory Medicine, 27(1), 54.CrossRefGoogle Scholar
  5. 5.
    Liddy, C., Blazkho, V., & Mill, K. (2014). Challenges of self-management when living with multiple chronic conditions: Systematic review of the qualitative literature. Canadian Family Physician, 60(12), 1123–1133.PubMedPubMedCentralGoogle Scholar
  6. 6.
    Boger, E. J., Demain, S., & Latter, S. (2013). Self-management: a systematic review of outcome measures adopted in self-management interventions for stroke. Disability and Rehabilitation, 35(17), 1415–1428.CrossRefGoogle Scholar
  7. 7.
    Nolte, S., Elsworth, G. R., Newman, S., & Osborne, R. H. (2013). Measurement issues in the evaluation of chronic disease self-management programs. Quality of Life Research, 22(7), 1655–1664.CrossRefGoogle Scholar
  8. 8.
    Packer, T. L., Fracini, A., Audulv, Å, Alizadeh, N., van Gaal, B. G. I., Warner, G., & Kephart, G. (2018). What we know about the purpose, theoretical foundation, scope and dimensionality of existing self-management measurement tools: A scoping review. Patient Education and Counselling, 101(4), 579–595.CrossRefGoogle Scholar
  9. 9.
    Corrigan, J. M., Adams, K., & Greiner, A. C. (2004). 1st annual crossing the quality chasm summit: A focus on communities. Washington, DC: National Academies Press.Google Scholar
  10. 10.
    Audulv, Å, Packer, T., Hutchinson, S., Roger, K. S., & Kephart, G. (2016). Coping, adapting or self-managing—What is the difference? A concept review based on the neurological literature. Journal of Advanced Nursing, 72(11), 2629–2643.CrossRefGoogle Scholar
  11. 11.
    Hibbard, J. H., Stockard, J., Mahoney, E. R., & Tusler, M. (2004). Development of the patient activation measure (PAM): Conceptualizing and measuring activation in patients and consumers. Health Services Research, 39(4 Pt 1), 1005–1026.CrossRefGoogle Scholar
  12. 12.
    Hibbard, J. H., Mahoney, E. R., Stockard, J., & Tusler, M. (2005). Development and testing of a short form of the patient activation measure. Health Services Research, 40(6 Pt 1), 1918–1930.CrossRefGoogle Scholar
  13. 13.
    Battersby, M. W., Ask, A., Reece, M. M., Markwick, M. J., & Collins, J. P. (2003). The Partners in Health scale: The development and psychometric properties of a generic assessment scale for chronic condition self-management. Australian Journal of Primary Health, 9(3), 41–52.CrossRefGoogle Scholar
  14. 14.
    Smith, D., Harvey, P., Lawn, S., Harris, M., & Battersby, M. (2017). Measuring chronic condition self-management in an Australian community: Factor structure of the revised Partners in Health (PIH) scale. Quality of Life Research, 26(1), 149–159.CrossRefGoogle Scholar
  15. 15.
    Lorig, K., Chastain, R. L., Ung, E., Shoor, S., & Holman, H. R. (1989). Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis and Rheumatism, 32(1), 37–44.CrossRefGoogle Scholar
  16. 16.
    Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.CrossRefGoogle Scholar
  17. 17.
    Bodenheimer, T., Wagner, E. H., & Grumbach, K. (2002). Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA, 288(15), 1909–1914.CrossRefGoogle Scholar
  18. 18.
    Bodenheimer, T., Lorig, K., Holman, H., & Grumbach, K. (2002). Patient self-management of chronic disease in primary care. JAMA, 288(19), 2469–2475.CrossRefGoogle Scholar
  19. 19.
    Von Korff, M., Gruman, J., Schaefer, J., Curry, S. J., & Wagner, E. H. (1997). Collaborative management of chronic illness. Annals of Internal Medicine, 127(12), 1097–1102.CrossRefGoogle Scholar
  20. 20.
    Versnel, J., Packer, T., Weeks, L. E., Brown, J., Godwin, M., Hutchinson, S., Kephart, G., MacKenzie, D., Roger, K., Stadnyk, R., Villeneuve, M., & Warner, G. (2013). The everyday experience of living with and managing a neurological condition (the LINC study): Study design. BMC Neurology, 13, 30.CrossRefGoogle Scholar
  21. 21.
    Audulv, Å., Packer, T., & Versnel, J. (2014). Identifying gaps in knowledge: A map of the qualitative literature concerning life with a neurological condition. Chronic Illness, 10(3), 192–243.CrossRefGoogle Scholar
  22. 22.
    Canada, P. H. A. O. (2014). Mapping Connections: An understanding of the neurological conditions in Canada. Ottawa: Government of Canada.Google Scholar
  23. 23.
    Raghunathan, T. E., Lepkowski, J. M., & Hoewyk, J. V. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology, 27(1), 85–96.Google Scholar
  24. 24.
    StataCorp. (2017). Stata Statistical Software: Release 15. College Station: StataCorp LP.Google Scholar
  25. 25.
    Ritter, P. L., & Lorig, K. (2014). The English and Spanish Self-Efficacy to Manage Chronic Disease Scale measures were validated using multiple studies. Journal of Clinical Epidemiology, 67(11), 1265–1273.CrossRefGoogle Scholar
  26. 26.
    Freund, T., Gensichen, J., Goetz, K., Szecsenyi, J., & Mahler, C. (2013). Evaluating self-efficacy for managing chronic disease: Psychometric properties of the six-item Self-Efficacy Scale in Germany. Journal of Evaluation in Clinical Practice, 19(1), 39–43.CrossRefGoogle Scholar
  27. 27.
    Eslami, A., Daniali, S. S., Mohammadi, K., Reisi-Dehkordi, N., & Mostafavi-Darani, F. (2017). Cultural adaptation and psychometric properties of the persian version of self-efficacy in chronic disease patients. Iranian Journal of Nursing and Midwifery Research, 22(1), 57–61.CrossRefGoogle Scholar
  28. 28.
    Petkov, J., Harvey, P., & Battersby, M. (2010). The internal consistency and construct validity of the partners in health scale: Validation of a patient rated chronic condition self-management measure. Quality of Life Research, 19(7), 1079–1085.CrossRefGoogle Scholar
  29. 29.
    Brenk-Franz, K., Hibbard, J. H., Herrmann, W. J., Freund, T., Szecsenyi, J., Djalali, S., Steurer-Stey, C., Sönnichsen, A., Tiesler, F., Storch, M., Schneider, N., & Gensichen, J. (2013). Validation of the German version of the patient activation measure 13 (PAM13-D) in an international multicentre study of primary care patients. PLoS ONE, 8(9), e74786.CrossRefGoogle Scholar
  30. 30.
    Graffigna, G., Barello, S., Bonanomi, A., Lozza, E., & Hibbard, J. (2015). Measuring patient activation in Italy: Translation, adaptation and validation of the Italian version of the patient activation measure 13 (PAM13-I). BMC Medical Informatics and Decision Making, 15, 109.CrossRefGoogle Scholar
  31. 31.
    Magnezi, R., & Glasser, S. (2014). Psychometric properties of the Hebrew translation of the patient activation measure (PAM-13). PLoS ONE, 9(11), e113391.CrossRefGoogle Scholar
  32. 32.
    Moreno-Chico, C., González-de Paz, L., Monforte-Royo, C., Arrighi, E., Navarro-Rubio, M. D., & Gallart Fernández-Puebla, A. (2017). Adaptation to European Spanish and psychometric properties of the patient activation measure 13 in patients with chronic diseases. Family Practice, 34(5), 627–634.CrossRefGoogle Scholar
  33. 33.
    Rademakers, J., Nijman, J., van der Hoek, L., Heijmans, M., & Rijken, M. (2012). Measuring patient activation in The Netherlands: translation and validation of the American short form patient activation measure (PAM13). BMC Public Health, 12, 577.CrossRefGoogle Scholar
  34. 34.
    Zill, J. M., Dwinger, S., Kriston, L., Rohenkohl, A., Härter, M., & Dirmaier, J. (2013). Psychometric evaluation of the German version of the patient activation measure (PAM13). BMC Public Health, 13, 1027.CrossRefGoogle Scholar
  35. 35.
    Moljord, I. E. O., Lara-Cabrera, M. L., Perestelo-Pérez, L., Rivero-Santana, A., Eriksen, L., & Linaker, O. M. (2015). Psychometric properties of the patient activation measure-13 among out-patients waiting for mental health treatment: A validation study in Norway. Patient Education and Counselling, 98(11), 1410–1417.CrossRefGoogle Scholar
  36. 36.
    Green, C. A., Perrin, N. A., Polen, M. R., Leo, M. C., Hibbard, J. H., & Tusler, M. (2010). Development of the patient activation measure for mental health. Administration and Policy in Mental Health, 37(4), 327–333.CrossRefGoogle Scholar
  37. 37.
    Skolasky, R. L., Mackenzie, E. J., Riley, L. H., & Wegener, S. T. (2009). Psychometric properties of the patient activation measure among individuals presenting for elective lumbar spine surgery. Quality of Life Research, 18(10), 1357–1366.CrossRefGoogle Scholar
  38. 38.
    Prey, J. E., Qian, M., Restaino, S., Hibbard, J., Bakken, S., Schnall, R., Rothenberg, G., Vawdrey, D. K., & Masterson Creber, R. (2016). Reliability and validity of the patient activation measure in hospitalized patients. Patient Education and Counselling, 99(12), 2026–2033.CrossRefGoogle Scholar
  39. 39.
    Hung, M., Carter, M., Hayden, C., Dzierzon, R., Morales, J., Snow, L., Butler, J., Bateman, K., & Samore, M. (2013). Psychometric assessment of the patient activation measure short form (PAM-13) in rural settings. Quality of Life Research, 22(3), 521–529.CrossRefGoogle Scholar
  40. 40.
    Packer, T. L., Kephart, G., Ghahari, S., Audulv, Å, Versnel, J., & Warner, G. (2015). The patient activation measure: A validation study in a neurological population. Quality of Life Research, 24(7), 1587–1596.CrossRefGoogle Scholar
  41. 41.
    Brown, T. A. (2015). Confirmatory factor analysis for applied research. New York: Guilford.Google Scholar
  42. 42.
    McNeish, D. (2017). Thanks coefficient alpha, we’ll take It from here. Psychological Methods, 23(3), 412–433.CrossRefGoogle Scholar
  43. 43.
    Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120.CrossRefGoogle Scholar
  44. 44.
    Satorra, A.. Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In von Eye A. & C. C. Clogg (Eds.), In Latent variables analysis: Applications for developmental research (pp. 399–419). Thousand Oaks: SageGoogle Scholar
  45. 45.
    Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and nonnormality. Structural Equation Modeling, 7(4), 557–595.CrossRefGoogle Scholar
  46. 46.
    Hu, L.. Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.CrossRefGoogle Scholar
  47. 47.
    Ngooi, B. X., Packer, T. L., Kephart, G., Warner, G., Koh, K. W. L., Wong, R. C. C., & Lim, S. P. (2016). Validation of the patient activation measure (PAM-13) among adults with cardiac conditions in Singapore. Quality of Life Research, 26(4), 1071–1080.CrossRefGoogle Scholar
  48. 48.
    Lenferink, A., Effing, T., Harvey, P., Battersby, M., Frith, P., van Beurden, W., et al. (2016). Construct validity of the Dutch version of the 12-item partners in health Scale: Measuring patient self-management behaviour and knowledge in patients with chronic obstructive pulmonary disease. PLoS ONE, 11(8), e0161595.CrossRefGoogle Scholar
  49. 49.
    Corbin, J.. Strauss, A. (1985). Managing chronic illness at home: Three lines of work. Qualitative Sociology, 8(3), 224–247.CrossRefGoogle Scholar
  50. 50.
    Corbin, J. M., & Strauss, A. (1988). Unending work and care: Managing chronic illness at home. San Fransisco, CA: Jossey-Bass.Google Scholar
  51. 51.
    Audulv, Å., Asplund, K., & Norbergh, K.-G. (2012). The integration of chronic illness self-management. Qualitative Health Research, 22(3), 332–345.CrossRefGoogle Scholar
  52. 52.
    Audulv, Å., Norbergh, K. G., Asplund, K., Hörnsten Å. (2009). An ongoing process of inner negotiation—A grounded Theory study of self-management among people living with chronic illness. Journal of Nursing and Healthcare of Chronic Illness, 1(4), 283–293.CrossRefGoogle Scholar
  53. 53.
    Schulman-Green, D., Jaser, S. S., Park, C., & Whittemore, R. (2016). A metasynthesis of factors affecting self-management of chronic illness. Journal of Advanced Nursing, 72(7), 1469–1489.CrossRefGoogle Scholar
  54. 54.
    Jamieson, N. J., Hanson, C. S., Josephson, M. A., Gordon, E. J., Craig, J. C., Halleck, F., Budde, K., & Tong, A. (2016). Motivations, challenges, and attitudes to self-management in kidney transplant recipients: A systematic review of qualitative studies. American Journal of Kidney Diseases, 67(3), 461–478.CrossRefGoogle Scholar
  55. 55.
    Boehmer, K. R., Gionfriddo, M. R., Rodriguez-Gutierrez, R., Dabrh, A. M., Leppin, A. L., Hargraves, I., May, C. R., Shippee, N. D., Castaneda-Guarderas, A., Palacios, C. Z., Bora, P., Erwin, P., & Montori, V. M. (2016). Patient capacity and constraints in the experience of chronic disease: A qualitative systematic review and thematic synthesis. BMC Family Practice, 17, 127.CrossRefGoogle Scholar
  56. 56.
    Roberts, N. J., Kidd, L., Dougall, N., Patel, I. S., McNarry, S., & Nixon, C. (2016). Measuring patient activation: The utility of the patient activation measure within a UK context-results from four exemplar studies and potential future applications. Patient Education and Counselling, 99(10), 1739–1746.CrossRefGoogle Scholar
  57. 57.
    Skolasky, R. L., Green, A. F., Scharfstein, D., Boult, C., Reider, L., & Wegener, S. T. (2011). Psychometric properties of the patient activation measure among multimorbid older adults. Health Services Research, 46(2), 457–478.CrossRefGoogle Scholar
  58. 58.
    Mosen, D. M., Schmittdiel, J., Hibbard, J., Sobel, D., Remmers, C., & Bellows, J. (2007). Is patient activation associated with outcomes of care for adults with chronic conditions? Journal of Ambulatory Care Management, 30(1), 21–29.CrossRefGoogle Scholar
  59. 59.
    Smith, D., Lawn, S., Harvey, P., & Battersby, M. (2017). Concurrent validity of the Partners in Health scale against general self-rated health in chronic conditions: A short report. Chronic Illness.  https://doi.org/10.1177/1742395317743559.

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Community Health and Epidemiology, Faculty of MedicineDalhousie UniversityHalifaxCanada
  2. 2.School of Occupational TherapyDalhousie UniversityHalifaxCanada
  3. 3.Department of NursingMid-Sweden UniversitySundsvallSweden

Personalised recommendations