Skip to main content

Advertisement

SpringerLink
Log in

The structural and convergent validity of three commonly used measures of self-management in persons with neurological conditions

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Purpose

Self-management ability is commonly assessed in chronic disease research and clinical practice. The purpose of this study was to assess the structural and convergent validity of three commonly used self-management outcome measures in a sample of persons with neurological conditions.

Methods

We used data from a Canadian survey of persons with neurological conditions, which included three commonly used self-management measures: the Partners in Health Scale (PIH), the Patient Activation Measure (PAM), and the Self-Efficacy for Managing a Chronic Disease Scale (SEMCD). Confirmatory factor analysis was used to assess the structural and convergent validity of the three measures.

Results

When treated as single-factor constructs, none of the measurement models provided a good fit to the data. A four-domain version of the PIH was the best fitting model. Confirmatory factor analysis suggests that the three tools measure different, but correlated constructs.

Conclusions

While the PAM, PIH and SEMCD scales are all used as measures of patient self-management, our study indicates that they measure different, but correlated latent variables. None, when treated as single, uni-dimensional construct, provides an acceptable fit to our data. This is probably because self-management is multi-dimensional, as is consistently shown by qualitative evidence. While these measures may provide reliable summative measures, multi-dimensional scales are needed for clinical use and more detailed research on self-management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Jonkman, N. H., Schuurmans, M. J., Groenwold, R. H. H., Hoes, A. W., & Trappenburg, J. C. A. (2016). Identifying components of self-management interventions that improve health-related quality of life in chronically ill patients: Systematic review and meta-regression analysis. Patient Education and Counselling, 99(7), 1087–1098.

    Article  Google Scholar 

  2. Jonkman, N. H., Westland, H., Groenwold, R. H. H., Ågren, S., Anguita, M., Blue, L., Bruggink-André de la Porte P. W. F., DeWalt, D. A., Hebert, P. L., Heisler, M., Jaarsma, T., Kempen, G. I. J. M., Leventhal, M. E., Lok, D. J. A., Mårtensson, J., Muñiz, J., Peters-Klimm, O. H., Rich, F., Riegel, M. W., Strömberg, B., Tsuyuki, A., Trappenburg, R. T., Schuurmans, J. C. A., Hoes, M. J. (2016). What are effective program characteristics of self-management interventions in patients with heart failure? An individual patient data meta-analysis. Journal of Cardiac Failure, 22(11), 861–871.

    Article  Google Scholar 

  3. Newham, J. J., Presseau, J., Heslop-Marshall, K., Russell, S., Ogunbayo, O. J., Netts, P., Hanratty, B., & Kaner, E. (2017). Features of self-management interventions for people with COPD associated with improved health-related quality of life and reduced emergency department visits: A systematic review and meta-analysis. International Journal of Chronic Obstructive Pulmonary Disease, 12, 1705–1720.

    Article  Google Scholar 

  4. Ogunbayo, O. J., Russell, S., Newham, J. J., Heslop-Marshall, K., Netts, P., Hanratty, B., & Kaner, E. (2017). Understanding the factors affecting self-management of COPD from the perspectives of healthcare practitioners: A qualitative study. NPJ Primary Care Respiritory Medicine, 27(1), 54.

    Article  Google Scholar 

  5. Liddy, C., Blazkho, V., & Mill, K. (2014). Challenges of self-management when living with multiple chronic conditions: Systematic review of the qualitative literature. Canadian Family Physician, 60(12), 1123–1133.

    PubMed  PubMed Central  Google Scholar 

  6. Boger, E. J., Demain, S., & Latter, S. (2013). Self-management: a systematic review of outcome measures adopted in self-management interventions for stroke. Disability and Rehabilitation, 35(17), 1415–1428.

    Article  Google Scholar 

  7. Nolte, S., Elsworth, G. R., Newman, S., & Osborne, R. H. (2013). Measurement issues in the evaluation of chronic disease self-management programs. Quality of Life Research, 22(7), 1655–1664.

    Article  Google Scholar 

  8. Packer, T. L., Fracini, A., Audulv, Å, Alizadeh, N., van Gaal, B. G. I., Warner, G., & Kephart, G. (2018). What we know about the purpose, theoretical foundation, scope and dimensionality of existing self-management measurement tools: A scoping review. Patient Education and Counselling, 101(4), 579–595.

    Article  Google Scholar 

  9. Corrigan, J. M., Adams, K., & Greiner, A. C. (2004). 1st annual crossing the quality chasm summit: A focus on communities. Washington, DC: National Academies Press.

    Google Scholar 

  10. Audulv, Å, Packer, T., Hutchinson, S., Roger, K. S., & Kephart, G. (2016). Coping, adapting or self-managing—What is the difference? A concept review based on the neurological literature. Journal of Advanced Nursing, 72(11), 2629–2643.

    Article  Google Scholar 

  11. Hibbard, J. H., Stockard, J., Mahoney, E. R., & Tusler, M. (2004). Development of the patient activation measure (PAM): Conceptualizing and measuring activation in patients and consumers. Health Services Research, 39(4 Pt 1), 1005–1026.

    Article  Google Scholar 

  12. Hibbard, J. H., Mahoney, E. R., Stockard, J., & Tusler, M. (2005). Development and testing of a short form of the patient activation measure. Health Services Research, 40(6 Pt 1), 1918–1930.

    Article  Google Scholar 

  13. Battersby, M. W., Ask, A., Reece, M. M., Markwick, M. J., & Collins, J. P. (2003). The Partners in Health scale: The development and psychometric properties of a generic assessment scale for chronic condition self-management. Australian Journal of Primary Health, 9(3), 41–52.

    Article  Google Scholar 

  14. Smith, D., Harvey, P., Lawn, S., Harris, M., & Battersby, M. (2017). Measuring chronic condition self-management in an Australian community: Factor structure of the revised Partners in Health (PIH) scale. Quality of Life Research, 26(1), 149–159.

    Article  Google Scholar 

  15. Lorig, K., Chastain, R. L., Ung, E., Shoor, S., & Holman, H. R. (1989). Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis and Rheumatism, 32(1), 37–44.

    Article  CAS  Google Scholar 

  16. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.

    Article  CAS  Google Scholar 

  17. Bodenheimer, T., Wagner, E. H., & Grumbach, K. (2002). Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA, 288(15), 1909–1914.

    Article  Google Scholar 

  18. Bodenheimer, T., Lorig, K., Holman, H., & Grumbach, K. (2002). Patient self-management of chronic disease in primary care. JAMA, 288(19), 2469–2475.

    Article  Google Scholar 

  19. Von Korff, M., Gruman, J., Schaefer, J., Curry, S. J., & Wagner, E. H. (1997). Collaborative management of chronic illness. Annals of Internal Medicine, 127(12), 1097–1102.

    Article  Google Scholar 

  20. Versnel, J., Packer, T., Weeks, L. E., Brown, J., Godwin, M., Hutchinson, S., Kephart, G., MacKenzie, D., Roger, K., Stadnyk, R., Villeneuve, M., & Warner, G. (2013). The everyday experience of living with and managing a neurological condition (the LINC study): Study design. BMC Neurology, 13, 30.

    Article  Google Scholar 

  21. Audulv, Å., Packer, T., & Versnel, J. (2014). Identifying gaps in knowledge: A map of the qualitative literature concerning life with a neurological condition. Chronic Illness, 10(3), 192–243.

    Article  Google Scholar 

  22. Canada, P. H. A. O. (2014). Mapping Connections: An understanding of the neurological conditions in Canada. Ottawa: Government of Canada.

    Google Scholar 

  23. Raghunathan, T. E., Lepkowski, J. M., & Hoewyk, J. V. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology, 27(1), 85–96.

    Google Scholar 

  24. StataCorp. (2017). Stata Statistical Software: Release 15. College Station: StataCorp LP.

    Google Scholar 

  25. Ritter, P. L., & Lorig, K. (2014). The English and Spanish Self-Efficacy to Manage Chronic Disease Scale measures were validated using multiple studies. Journal of Clinical Epidemiology, 67(11), 1265–1273.

    Article  Google Scholar 

  26. Freund, T., Gensichen, J., Goetz, K., Szecsenyi, J., & Mahler, C. (2013). Evaluating self-efficacy for managing chronic disease: Psychometric properties of the six-item Self-Efficacy Scale in Germany. Journal of Evaluation in Clinical Practice, 19(1), 39–43.

    Article  Google Scholar 

  27. Eslami, A., Daniali, S. S., Mohammadi, K., Reisi-Dehkordi, N., & Mostafavi-Darani, F. (2017). Cultural adaptation and psychometric properties of the persian version of self-efficacy in chronic disease patients. Iranian Journal of Nursing and Midwifery Research, 22(1), 57–61.

    Article  Google Scholar 

  28. Petkov, J., Harvey, P., & Battersby, M. (2010). The internal consistency and construct validity of the partners in health scale: Validation of a patient rated chronic condition self-management measure. Quality of Life Research, 19(7), 1079–1085.

    Article  Google Scholar 

  29. Brenk-Franz, K., Hibbard, J. H., Herrmann, W. J., Freund, T., Szecsenyi, J., Djalali, S., Steurer-Stey, C., Sönnichsen, A., Tiesler, F., Storch, M., Schneider, N., & Gensichen, J. (2013). Validation of the German version of the patient activation measure 13 (PAM13-D) in an international multicentre study of primary care patients. PLoS ONE, 8(9), e74786.

    Article  CAS  Google Scholar 

  30. Graffigna, G., Barello, S., Bonanomi, A., Lozza, E., & Hibbard, J. (2015). Measuring patient activation in Italy: Translation, adaptation and validation of the Italian version of the patient activation measure 13 (PAM13-I). BMC Medical Informatics and Decision Making, 15, 109.

    Article  Google Scholar 

  31. Magnezi, R., & Glasser, S. (2014). Psychometric properties of the Hebrew translation of the patient activation measure (PAM-13). PLoS ONE, 9(11), e113391.

    Article  Google Scholar 

  32. Moreno-Chico, C., González-de Paz, L., Monforte-Royo, C., Arrighi, E., Navarro-Rubio, M. D., & Gallart Fernández-Puebla, A. (2017). Adaptation to European Spanish and psychometric properties of the patient activation measure 13 in patients with chronic diseases. Family Practice, 34(5), 627–634.

    Article  Google Scholar 

  33. Rademakers, J., Nijman, J., van der Hoek, L., Heijmans, M., & Rijken, M. (2012). Measuring patient activation in The Netherlands: translation and validation of the American short form patient activation measure (PAM13). BMC Public Health, 12, 577.

    Article  Google Scholar 

  34. Zill, J. M., Dwinger, S., Kriston, L., Rohenkohl, A., Härter, M., & Dirmaier, J. (2013). Psychometric evaluation of the German version of the patient activation measure (PAM13). BMC Public Health, 13, 1027.

    Article  Google Scholar 

  35. Moljord, I. E. O., Lara-Cabrera, M. L., Perestelo-Pérez, L., Rivero-Santana, A., Eriksen, L., & Linaker, O. M. (2015). Psychometric properties of the patient activation measure-13 among out-patients waiting for mental health treatment: A validation study in Norway. Patient Education and Counselling, 98(11), 1410–1417.

    Article  Google Scholar 

  36. Green, C. A., Perrin, N. A., Polen, M. R., Leo, M. C., Hibbard, J. H., & Tusler, M. (2010). Development of the patient activation measure for mental health. Administration and Policy in Mental Health, 37(4), 327–333.

    Article  Google Scholar 

  37. Skolasky, R. L., Mackenzie, E. J., Riley, L. H., & Wegener, S. T. (2009). Psychometric properties of the patient activation measure among individuals presenting for elective lumbar spine surgery. Quality of Life Research, 18(10), 1357–1366.

    Article  Google Scholar 

  38. Prey, J. E., Qian, M., Restaino, S., Hibbard, J., Bakken, S., Schnall, R., Rothenberg, G., Vawdrey, D. K., & Masterson Creber, R. (2016). Reliability and validity of the patient activation measure in hospitalized patients. Patient Education and Counselling, 99(12), 2026–2033.

    Article  Google Scholar 

  39. Hung, M., Carter, M., Hayden, C., Dzierzon, R., Morales, J., Snow, L., Butler, J., Bateman, K., & Samore, M. (2013). Psychometric assessment of the patient activation measure short form (PAM-13) in rural settings. Quality of Life Research, 22(3), 521–529.

    Article  Google Scholar 

  40. Packer, T. L., Kephart, G., Ghahari, S., Audulv, Å, Versnel, J., & Warner, G. (2015). The patient activation measure: A validation study in a neurological population. Quality of Life Research, 24(7), 1587–1596.

    Article  Google Scholar 

  41. Brown, T. A. (2015). Confirmatory factor analysis for applied research. New York: Guilford.

    Google Scholar 

  42. McNeish, D. (2017). Thanks coefficient alpha, we’ll take It from here. Psychological Methods, 23(3), 412–433.

    Article  Google Scholar 

  43. Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120.

    Article  Google Scholar 

  44. Satorra, A.. Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In von Eye A. & C. C. Clogg (Eds.), In Latent variables analysis: Applications for developmental research (pp. 399–419). Thousand Oaks: Sage

    Google Scholar 

  45. Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and nonnormality. Structural Equation Modeling, 7(4), 557–595.

    Article  Google Scholar 

  46. Hu, L.. Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.

    Article  Google Scholar 

  47. Ngooi, B. X., Packer, T. L., Kephart, G., Warner, G., Koh, K. W. L., Wong, R. C. C., & Lim, S. P. (2016). Validation of the patient activation measure (PAM-13) among adults with cardiac conditions in Singapore. Quality of Life Research, 26(4), 1071–1080.

    Article  Google Scholar 

  48. Lenferink, A., Effing, T., Harvey, P., Battersby, M., Frith, P., van Beurden, W., et al. (2016). Construct validity of the Dutch version of the 12-item partners in health Scale: Measuring patient self-management behaviour and knowledge in patients with chronic obstructive pulmonary disease. PLoS ONE, 11(8), e0161595.

    Article  Google Scholar 

  49. Corbin, J.. Strauss, A. (1985). Managing chronic illness at home: Three lines of work. Qualitative Sociology, 8(3), 224–247.

    Article  Google Scholar 

  50. Corbin, J. M., & Strauss, A. (1988). Unending work and care: Managing chronic illness at home. San Fransisco, CA: Jossey-Bass.

    Google Scholar 

  51. Audulv, Å., Asplund, K., & Norbergh, K.-G. (2012). The integration of chronic illness self-management. Qualitative Health Research, 22(3), 332–345.

    Article  Google Scholar 

  52. Audulv, Å., Norbergh, K. G., Asplund, K., Hörnsten Å. (2009). An ongoing process of inner negotiation—A grounded Theory study of self-management among people living with chronic illness. Journal of Nursing and Healthcare of Chronic Illness, 1(4), 283–293.

    Article  Google Scholar 

  53. Schulman-Green, D., Jaser, S. S., Park, C., & Whittemore, R. (2016). A metasynthesis of factors affecting self-management of chronic illness. Journal of Advanced Nursing, 72(7), 1469–1489.

    Article  Google Scholar 

  54. Jamieson, N. J., Hanson, C. S., Josephson, M. A., Gordon, E. J., Craig, J. C., Halleck, F., Budde, K., & Tong, A. (2016). Motivations, challenges, and attitudes to self-management in kidney transplant recipients: A systematic review of qualitative studies. American Journal of Kidney Diseases, 67(3), 461–478.

    Article  Google Scholar 

  55. Boehmer, K. R., Gionfriddo, M. R., Rodriguez-Gutierrez, R., Dabrh, A. M., Leppin, A. L., Hargraves, I., May, C. R., Shippee, N. D., Castaneda-Guarderas, A., Palacios, C. Z., Bora, P., Erwin, P., & Montori, V. M. (2016). Patient capacity and constraints in the experience of chronic disease: A qualitative systematic review and thematic synthesis. BMC Family Practice, 17, 127.

    Article  Google Scholar 

  56. Roberts, N. J., Kidd, L., Dougall, N., Patel, I. S., McNarry, S., & Nixon, C. (2016). Measuring patient activation: The utility of the patient activation measure within a UK context-results from four exemplar studies and potential future applications. Patient Education and Counselling, 99(10), 1739–1746.

    Article  CAS  Google Scholar 

  57. Skolasky, R. L., Green, A. F., Scharfstein, D., Boult, C., Reider, L., & Wegener, S. T. (2011). Psychometric properties of the patient activation measure among multimorbid older adults. Health Services Research, 46(2), 457–478.

    Article  Google Scholar 

  58. Mosen, D. M., Schmittdiel, J., Hibbard, J., Sobel, D., Remmers, C., & Bellows, J. (2007). Is patient activation associated with outcomes of care for adults with chronic conditions? Journal of Ambulatory Care Management, 30(1), 21–29.

    Article  Google Scholar 

  59. Smith, D., Lawn, S., Harvey, P., & Battersby, M. (2017). Concurrent validity of the Partners in Health scale against general self-rated health in chronic conditions: A short report. Chronic Illness. https://doi.org/10.1177/1742395317743559.

Download references

Funding

The funding was provided by Public Health Agency of Canada, Nova Scotia Health Research Foundation (Grant No. PSO-DI-2015-10083), Institute of Health Services and Policy Research.

Author information

Authors and Affiliations

  1. Department of Community Health and Epidemiology, Faculty of Medicine, Dalhousie University, 5790 University Avenue, Halifax, NS, B3H 1V7, Canada

    George Kephart

  2. School of Occupational Therapy, Dalhousie University, PO Box 15000, Halifax, NS, B3H 4R2, Canada

    Tanya L. Packer & Grace Warner

  3. Department of Nursing, Mid-Sweden University, 851 70, Sundsvall, Sweden

    Åsa Audulv

Authors
  1. George Kephart
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tanya L. Packer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Åsa Audulv
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Grace Warner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to George Kephart.

Appendix

Appendix

See Tables 8, 9, 10 and 11.

Table 8 Item wordings for the PAM, PIH and SEMCD
Full size table
Table 9 Distribution of PIH Item Scores
Full size table
Table 10 Distribution of PAM Item Scores
Full size table
Table 11 Distribution of SEMCD Item Scores
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kephart, G., Packer, T.L., Audulv, Å. et al. The structural and convergent validity of three commonly used measures of self-management in persons with neurological conditions. Qual Life Res 28, 545–556 (2019). https://doi.org/10.1007/s11136-018-2036-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-018-2036-8

Keywords

Search

Navigation