Self-management ability is commonly assessed in chronic disease research and clinical practice. The purpose of this study was to assess the structural and convergent validity of three commonly used self-management outcome measures in a sample of persons with neurological conditions.
We used data from a Canadian survey of persons with neurological conditions, which included three commonly used self-management measures: the Partners in Health Scale (PIH), the Patient Activation Measure (PAM), and the Self-Efficacy for Managing a Chronic Disease Scale (SEMCD). Confirmatory factor analysis was used to assess the structural and convergent validity of the three measures.
When treated as single-factor constructs, none of the measurement models provided a good fit to the data. A four-domain version of the PIH was the best fitting model. Confirmatory factor analysis suggests that the three tools measure different, but correlated constructs.
While the PAM, PIH and SEMCD scales are all used as measures of patient self-management, our study indicates that they measure different, but correlated latent variables. None, when treated as single, uni-dimensional construct, provides an acceptable fit to our data. This is probably because self-management is multi-dimensional, as is consistently shown by qualitative evidence. While these measures may provide reliable summative measures, multi-dimensional scales are needed for clinical use and more detailed research on self-management.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Jonkman, N. H., Schuurmans, M. J., Groenwold, R. H. H., Hoes, A. W., & Trappenburg, J. C. A. (2016). Identifying components of self-management interventions that improve health-related quality of life in chronically ill patients: Systematic review and meta-regression analysis. Patient Education and Counselling, 99(7), 1087–1098.
Jonkman, N. H., Westland, H., Groenwold, R. H. H., Ågren, S., Anguita, M., Blue, L., Bruggink-André de la Porte P. W. F., DeWalt, D. A., Hebert, P. L., Heisler, M., Jaarsma, T., Kempen, G. I. J. M., Leventhal, M. E., Lok, D. J. A., Mårtensson, J., Muñiz, J., Peters-Klimm, O. H., Rich, F., Riegel, M. W., Strömberg, B., Tsuyuki, A., Trappenburg, R. T., Schuurmans, J. C. A., Hoes, M. J. (2016). What are effective program characteristics of self-management interventions in patients with heart failure? An individual patient data meta-analysis. Journal of Cardiac Failure, 22(11), 861–871.
Newham, J. J., Presseau, J., Heslop-Marshall, K., Russell, S., Ogunbayo, O. J., Netts, P., Hanratty, B., & Kaner, E. (2017). Features of self-management interventions for people with COPD associated with improved health-related quality of life and reduced emergency department visits: A systematic review and meta-analysis. International Journal of Chronic Obstructive Pulmonary Disease, 12, 1705–1720.
Ogunbayo, O. J., Russell, S., Newham, J. J., Heslop-Marshall, K., Netts, P., Hanratty, B., & Kaner, E. (2017). Understanding the factors affecting self-management of COPD from the perspectives of healthcare practitioners: A qualitative study. NPJ Primary Care Respiritory Medicine, 27(1), 54.
Liddy, C., Blazkho, V., & Mill, K. (2014). Challenges of self-management when living with multiple chronic conditions: Systematic review of the qualitative literature. Canadian Family Physician, 60(12), 1123–1133.
Boger, E. J., Demain, S., & Latter, S. (2013). Self-management: a systematic review of outcome measures adopted in self-management interventions for stroke. Disability and Rehabilitation, 35(17), 1415–1428.
Nolte, S., Elsworth, G. R., Newman, S., & Osborne, R. H. (2013). Measurement issues in the evaluation of chronic disease self-management programs. Quality of Life Research, 22(7), 1655–1664.
Packer, T. L., Fracini, A., Audulv, Å, Alizadeh, N., van Gaal, B. G. I., Warner, G., & Kephart, G. (2018). What we know about the purpose, theoretical foundation, scope and dimensionality of existing self-management measurement tools: A scoping review. Patient Education and Counselling, 101(4), 579–595.
Corrigan, J. M., Adams, K., & Greiner, A. C. (2004). 1st annual crossing the quality chasm summit: A focus on communities. Washington, DC: National Academies Press.
Audulv, Å, Packer, T., Hutchinson, S., Roger, K. S., & Kephart, G. (2016). Coping, adapting or self-managing—What is the difference? A concept review based on the neurological literature. Journal of Advanced Nursing, 72(11), 2629–2643.
Hibbard, J. H., Stockard, J., Mahoney, E. R., & Tusler, M. (2004). Development of the patient activation measure (PAM): Conceptualizing and measuring activation in patients and consumers. Health Services Research, 39(4 Pt 1), 1005–1026.
Hibbard, J. H., Mahoney, E. R., Stockard, J., & Tusler, M. (2005). Development and testing of a short form of the patient activation measure. Health Services Research, 40(6 Pt 1), 1918–1930.
Battersby, M. W., Ask, A., Reece, M. M., Markwick, M. J., & Collins, J. P. (2003). The Partners in Health scale: The development and psychometric properties of a generic assessment scale for chronic condition self-management. Australian Journal of Primary Health, 9(3), 41–52.
Smith, D., Harvey, P., Lawn, S., Harris, M., & Battersby, M. (2017). Measuring chronic condition self-management in an Australian community: Factor structure of the revised Partners in Health (PIH) scale. Quality of Life Research, 26(1), 149–159.
Lorig, K., Chastain, R. L., Ung, E., Shoor, S., & Holman, H. R. (1989). Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arthritis and Rheumatism, 32(1), 37–44.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.
Bodenheimer, T., Wagner, E. H., & Grumbach, K. (2002). Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA, 288(15), 1909–1914.
Bodenheimer, T., Lorig, K., Holman, H., & Grumbach, K. (2002). Patient self-management of chronic disease in primary care. JAMA, 288(19), 2469–2475.
Von Korff, M., Gruman, J., Schaefer, J., Curry, S. J., & Wagner, E. H. (1997). Collaborative management of chronic illness. Annals of Internal Medicine, 127(12), 1097–1102.
Versnel, J., Packer, T., Weeks, L. E., Brown, J., Godwin, M., Hutchinson, S., Kephart, G., MacKenzie, D., Roger, K., Stadnyk, R., Villeneuve, M., & Warner, G. (2013). The everyday experience of living with and managing a neurological condition (the LINC study): Study design. BMC Neurology, 13, 30.
Audulv, Å., Packer, T., & Versnel, J. (2014). Identifying gaps in knowledge: A map of the qualitative literature concerning life with a neurological condition. Chronic Illness, 10(3), 192–243.
Canada, P. H. A. O. (2014). Mapping Connections: An understanding of the neurological conditions in Canada. Ottawa: Government of Canada.
Raghunathan, T. E., Lepkowski, J. M., & Hoewyk, J. V. (2001). A multivariate technique for multiply imputing missing values using a sequence of regression models. Survey Methodology, 27(1), 85–96.
StataCorp. (2017). Stata Statistical Software: Release 15. College Station: StataCorp LP.
Ritter, P. L., & Lorig, K. (2014). The English and Spanish Self-Efficacy to Manage Chronic Disease Scale measures were validated using multiple studies. Journal of Clinical Epidemiology, 67(11), 1265–1273.
Freund, T., Gensichen, J., Goetz, K., Szecsenyi, J., & Mahler, C. (2013). Evaluating self-efficacy for managing chronic disease: Psychometric properties of the six-item Self-Efficacy Scale in Germany. Journal of Evaluation in Clinical Practice, 19(1), 39–43.
Eslami, A., Daniali, S. S., Mohammadi, K., Reisi-Dehkordi, N., & Mostafavi-Darani, F. (2017). Cultural adaptation and psychometric properties of the persian version of self-efficacy in chronic disease patients. Iranian Journal of Nursing and Midwifery Research, 22(1), 57–61.
Petkov, J., Harvey, P., & Battersby, M. (2010). The internal consistency and construct validity of the partners in health scale: Validation of a patient rated chronic condition self-management measure. Quality of Life Research, 19(7), 1079–1085.
Brenk-Franz, K., Hibbard, J. H., Herrmann, W. J., Freund, T., Szecsenyi, J., Djalali, S., Steurer-Stey, C., Sönnichsen, A., Tiesler, F., Storch, M., Schneider, N., & Gensichen, J. (2013). Validation of the German version of the patient activation measure 13 (PAM13-D) in an international multicentre study of primary care patients. PLoS ONE, 8(9), e74786.
Graffigna, G., Barello, S., Bonanomi, A., Lozza, E., & Hibbard, J. (2015). Measuring patient activation in Italy: Translation, adaptation and validation of the Italian version of the patient activation measure 13 (PAM13-I). BMC Medical Informatics and Decision Making, 15, 109.
Magnezi, R., & Glasser, S. (2014). Psychometric properties of the Hebrew translation of the patient activation measure (PAM-13). PLoS ONE, 9(11), e113391.
Moreno-Chico, C., González-de Paz, L., Monforte-Royo, C., Arrighi, E., Navarro-Rubio, M. D., & Gallart Fernández-Puebla, A. (2017). Adaptation to European Spanish and psychometric properties of the patient activation measure 13 in patients with chronic diseases. Family Practice, 34(5), 627–634.
Rademakers, J., Nijman, J., van der Hoek, L., Heijmans, M., & Rijken, M. (2012). Measuring patient activation in The Netherlands: translation and validation of the American short form patient activation measure (PAM13). BMC Public Health, 12, 577.
Zill, J. M., Dwinger, S., Kriston, L., Rohenkohl, A., Härter, M., & Dirmaier, J. (2013). Psychometric evaluation of the German version of the patient activation measure (PAM13). BMC Public Health, 13, 1027.
Moljord, I. E. O., Lara-Cabrera, M. L., Perestelo-Pérez, L., Rivero-Santana, A., Eriksen, L., & Linaker, O. M. (2015). Psychometric properties of the patient activation measure-13 among out-patients waiting for mental health treatment: A validation study in Norway. Patient Education and Counselling, 98(11), 1410–1417.
Green, C. A., Perrin, N. A., Polen, M. R., Leo, M. C., Hibbard, J. H., & Tusler, M. (2010). Development of the patient activation measure for mental health. Administration and Policy in Mental Health, 37(4), 327–333.
Skolasky, R. L., Mackenzie, E. J., Riley, L. H., & Wegener, S. T. (2009). Psychometric properties of the patient activation measure among individuals presenting for elective lumbar spine surgery. Quality of Life Research, 18(10), 1357–1366.
Prey, J. E., Qian, M., Restaino, S., Hibbard, J., Bakken, S., Schnall, R., Rothenberg, G., Vawdrey, D. K., & Masterson Creber, R. (2016). Reliability and validity of the patient activation measure in hospitalized patients. Patient Education and Counselling, 99(12), 2026–2033.
Hung, M., Carter, M., Hayden, C., Dzierzon, R., Morales, J., Snow, L., Butler, J., Bateman, K., & Samore, M. (2013). Psychometric assessment of the patient activation measure short form (PAM-13) in rural settings. Quality of Life Research, 22(3), 521–529.
Packer, T. L., Kephart, G., Ghahari, S., Audulv, Å, Versnel, J., & Warner, G. (2015). The patient activation measure: A validation study in a neurological population. Quality of Life Research, 24(7), 1587–1596.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. New York: Guilford.
McNeish, D. (2017). Thanks coefficient alpha, we’ll take It from here. Psychological Methods, 23(3), 412–433.
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120.
Satorra, A.. Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In von Eye A. & C. C. Clogg (Eds.), In Latent variables analysis: Applications for developmental research (pp. 399–419). Thousand Oaks: Sage
Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and nonnormality. Structural Equation Modeling, 7(4), 557–595.
Hu, L.. Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
Ngooi, B. X., Packer, T. L., Kephart, G., Warner, G., Koh, K. W. L., Wong, R. C. C., & Lim, S. P. (2016). Validation of the patient activation measure (PAM-13) among adults with cardiac conditions in Singapore. Quality of Life Research, 26(4), 1071–1080.
Lenferink, A., Effing, T., Harvey, P., Battersby, M., Frith, P., van Beurden, W., et al. (2016). Construct validity of the Dutch version of the 12-item partners in health Scale: Measuring patient self-management behaviour and knowledge in patients with chronic obstructive pulmonary disease. PLoS ONE, 11(8), e0161595.
Corbin, J.. Strauss, A. (1985). Managing chronic illness at home: Three lines of work. Qualitative Sociology, 8(3), 224–247.
Corbin, J. M., & Strauss, A. (1988). Unending work and care: Managing chronic illness at home. San Fransisco, CA: Jossey-Bass.
Audulv, Å., Asplund, K., & Norbergh, K.-G. (2012). The integration of chronic illness self-management. Qualitative Health Research, 22(3), 332–345.
Audulv, Å., Norbergh, K. G., Asplund, K., Hörnsten Å. (2009). An ongoing process of inner negotiation—A grounded Theory study of self-management among people living with chronic illness. Journal of Nursing and Healthcare of Chronic Illness, 1(4), 283–293.
Schulman-Green, D., Jaser, S. S., Park, C., & Whittemore, R. (2016). A metasynthesis of factors affecting self-management of chronic illness. Journal of Advanced Nursing, 72(7), 1469–1489.
Jamieson, N. J., Hanson, C. S., Josephson, M. A., Gordon, E. J., Craig, J. C., Halleck, F., Budde, K., & Tong, A. (2016). Motivations, challenges, and attitudes to self-management in kidney transplant recipients: A systematic review of qualitative studies. American Journal of Kidney Diseases, 67(3), 461–478.
Boehmer, K. R., Gionfriddo, M. R., Rodriguez-Gutierrez, R., Dabrh, A. M., Leppin, A. L., Hargraves, I., May, C. R., Shippee, N. D., Castaneda-Guarderas, A., Palacios, C. Z., Bora, P., Erwin, P., & Montori, V. M. (2016). Patient capacity and constraints in the experience of chronic disease: A qualitative systematic review and thematic synthesis. BMC Family Practice, 17, 127.
Roberts, N. J., Kidd, L., Dougall, N., Patel, I. S., McNarry, S., & Nixon, C. (2016). Measuring patient activation: The utility of the patient activation measure within a UK context-results from four exemplar studies and potential future applications. Patient Education and Counselling, 99(10), 1739–1746.
Skolasky, R. L., Green, A. F., Scharfstein, D., Boult, C., Reider, L., & Wegener, S. T. (2011). Psychometric properties of the patient activation measure among multimorbid older adults. Health Services Research, 46(2), 457–478.
Mosen, D. M., Schmittdiel, J., Hibbard, J., Sobel, D., Remmers, C., & Bellows, J. (2007). Is patient activation associated with outcomes of care for adults with chronic conditions? Journal of Ambulatory Care Management, 30(1), 21–29.
Smith, D., Lawn, S., Harvey, P., & Battersby, M. (2017). Concurrent validity of the Partners in Health scale against general self-rated health in chronic conditions: A short report. Chronic Illness. https://doi.org/10.1177/1742395317743559.
The funding was provided by Public Health Agency of Canada, Nova Scotia Health Research Foundation (Grant No. PSO-DI-2015-10083), Institute of Health Services and Policy Research.
About this article
Cite this article
Kephart, G., Packer, T.L., Audulv, Å. et al. The structural and convergent validity of three commonly used measures of self-management in persons with neurological conditions. Qual Life Res 28, 545–556 (2019). https://doi.org/10.1007/s11136-018-2036-8
- Patient activation
- Confirmatory factor analysis
- Construct validity
- Structural validity
- Convergent validity