Abstract
Women with heart failure report worse health-related quality of life on average, than men. This may result from actual differences in care or differing interpretations of and responses to survey questions. We investigated potential gender-based differential item functioning on the Kansas City Cardiomyopathy Questionnaire (KCCQ) Physical Limitations domain. Using data from the HF-ACTION trial, a multicenter, randomized controlled trial of exercise training in patients with chronic heart failure with reduced ejection fraction (661 women, 1670 men), we assessed gender-based differential item functioning using a Wald test based on item response theory and ordinal logistic regression. Both methods evaluated how men and women responded to each KCCQ item after adjusting for physical limitation status. No item exhibited statistically significant differential item functioning using the Wald method. Two items exhibited differential item functioning using the ordinal logistic regression method (KCCQ1e: Climbing a flight of stairs without stopping; KCCQ1f: Hurrying or jogging) (P < 0.01), but the magnitude of differential item functioning was negligible. To accurately measure patient-reported outcomes, it is important to evaluate potential biases that may influence the ability to compare patient subgroups. The magnitude of differential item functioning on a 5-item KCCQ Physical Limitation domain was negligible.
Similar content being viewed by others
Data Availability
The data that support the findings of this study are available upon request from https://biolincc.nhlbi.nih.gov/studies/hf_action/ Restrictions may apply to the availability of these data.
References
Adams, K. F., Dunlap, S. H., Sueta, C. A., Clarke, S. W., Patterson, J. H., Blauwet, M. B., Jensen, L. R., Tomasko, L., & Koch, G. (1996). Relation between gender, etiology and survival in patients with symptomatic heart failure. Journal of the American College of Cardiology, 28(7), 1781–1788. https://doi.org/10.1016/S0735-1097(96)00380-4
Ahmad, F. S., Kallen, M. A., Schifferdecker, K. E., Carluzzo, K. L., Yount, S. E., Gelow, J. M., McCullough, P. A., Kimmel, S. E., Fisher, E. S., & Cella, D. (2019, Jun). Development and initial validation of the PROMIS (R)-Plus-HF profile measure. Circulation-Heart Failure, 12(6), e005751. https://doi.org/10.1161/circheartfailure.118.005751
Armstrong, P. W., Lam, C. S. P., Anstrom, K. J., Ezekowitz, J., Hernandez, A. F., O’Connor, C. M., Pieske, B., Ponikowski, P., Shah, S. J., Solomon, S. D., Voors, A. A., She, L. L., Vlajnic, V., Carvalho, F., Bamber, L., Blaustein, R. O., Roessig, L., Butler, J., & Grp, V.-H.S. (2020). Effect of vericiguat vs placebo on quality of life in patients with heart failure and preserved ejection fraction the VITALITY-HFpEF randomized clinical trial. Jama-Journal of the American Medical Association, 324(15), 1512–1521. https://doi.org/10.1001/jama.2020.15922
Cai, L., Maydeu-Olivares, A., Coffman, D. L., & Thissen, D. (2006). Limited-information goodness-of-fit testing of item response theory models for sparse 2(P) tables. British Journal of Mathematical & Statistical Psychology, 59, 173–194. https://doi.org/10.1348/000711005x66419
Chen, W. H., & Thissen, D. (1997). Local dependence indexes for item pairs: Using item response theory. Journal of Educational and Behavioral Statistics, 22(3), 265–289. https://doi.org/10.3102/10769986022003265
ClinicalTrials.gov. U.S. National Library of Medicine. (2020, May 28). Pressure assessment to improve outcomes after TAVR: A registry. Identifier NCT03923530. Retrieved August 8, 2022, from https://ClinicalTrials.gov/show/NCT03923530
ClinicalTrials.gov. U.S. National Library of Medicine. (2021a, May 5). Determine-reduced - dapagliflozin effect on exercise capacity using a 6-minute walk test in patients with heart failure with reduced ejection fraction. Identifier NCT03877237. Retrieved August 8, 2022, from https://ClinicalTrials.gov/show/NCT03877237
ClinicalTrials.gov. U.S. National Library of Medicine. (2021b, November 17). Determine-preserved - dapagliflozin effect on exercise capacity using a 6-minute walk test in patients with heart failure with preserved ejection fraction. Identifier NCT03877224. Retrieved August 8, 2022, from https://ClinicalTrials.gov/show/NCT03877224
Cohen, J. (1992). A Power Primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
Coles, T. M., Lucas, N., McFatrich, M., Henke, D., Ridgeway, J. L., Behnken, E. M., Weinfurt, K., Reeve, B. B., Corneli, A., Dunlay, S. M., Spertus, J. A., Lin, L., Piña, I. L., Bocell, F. D., Tarver, M. E., Dohse, H., Saha, A., & Caldwell, B. (2023). Investigating gender-based differential item functioning on the Kansas City Cardiomyopathy Questionnaire (KCCQ) using qualitative content analysis. Quality of Life Research, 32, 841–852. https://doi.org/10.1007/s11136-022-03276-y
Coles, T. (2022). Do PRO measures function the same way for all individuals with heart failure? J Card Fail (S1071–9164(22)), 00545–00540. https://doi.org/10.1016/j.cardfail.2022.05.017
Crane, P. K., Gibbons, L. E., Ocepek-Welikson, K., Cook, K., Cella, D., Narasimhalu, K., Hays, R. D., & Teresi, J. A. (2007). A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Quality of Life Research, 16, 69–84. https://doi.org/10.1007/s11136-007-9185-5
Dewan, P., Rorth, R., Jhund, P. S., Shen, L., Raparelli, V., Petrie, M. C., Abraham, W. T., Desai, A. S., Dickstein, K., Kober, L., Mogensen, U. M., Packer, M., Rouleau, J. L., Solomon, S. D., Swedberg, K., Zile, M. R., & McMurray, J. J. V. (2019). Differential impact of heart failure with reduced ejection fraction on men and women. Journal of the American College of Cardiology, 73(1), 29–40. https://doi.org/10.1016/j.jacc.2018.09.081
Edelen, M. O., Stucky, B. D., & Chandra, A. (2015). Quantifying “problematic” DIF within an IRT framework: application to a cancer stigma index. Quality of Life Research, 24(1), 95–103. https://doi.org/10.1007/s11136-013-0540-4
Eurich, D. T., Johnson, J. A., Reid, K. J., & Spertus, J. A. (2006). Assessing responsiveness of generic and specific health related quality of life measures in heart failure. Health and Quality of Life Outcomes, 4, 89. https://doi.org/10.1186/1477-7525-4-89
Flynn, K. E., Piña, I. L., Whellan, D. J., Lin, L., Blumenthal, J. A., Ellis, S. J., Fine, L. J., Howlett, J. G., Keteyian, S. J., Kitzman, D. W., Kraus, W. E., Miller, N. H., Schulman, K. A., Spertus, J. A., O’Connor, C. M., & Weinfurt, K. P. (2009). Effects of exercise training on health status in patients with chronic heart failure HF-ACTION randomized controlled trial. Jama-Journal of the American Medical Association, 301(14), 1451–1459. https://doi.org/10.1001/jama.2009.457
Green, C. P., Porter, C. B., Bresnahan, D. R., & Spertus, J. A. (2000). Development and evaluation of the Kansas City Cardiomyopathy Questionnaire: A new health status measure for heart failure. Journal of the American College of Cardiology, 35(5), 1245–1255. https://doi.org/10.1016/S0735-1097(00)00531-3
Heiat, A., Gross, C. P., & Krumholz, H. M. (2002). Representation of the elderly, women, and minorities in heart failure clinical trials. Archives of Internal Medicine, 162(15), 1682–1688. https://doi.org/10.1001/archinte.162.15.1682
Heidenreich, P. A. (2021). The growing case for routine collection of patient-reported outcomes. JAMA Cardiol, 6(5), 497–498. https://doi.org/10.1001/jamacardio.2021.0391
Kelkar, A. A., Spertus, J., Pang, P., Pierson, R. F., Cody, R. J., Piña, I. L., Hernandez, A., & Butler, J. (2016). Utility of patient-reported outcome instruments in heart failure. JACC Heart Fail, 4(3), 165–175. https://doi.org/10.1016/j.jchf.2015.10.015
Khariton, Y., Nassif, M. E., Thomas, L., Fonarow, G. C., Mi, X. J., DeVore, A. D., Duffy, C., Sharma, P. P., Albert, N. M., Patterson, J. H., Butler, L., Hernandez, A. F., Williams, F. B., McCague, K., & Spertus, J. A. (2018). Health status disparities by sex, race/ethnicity, and socioeconomic status in outpatients with heart failure. Jacc-Heart Failure, 6(6), 465–473. https://doi.org/10.1016/j.jchf.2018.02.002
Langer, M. M. (2008). A reexamination of Lord’s Wald test for differential item functioning using item response theory and modern error estimation. https://doi.org/10.17615/chn0-dz45
Lee, C. S., Hiatt, S. O., Denfeld, Q. E., Chien, C. V., Mudd, J. O., & Gelow, J. M. (2015). Gender-specific physical symptom biology in heart failure. Journal of Cardiovascular Nursing, 30(6), 517–521. https://doi.org/10.1097/Jcn.0000000000000191
McSweeney, J. C., Cody, M., O’Sullivan, P., Elberson, K., Moser, D. K., & Garvin, B. J. (2003). Women’s early warning symptoms of acute myocardial infarction. Circulation, 108(21), 2619–2623. https://doi.org/10.1161/01.Cir.0000097116.29625.7c
Mentz, R. J., Kelly, J. P., von Lueder, T. G., Voors, A. A., Lam, C. S. P., Cowie, M. R., Kjeldsen, K., Jankowska, E. A., Atar, D., Butler, J., Fiuzat, M., Zannad, F., Pitt, B., & O’Connor, C. M. (2014). Noncardiac comorbidities in heart failure with reduced versus preserved ejection fraction. Journal of the American College of Cardiology, 64(21), 2281–2293. https://doi.org/10.1016/j.jacc.2014.08.036
Munyombwe, T., Höfer, S., Fitzsimons, D., Thompson, D. R., Lane, D., Smith, K., & Astin, F. (2014). An evaluation of the Minnesota living with heart failure questionnaire using Rasch analysis. Quality of Life Research, 23(6), 1753–1765.
O’Connor, C. M., Whellan, D. J., Lee, K. L., Keteyian, S. J., Cooper, L. S., Ellis, S. J., Leifer, E. S., Kraus, W. E., Kitzman, D. W., Blumenthal, J. A., Rendall, D. S., Miller, N. H., Fleg, J. L., Schulman, K. A., McKelvie, R. S., Zannad, F., Piña, I. L., & Investigators, H.-A. (2009). Efficacy and safety of exercise training in patients with chronic heart failure HF-ACTION randomized controlled trial. Jama-Journal of the American Medical Association, 301(14), 1439–1450. https://doi.org/10.1001/jama.2009.454
Piña, I. L., Kokkinos, P., Kao, A., Bittner, V., Saval, M., Clare, B., Goldberg, L., Johnson, M., Swank, A., Ventura, H., Moe, G., Fitz-Gerald, M., Ellis, S. J., Vest, M., Cooper, L., Whellan, D., & Investigators, H.-A. (2009). Baseline differences in the HF-ACTION trial by sex. American Heart Journal, 158(4), S16–S23. https://doi.org/10.1016/j.ahj.2009.07.012
Pope, J. H., Aufderheide, T. P., Ruthazer, R., Woolard, R. H., Feldman, J. A., Beshansky, J. R., Griffith, J. L., & Selker, H. P. (2000). Missed diagnoses of acute cardiac ischemia in the emergency department. New England Journal of Medicine, 342(16), 1163–1170. https://doi.org/10.1056/Nejm200004203421603
Rector, T. S., & Cohn, J. N. (1992). Assessment of patient outcome with the minnesota living with heart-failure Questionnaire - reliability and validity during a randomized, double-blind, placebo-controlled trial of pimobendan. American Heart Journal, 124(4), 1017–1025. https://doi.org/10.1016/0002-8703(92)90986-6
Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H. H., Gershon, R., Reise, S. P., Lai, J. S., Cella, D., & Grp, P. C. (2007). Psychometric evaluation and calibration of health-related quality of life item banks - Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5), S22–S31. https://doi.org/10.1097/01.mlr.0000250483.85507.04
Spertus, J. A., Jones, P. G., Kim, J., & Globe, D. (2008). Validity, reliability, and responsiveness of the Kansas City Cardiomyopathy Questionnaire in anemic heart failure patients. Quality of Life Research, 17(2), 291–298. https://doi.org/10.1007/s11136-007-9302-5
Toland, M. D. (2014). Practical guide to conducting an item response theory analysis. Journal of Early Adolescence, 34(1), 120–151. https://doi.org/10.1177/0272431613511332
United States (U.S.) Food and Drug Administration (FDA). (2016, January 19). Medical device development tool (MDDT): Qualification decision summary for Kansas City Cardiomyopathy Questionnaire (KCCQ). Submission MDDT020. Retrieved August 8, 2022, from https://www.fda.gov/media/108301/download
Vector Psychometric Group. (2011). IRTPRO for Windows [Computer software]. Lincolnwood, IL: Scientific Software International. Retrieved August 8, 2022, from https://vpgcentral.com/software/irtpro/
Weinfurt, K. P. (2021). Constructing arguments for the interpretation and use of patient-reported outcome measures in research: an application of modern validity theory. Quality of Life Research, 30(6), 1715–1722. https://doi.org/10.1007/s11136-021-02776-7
Zumbo, B. D. (1999). Handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense (Canada).
Acknowledgements
The authors acknowledge Heidi Dohse, a patient partner, for her insight on the patients’ perspective. The authors acknowledge patients and clinicians from the HF-ACTION trial, Ashley J. Wilson, our Center for Health Measurement intern for her support with the DIF worksheets, as well as Karen Staman, Liz Wing, and Terren Green, who provided medical editing support.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing Interests
Dr. John Spertus owns the copyright to the KCCQ. Dr. Mentz received research support and honoraria from Abbott, American Regent, Amgen, AstraZeneca, Bayer, Boehringer Ingelheim/Eli Lilly, Boston Scientific, Cytokinetics, Fast BioMedical, Gilead, Innolife, Medtronic, Merck, Novartis, Relypsa, Respicardia, Roche, Sanofi, Vifor, and Windtree Therapeutics. Dr. Coles received research support from Merck and is a consultant with Regenxbio. Ms. Lin, Dr. Weinfurt, Dr. Reeve, Dr. Piña, Dr. Bocell, Dr. Tarver, Ms. Saha, and Dr. Caldwell have no competing interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Coles, T.M., Lin, L., Weinfurt, K. et al. Investigating Potential Gender-Based Differential Item Functioning for Items in the Kansas City Cardiomyopathy Questionnaire (KCCQ) Physical Limitations Domain. Applied Research Quality Life 18, 1785–1798 (2023). https://doi.org/10.1007/s11482-023-10162-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11482-023-10162-3