Abstract
Goal of work
The goal of this study is to test the validity of RESPOND, a web-based decision support system to assess and manage anemia in cancer patients as per the European Organisation for Research and Treatment of Cancer (EORTC) guidelines. The intraclass correlation metrics for the algorithmic definitions were reported previously. Reported here are the concurrent validity, the extent to which clinicians' anemia management is guidelines-congruent when using the system; and discriminant validity, the extent to which clinicians practice in congruence with guidelines when vs. when not using the system.
Patients and methods
Hybrid matched design with precohort (retrospective; clinicians not using RESPOND) and postcohort (prospective; clinicians using RESPOND) of anemic patients matched on cancer type and chemotherapy regimen and followed up over 4 months after treatment initiation with erythropoietic proteins (34 patients per cohort; total N = 68). Congruence scores quantified the extent to which anemia management was congruent with the EORTC guidelines (range 0–10).
Main results
Hemoglobin (Hb) increased significantly for both cohorts, but the postcohort group showed more rapid rate of Hb increase over time (p < 0.006), higher Hb by visit 4 (p = 0.007), and greater Hb increase by visit 4 (p = 0.006). Concurrent validity was high with mean postcohort congruence scores of 8.18 ± 1.38. Discriminant validity was inferred from statistically significant differences in mean congruence scores between cohorts (p < 0.001) and from the postcohort having odds ratios of 3.64 for patients to reach Hb ≥ 11 g/dL and 2.91 to achieve Hb ≥ 12 g/dL.
Conclusions
RESPOND, a validated computerized clinical guidance system with an incremental effect beyond the pharmacotherapeutic effect of erythropoietic proteins, offers clinicians accurate and safe guidance in managing anemia in cancer patients.
Similar content being viewed by others
References
Groopman JE, Itri LM (1999) Chemotherapy-induced anemia in adults: incidence and treatment. J Natl Cancer Inst 91:1616–1634
Ludwig H, Van Belle S, Barrett-Lee P et al (2004) The European Cancer Anemia Survey (ECAS): a large, multinational, prospective survey defining the prevalence, incidence, and treatment of anemia in cancer patients. Eur J Cancer 40:2293–2306
Blohmer JU, Dunst J, Harrison L et al (2005) Cancer-related anemia: biological findings, clinical implications and impact on quality of life. Oncology 68:S12–S21
Caro JJ, Salas M, Ward A et al (2001) Anemia as an independent prognostic factor for survival in patients with cancer: a systemic, quantitative review. Cancer 91:2214–2221
Nissenson AR, Goodnough LT, Dubois RW (2003) Anemia: not just an innocent bystander? Arch Int Med 163:1400–1404
Cella D (1998) Factors influencing quality of life in cancer patients: anemia and fatigue. Semin Oncol 25:S43–S46
Rizzo JD, Lichtin AE, Woolf SH et al (2002) Use of epoetin in patients with cancer: evidence-based clinical practice guidelines of the American Society of Clinical Oncology and the American Society of Hematology. J Clin Oncol 20:4083–4107
Rizzo JD, Somerfield MR, Hagerty KL et al (2008) Use of epoetin and darbepoetin in patients with cancer: 2007 American Society of Clinical Oncology/American Society of Hematology clinical practice guideline update. J Clin Oncol 26:132–149
Bokemeyer C, Aapro MS, Courdi A et al (2004) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer. Eur J Cancer 40:2201–2216
Bokemeyer C, Aapro MS, Courdi A et al (2007) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer: 2006 update. Eur J Cancer 43:258–270
Aapro MS, Link H (2008) September 2007 update on EORTC guidelines and anemia management with erythropoiesis-stimulating agents. Oncologist 13:33–36
Ludwig H, Aapro M, Bokemeyer C et al (2009) Treatment patterns and outcomes in the management of cancer-related anemia in Europe: findings from the Anemia Cancer Treatment (A.C.T.) study. Eur J Cancer. doi:10.1016/j.ejca.2009.02.003
Aapro M, Abraham I, MacDonald K et al (2007) Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care. Support Care Cancer 15:1325–1329
Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24:18–28
Eddy DM (2005) Evidence-based medicine: a unified approach. Health Aff 24:9–17
Olivotto A, Coldman AJ, Hislop TG (1997) Compliance with practice guidelines for node-negative breast cancer. J Clin Oncol 15:216–222
Hébert-Croteau N, Brisson J, Latreille J et al (2004) Compliance with consensus recommendations for systemic therapy is associated with improved survival of women with node-negative breast cancer. J Clin Oncol 22:3685–3693
Mille D, Roy T, Carrere MO et al (2000) Economic impact of harmonizing medical practices: compliance with clinical practice guidelines in the follow-up of breast cancer in a French comprehensive cancer center. J Clin Oncol 18:1718–1724
Cruse H, Winiark M, Marshburn J et al (2002) Quality and methods of developing practice guidelines. BMC Health Serv Res 2:1–7
Aapro M, Van Erps J, MacDonald K et al (2008) Promoting evidence-based management of anemia in cancer patients: background, development, and scientific validation of RESPOND, a web-based clinical guidance system based on the EORTC guidelines. Crit Rev Oncol Hematol 65:32–42
Smith TJ, Hillner BE (2001) Ensuring quality cancer care by the use of clinical practice guidelines and critical pathways. J Clin Oncol 19:2886–2897
Bates DW, Kuperman GJ, Wang S et al (2003) Ten commandments for effective clinical decision making support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 10:523–530
Musen MA, Shahar Y, Shortliffe EH (2006) Clinical decision support systems. In: Shortliffe EH, Cimino JJ (eds) Biomedical informatics: computer applications in health care and biomedicine, 3rd edn. Springer, New York, pp 698–736
Kawamoto K, Houlihan CA, Balas EA et al (2005) Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Br Med J 330:775–782
Aapro M, MacDonald K, Van Erps J et al (2009) Managing cancer-related anemia in congruence with the EORTC guidelines is an independent predictor of hemoglobin outcome: initial evidence from the RESPOND study. Eur J Cancer 45:8–11
Khuri FR (2007) Weighing the hazards of erythropoiesis stimulation in patients with cancer. N Engl J Med 356:2445–2448
Anonymous (2008) Erythropoietin analogues: an unnecessary class of drugs. Lancet Oncol 9:81
Aapro MS, Birgegård G, Bokemeyet C et al (2008) Erythropoietins should be used according to guidelines. Lancet Oncol 9:412–413
Tonelli M, Hemmelgarn B, Reiman T et al (2009) Benefits and harms of erythropoiesis-stimulating agents for anemia related to cancer: a meta-analysis. Can Med Assoc J 180(11):E62–E71. doi:10.1503/cmaj.090470
Bohlius J, Schmidlin K, Brillant C et al (2009) Recombinant human erythropoiesis-stimulating agents and mortality in patients with cancer: a meta-analysis of randomised trials. Lancet 373:1532–1542
Acknowledgments
This study was supported by grants from F. Hoffmann-La Roche AG. The authors thank Matthew Abraham for the editorial and proofreading support.
Disclosures
Section I: Contributions to the Project
Project concept—methodological aspects and study paradigm: I. Abraham, K. MacDonald, M. Turner.
Project concept—application to oncology: M. Aapro, P. Soubeyran, M. Turner, H. Warrinnier.
Project concept—application to evidence-based medicine: J. Van Erps, M. Aapro, P. Soubeyran, M. Turner, K. MacDonald, T. Albrecht, I. Abraham.
Study design: I. Abraham, M. Aapro, K. MacDonald, M. Turner, H. Warrinnier.
Supervision of study implementation: K. MacDonald, I. Abraham, M. Turner, T. Albrecht, H. Warrinnier.
Quality assurance: K. MacDonald, T. Albrecht, I. Abraham.
Statistical plan: I. Abraham.
Manuscript preparation: I. Abraham.
Critical review of manuscript for intellectual content: J. Van Erps, M. Aapro, P. Soubeyran, M. Turner, K. MacDonald, T. Albrecht, I Abraham.
Section II: Conflict of Interest
J. Van Erps has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche and Novartis. She declares no conflict with regard to the work described in this manuscript.
M. Aapro has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche, Amgen, and Novartis. He declares no conflict of interest with regard to the work described in this manuscript.
I. Abraham and K. MacDonald have consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies and, as applicable, their subsidiaries: Novartis (including Novartis Oncology and Sandoz), Johnson & Johnson (including Centocor, Ortho-Biotech, Janssen Pharmaceutica, Janssen-Cilag, and Janssen-Ortho), Eli Lilly, Roche, Pfizer, Amgen, Merck, Bristol-Meyers Squibb, Schering-Plough, Astra-Zeneca, Bayer, GlaxoSmithKline, Lundbeck, and Innogenetics (including Xcellentis). Matrix45 has been contracted by sponsor to provide support and project conceptualization, project design, protocol development, development of project materials, training, project management and implementation, development of statistical plan, and quality assurance. Matrix45 provides similar services to other pharmaceutical companies. T. Albrecht is a part-time employee of Matrix45. Per company policy, I. Abraham, K. MacDonald, and T. Albrecht are barred from holding equity in any client companies and are subjected to internal and external review of their work to assure objectivity and transparency. They have taken the necessary steps to assure independence and do not declare a conflict of interest with regard to the work described in this manuscript.
P. Soubeyran has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche, Amgen, Johnson & Johnson, Sanofi-Aventis, Schering AG, Schering-Plough, Pfizer, Chugai, and Baxter Oncology. He declares no conflict with regard to the work described in this manuscript.
M. Turner and Hans Warrinnier are employees of F. Hoffmann-La Roche and its subsidiaries. They have refrained from undue influence throughout the project and manuscript preparation.
Section III: Sponsor and Role of Sponsor
Sponsor: F. Hoffman-La Roche AG (Basel, Switzerland) and its subsidiaries provided financial support for the project. The sponsor has also committed internal resources to support the project.
Role or the sponsor: The study paradigm was developed independently and proposed to sponsor by I. Abraham and K. MacDonald. The application to cancer-related anemia was identified by the sponsor. The independent oncology experts (J. Van Erps, M. Aapro, and P. Soubeyran) were proposed by the sponsor. Collectively, the authors constituted the project team; employees of F. Hoffmann-La Roche AG and its subsidiaries listed as authors participated as members of the team. The manuscript was developed by members of the research team not affiliated with the sponsor. The sponsor had the right of review and comment. All final decisions regarding the content of the manuscript were made by the external members of the team. See also Section 1 supra.
Section IV: Role of the Medical Writer or Editor
No medical writer or editor was retained in the preparation of this manuscript. M. Abraham provided proofreading support and was funded under the manuscript preparation subcontract by the sponsor to Matrix45.
Author information
Authors and Affiliations
Corresponding author
Additional information
Author Matthew Turner has left F. Hoffmann-La Roche, but was employed by this company at the time of the study.
Rights and permissions
About this article
Cite this article
Van Erps, J., Aapro, M., MacDonald, K. et al. Promoting evidence-based management of anemia in cancer patients: concurrent and discriminant validity of RESPOND, a web-based clinical guidance system based on the EORTC guidelines for supportive care in cancer. Support Care Cancer 18, 847–858 (2010). https://doi.org/10.1007/s00520-009-0718-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00520-009-0718-z