Skip to main content

Advertisement

Log in

Promoting evidence-based management of anemia in cancer patients: concurrent and discriminant validity of RESPOND, a web-based clinical guidance system based on the EORTC guidelines for supportive care in cancer

  • Original Article
  • Published:
Supportive Care in Cancer Aims and scope Submit manuscript

Abstract

Goal of work

The goal of this study is to test the validity of RESPOND, a web-based decision support system to assess and manage anemia in cancer patients as per the European Organisation for Research and Treatment of Cancer (EORTC) guidelines. The intraclass correlation metrics for the algorithmic definitions were reported previously. Reported here are the concurrent validity, the extent to which clinicians' anemia management is guidelines-congruent when using the system; and discriminant validity, the extent to which clinicians practice in congruence with guidelines when vs. when not using the system.

Patients and methods

Hybrid matched design with precohort (retrospective; clinicians not using RESPOND) and postcohort (prospective; clinicians using RESPOND) of anemic patients matched on cancer type and chemotherapy regimen and followed up over 4 months after treatment initiation with erythropoietic proteins (34 patients per cohort; total N = 68). Congruence scores quantified the extent to which anemia management was congruent with the EORTC guidelines (range 0–10).

Main results

Hemoglobin (Hb) increased significantly for both cohorts, but the postcohort group showed more rapid rate of Hb increase over time (p < 0.006), higher Hb by visit 4 (p = 0.007), and greater Hb increase by visit 4 (p = 0.006). Concurrent validity was high with mean postcohort congruence scores of 8.18 ± 1.38. Discriminant validity was inferred from statistically significant differences in mean congruence scores between cohorts (p < 0.001) and from the postcohort having odds ratios of 3.64 for patients to reach Hb ≥ 11 g/dL and 2.91 to achieve Hb ≥ 12 g/dL.

Conclusions

RESPOND, a validated computerized clinical guidance system with an incremental effect beyond the pharmacotherapeutic effect of erythropoietic proteins, offers clinicians accurate and safe guidance in managing anemia in cancer patients.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Groopman JE, Itri LM (1999) Chemotherapy-induced anemia in adults: incidence and treatment. J Natl Cancer Inst 91:1616–1634

    Article  CAS  PubMed  Google Scholar 

  2. Ludwig H, Van Belle S, Barrett-Lee P et al (2004) The European Cancer Anemia Survey (ECAS): a large, multinational, prospective survey defining the prevalence, incidence, and treatment of anemia in cancer patients. Eur J Cancer 40:2293–2306

    Article  PubMed  Google Scholar 

  3. Blohmer JU, Dunst J, Harrison L et al (2005) Cancer-related anemia: biological findings, clinical implications and impact on quality of life. Oncology 68:S12–S21

    Article  Google Scholar 

  4. Caro JJ, Salas M, Ward A et al (2001) Anemia as an independent prognostic factor for survival in patients with cancer: a systemic, quantitative review. Cancer 91:2214–2221

    Article  CAS  PubMed  Google Scholar 

  5. Nissenson AR, Goodnough LT, Dubois RW (2003) Anemia: not just an innocent bystander? Arch Int Med 163:1400–1404

    Article  Google Scholar 

  6. Cella D (1998) Factors influencing quality of life in cancer patients: anemia and fatigue. Semin Oncol 25:S43–S46

    Google Scholar 

  7. Rizzo JD, Lichtin AE, Woolf SH et al (2002) Use of epoetin in patients with cancer: evidence-based clinical practice guidelines of the American Society of Clinical Oncology and the American Society of Hematology. J Clin Oncol 20:4083–4107

    Article  CAS  PubMed  Google Scholar 

  8. Rizzo JD, Somerfield MR, Hagerty KL et al (2008) Use of epoetin and darbepoetin in patients with cancer: 2007 American Society of Clinical Oncology/American Society of Hematology clinical practice guideline update. J Clin Oncol 26:132–149

    Article  CAS  PubMed  Google Scholar 

  9. Bokemeyer C, Aapro MS, Courdi A et al (2004) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer. Eur J Cancer 40:2201–2216

    Article  CAS  PubMed  Google Scholar 

  10. Bokemeyer C, Aapro MS, Courdi A et al (2007) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer: 2006 update. Eur J Cancer 43:258–270

    Article  CAS  PubMed  Google Scholar 

  11. Aapro MS, Link H (2008) September 2007 update on EORTC guidelines and anemia management with erythropoiesis-stimulating agents. Oncologist 13:33–36

    Article  CAS  PubMed  Google Scholar 

  12. Ludwig H, Aapro M, Bokemeyer C et al (2009) Treatment patterns and outcomes in the management of cancer-related anemia in Europe: findings from the Anemia Cancer Treatment (A.C.T.) study. Eur J Cancer. doi:10.1016/j.ejca.2009.02.003

    Google Scholar 

  13. Aapro M, Abraham I, MacDonald K et al (2007) Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care. Support Care Cancer 15:1325–1329

    Article  PubMed  Google Scholar 

  14. Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24:18–28

    Article  Google Scholar 

  15. Eddy DM (2005) Evidence-based medicine: a unified approach. Health Aff 24:9–17

    Article  Google Scholar 

  16. Olivotto A, Coldman AJ, Hislop TG (1997) Compliance with practice guidelines for node-negative breast cancer. J Clin Oncol 15:216–222

    CAS  PubMed  Google Scholar 

  17. Hébert-Croteau N, Brisson J, Latreille J et al (2004) Compliance with consensus recommendations for systemic therapy is associated with improved survival of women with node-negative breast cancer. J Clin Oncol 22:3685–3693

    Article  PubMed  Google Scholar 

  18. Mille D, Roy T, Carrere MO et al (2000) Economic impact of harmonizing medical practices: compliance with clinical practice guidelines in the follow-up of breast cancer in a French comprehensive cancer center. J Clin Oncol 18:1718–1724

    CAS  PubMed  Google Scholar 

  19. Cruse H, Winiark M, Marshburn J et al (2002) Quality and methods of developing practice guidelines. BMC Health Serv Res 2:1–7

    Article  PubMed  Google Scholar 

  20. Aapro M, Van Erps J, MacDonald K et al (2008) Promoting evidence-based management of anemia in cancer patients: background, development, and scientific validation of RESPOND, a web-based clinical guidance system based on the EORTC guidelines. Crit Rev Oncol Hematol 65:32–42

    Article  PubMed  Google Scholar 

  21. Smith TJ, Hillner BE (2001) Ensuring quality cancer care by the use of clinical practice guidelines and critical pathways. J Clin Oncol 19:2886–2897

    CAS  PubMed  Google Scholar 

  22. Bates DW, Kuperman GJ, Wang S et al (2003) Ten commandments for effective clinical decision making support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 10:523–530

    Article  PubMed  Google Scholar 

  23. Musen MA, Shahar Y, Shortliffe EH (2006) Clinical decision support systems. In: Shortliffe EH, Cimino JJ (eds) Biomedical informatics: computer applications in health care and biomedicine, 3rd edn. Springer, New York, pp 698–736

    Google Scholar 

  24. Kawamoto K, Houlihan CA, Balas EA et al (2005) Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Br Med J 330:775–782

    Article  Google Scholar 

  25. Aapro M, MacDonald K, Van Erps J et al (2009) Managing cancer-related anemia in congruence with the EORTC guidelines is an independent predictor of hemoglobin outcome: initial evidence from the RESPOND study. Eur J Cancer 45:8–11

    Article  PubMed  Google Scholar 

  26. Khuri FR (2007) Weighing the hazards of erythropoiesis stimulation in patients with cancer. N Engl J Med 356:2445–2448

    Article  CAS  PubMed  Google Scholar 

  27. Anonymous (2008) Erythropoietin analogues: an unnecessary class of drugs. Lancet Oncol 9:81

    Article  Google Scholar 

  28. Aapro MS, Birgegård G, Bokemeyet C et al (2008) Erythropoietins should be used according to guidelines. Lancet Oncol 9:412–413

    Article  PubMed  Google Scholar 

  29. Tonelli M, Hemmelgarn B, Reiman T et al (2009) Benefits and harms of erythropoiesis-stimulating agents for anemia related to cancer: a meta-analysis. Can Med Assoc J 180(11):E62–E71. doi:10.1503/cmaj.090470

    Article  Google Scholar 

  30. Bohlius J, Schmidlin K, Brillant C et al (2009) Recombinant human erythropoiesis-stimulating agents and mortality in patients with cancer: a meta-analysis of randomised trials. Lancet 373:1532–1542

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

This study was supported by grants from F. Hoffmann-La Roche AG. The authors thank Matthew Abraham for the editorial and proofreading support.

Disclosures

Section I: Contributions to the Project

Project concept—methodological aspects and study paradigm: I. Abraham, K. MacDonald, M. Turner.

Project concept—application to oncology: M. Aapro, P. Soubeyran, M. Turner, H. Warrinnier.

Project concept—application to evidence-based medicine: J. Van Erps, M. Aapro, P. Soubeyran, M. Turner, K. MacDonald, T. Albrecht, I. Abraham.

Study design: I. Abraham, M. Aapro, K. MacDonald, M. Turner, H. Warrinnier.

Supervision of study implementation: K. MacDonald, I. Abraham, M. Turner, T. Albrecht, H. Warrinnier.

Quality assurance: K. MacDonald, T. Albrecht, I. Abraham.

Statistical plan: I. Abraham.

Manuscript preparation: I. Abraham.

Critical review of manuscript for intellectual content: J. Van Erps, M. Aapro, P. Soubeyran, M. Turner, K. MacDonald, T. Albrecht, I Abraham.

Section II: Conflict of Interest

J. Van Erps has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche and Novartis. She declares no conflict with regard to the work described in this manuscript.

M. Aapro has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche, Amgen, and Novartis. He declares no conflict of interest with regard to the work described in this manuscript.

I. Abraham and K. MacDonald have consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies and, as applicable, their subsidiaries: Novartis (including Novartis Oncology and Sandoz), Johnson & Johnson (including Centocor, Ortho-Biotech, Janssen Pharmaceutica, Janssen-Cilag, and Janssen-Ortho), Eli Lilly, Roche, Pfizer, Amgen, Merck, Bristol-Meyers Squibb, Schering-Plough, Astra-Zeneca, Bayer, GlaxoSmithKline, Lundbeck, and Innogenetics (including Xcellentis). Matrix45 has been contracted by sponsor to provide support and project conceptualization, project design, protocol development, development of project materials, training, project management and implementation, development of statistical plan, and quality assurance. Matrix45 provides similar services to other pharmaceutical companies. T. Albrecht is a part-time employee of Matrix45. Per company policy, I. Abraham, K. MacDonald, and T. Albrecht are barred from holding equity in any client companies and are subjected to internal and external review of their work to assure objectivity and transparency. They have taken the necessary steps to assure independence and do not declare a conflict of interest with regard to the work described in this manuscript.

P. Soubeyran has consulted with, received research grants and contracts from, and/or served as a sponsored speaker for the following companies: Roche, Amgen, Johnson & Johnson, Sanofi-Aventis, Schering AG, Schering-Plough, Pfizer, Chugai, and Baxter Oncology. He declares no conflict with regard to the work described in this manuscript.

M. Turner and Hans Warrinnier are employees of F. Hoffmann-La Roche and its subsidiaries. They have refrained from undue influence throughout the project and manuscript preparation.

Section III: Sponsor and Role of Sponsor

Sponsor: F. Hoffman-La Roche AG (Basel, Switzerland) and its subsidiaries provided financial support for the project. The sponsor has also committed internal resources to support the project.

Role or the sponsor: The study paradigm was developed independently and proposed to sponsor by I. Abraham and K. MacDonald. The application to cancer-related anemia was identified by the sponsor. The independent oncology experts (J. Van Erps, M. Aapro, and P. Soubeyran) were proposed by the sponsor. Collectively, the authors constituted the project team; employees of F. Hoffmann-La Roche AG and its subsidiaries listed as authors participated as members of the team. The manuscript was developed by members of the research team not affiliated with the sponsor. The sponsor had the right of review and comment. All final decisions regarding the content of the manuscript were made by the external members of the team. See also Section 1 supra.

Section IV: Role of the Medical Writer or Editor

No medical writer or editor was retained in the preparation of this manuscript. M. Abraham provided proofreading support and was funded under the manuscript preparation subcontract by the sponsor to Matrix45.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ivo Abraham.

Additional information

Author Matthew Turner has left F. Hoffmann-La Roche, but was employed by this company at the time of the study.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Van Erps, J., Aapro, M., MacDonald, K. et al. Promoting evidence-based management of anemia in cancer patients: concurrent and discriminant validity of RESPOND, a web-based clinical guidance system based on the EORTC guidelines for supportive care in cancer. Support Care Cancer 18, 847–858 (2010). https://doi.org/10.1007/s00520-009-0718-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00520-009-0718-z

Keywords

Navigation