Skip to main content
Download PDF

Methodology used to develop the AANS/CNS management of brain metastases evidence-based clinical practice parameter guidelines

Journal of Neuro-Oncology volume 96, pages 11–16 (2010)Cite this article

Background

Brain metastases, which occur in approximately 20–40% of individuals with systemic cancer, represent a significant cause of morbidity and mortality and overwhelm all other types of brain tumors in terms of incidence and public health impact [1]. Considerable research has focused on improving survival and quality of life for this patient population. Given the expanding knowledge base and the rapid emergence of new therapies, the American Association of Neurological Surgeons (AANS), the Congress of Neurological Surgeons (CNS), and the AANS/CNS Joint Tumor Section jointly funded an initiative to produce methodologically rigorous evidence-linked clinical practice parameter guidelines on this topic. The overall objective of this series of guideline papers is to provide the latest up-to-date evidence-based recommendations for the management of patients with brain metastases centering on eight questions related to commonly encountered clinical scenarios (Tables 1, 2, 3). Accomplishment of this goal required undertaking a systematic review of the literature.

Table 1 Guideline questions specifically addressing treatment of patients with newly diagnosed brain metastases
Full size table
Table 2 Guideline questions specifically addressing treatment of patients with recurrent and/or progressive brain metastases
Full size table
Table 3 Guideline questions addressing all patients with brain metastases
Full size table

The McMaster University Evidence-based Practice Center (EPC), which is an academic research unit partially funded by an EPC grant from the Agency for Healthcare Research and Quality (AHRQ), with specialized expertise in evidence-based medicine and the development of systematic reviews, was contracted to performed the systematic review in consultation with the guideline panel assembled for the initiative. The McMaster EPC also served as facilitators during the guideline development, consensus and writing processes.

The Joint Tumor Section of the AANS/CNS recruited representatives from surgical neuro-oncology (including microsurgical, stereotactic radiosurgery and experimental therapies), radiation oncology (fractionated radiotherapy, stereotactic radiosurgery and brachytherapy) and medical neuro-oncology (chemotherapy and experimental therapies) to form a multi-disciplinary panel of 17 clinical experts who developed the evidence-based practice guidelines from the systematic review results (Table 4). These seventeen experts across several disciplines were all nominated and selected by the Executive Committee of the AANS/CNS Tumor Section based on their clinical expertise and recognized contributions to the field of neuro-oncology in general and brain metastases in particular. The Tumor Section Executive Committee then selected a chairperson for this endeavor to organize and lead the effort, serving also to encourage and manage debate on the various topics involved.

Table 4 Management of brain metastases guideline panel
Full size table

Scope of the systematic review and clinical practice guidelines

The specific questions regarding the treatment of brain metastases addressed by the systematic review and the resulting practice guidelines were determined collaboratively by the clinical guideline panel and methodologists at the McMaster EPC. In total, eight questions were agreed upon and these correspond to the eight practice guideline papers in this series. Four of the questions specifically focus on the treatment of patients with newly diagnosed brain metastases (Table 1), one question addresses the treatment of recurrent/progressive metastatic brain disease (Table 2) and the remaining three questions are relevant to all patients with brain metastases (Table 3). Some of the questions had several parts.

For the purposes of the systematic review and the clinical practice guidelines, brain metastases have been defined as solid metastases to the brain from systemic cancer. The definition excludes leptomeningeal metastatic disease.

Literature search strategy

A broad literature search strategy was undertaken to identify all citations relevant to the management of brain metastases. The following electronic databases were searched from 1990 to September 2008: MEDLINE®, Embase®, Cochrane Database of Systematic Reviews, Cochrane Controlled Trials Registry, and Cochrane Database of Abstracts of Reviews of Effects. The search strategy used a combination of subheadings and text words. The specific search terms used for MEDLINE® are provided in Appendix A; this search strategy was modified accordingly for appropriate terms for each database searched. Reference lists of included studies were also screened for potentially relevant studies.

An additional electronic database search was conducted to identify randomized trials published from 1970 forward that evaluated different dose/fractionation schedules of whole-brain radiation for the treatment of brain metastases. This was done to capture seminal studies in this area known to have been undertaken in this earlier time frame. The initial electronic search commenced at 1990 given the lack of any known comparative data for radiation, surgical resection and radiosurgery prior to this date, although additional searches were conducted as far back as 1970 as outlined above.

Conference proceedings from the 2006–2008 meetings of the AANS, CNS, Society for NeuroOncology (SNO), American Society for Therapeutic Radiation and Oncology (ASTRO), American Society for Clinical Oncology (ASCO) and the AANS/CNS joint section on tumors satellite symposiums were searched for abstracts eligible for inclusion in the emerging and investigational therapies guideline question.

Study selection, quality assessment and statistical methods

The search of the bibliographic databases identified 16,966 possibly relevant citations. These citations were screened in duplicate using an online systematic review management system designed by TrialStat! (http://www.ESRNEXUS.com). Two independent reviewers evaluated titles and abstracts using a priori eligibility criteria in standardized forms. Cases of disagreement were resolved by a third reviewer. The same process was applied to full text screening of potentially relevant studies. Articles that met the eligibility criteria for one or more of the questions were grouped according to the questions they addressed. Reasons for exclusion were documented. The eligibility criteria for each of the eight questions are documented in the individual clinical practice guideline papers in this series.

Studies which met the eligibility criteria were data extracted by one reviewer and the extracted information was checked by a second reviewer. The PEDro scale [2, 3] was used to evaluate the methodological quality (internal validity) of randomized trials. The quality of comparative studies using non-randomized designs was evaluated using eight items selected and modified from existing scales (Appendix B).

Evidence and summary tables, reporting the extracted study information and quality assessment, were generated for all of the included studies for each of the eight questions. Meta-analyses were undertaken when sufficient data for pooling was available for the outcomes of interest. In only one of the eight guideline papers in this series was the criteria for pooling met. The specific details of the meta-analyses undertaken for this question are provided in the whole-brain radiation therapy (WBRT) guideline paper by Gaspar et al. [4].

Evidence classes and levels of recommendations endorsed by the AANS/CNS

Both the evidence classification and the strength of the recommendations were graded according to the criteria endorsed by the AANS/CNS (Table 5). The class of evidence assigned to each study was based on study design alone (i.e., class I, II, or III). The strength of the recommendations made (i.e., level 1, 2, or 3) took into account aspects of study quality, not just study design. Specifically, the level of a recommendation made could be decreased, based on consensus input, if there were methodological concerns regarding the studies that provided evidence for that particular recommendation.

Table 5 AANS/CNS evidence classes and levels of recommendation
Full size table

Guideline panel consensus and practice guideline approval process

Small writing groups composed of four to eight members of the clinical guideline panel were assigned to each of the eight questions, and each question had at least one member from each subspecialty as part of the initial writing team. Each group was provided with the included studies and the evidence/summary tables for their specific question, as well as an exhaustive statistical analysis, from the McMaster EPC team. Using this information, the small writing groups were responsible for drafting the clinical practice guideline for their respective questions. The draft guidelines were then circulated to the entire clinical guideline panel for feedback, discussion, and ultimately approval.

In accordance with the initial goal of a 1-year time horizon, the completed evidence-based clinical practice guidelines on the management of brain metastases were presented to the Joint Guidelines Committee (JGC) of the AANS/CNS for approval approximately 12 months after starting the evidence review process. As part of their approval process, the JGC could provide input on the content of the clinical practice guidelines. Once approved by the American Association of Neurological Surgeons and the Congress of Neurological Surgeons, the guidelines were also presented to the executive leadership of the Society for Neuro-oncology (SNO), the American Society for Radiation Oncology (ASTRO), in addition to the AANS/CNS Joint Tumor Section, to offer multidisciplinary review and endorsement with plans for online publication and dissemination in all of the various organized societies concerned with the treatment of brain metastases.

Development of this set of evidence-based clinical practice guidelines was editorially independent from the funding agencies. The funding agencies (AANS Board, CNS Executive Committee, and AANS/CNS Joint Tumor Section Executive Committee) review of these guideline papers, following JGC approval but prior to submission for publication, was limited to whether or not to endorse or reject this body of work. Figure 1 provides an outline of the key steps in the process of developing these clinical practice guidelines.

Fig. 1
figure 1

Overview of the guideline development process

Full size image

Plans for updating the guidelines

Searches of a clinical trial registry (clinicaltrials.gov) identified several on-going randomized trials that are evaluating treatment comparisons directly addressed by questions in this guideline series. The outcome of these trials will be monitored and updates to the relevant guidelines will be undertaken as new evidence develops and as clinical need indicates.

References

  1. Gavrilovic IT, Posner JB (2005) Brain metastases: epidemiology and pathophysiology. J Neurooncol 75(1):5–14

    Article  PubMed  Google Scholar 

  2. Centre for Evidence-Based Physiotherapy (2009) Physiotherapy evidence database (PEDro). http://www.pedro.org.au/. Accessed Jan 2009

  3. Maher CG, Sherrington C, Herbert RD, Moseley AM, Elkins M (2003) Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther 83(8):713–721

    PubMed  Google Scholar 

  4. Gaspar LE, Mehta MP, Patchell RA, Burri SH, Robinson PD, Morris RE et al (2009) The role of whole brain radiation therapy in the management of newly diagnosed brain metastases: a systematic review and evidence-based clinical practice guideline. J Neurooncol. doi:10.1007/s11060-009-0060-9

Download references

Acknowledgments

We would like to acknowledge the contributions of the McMaster Evidence-based Practice Center (EPC), Dr. Parminder Raina (Director). Dr. Lina Santaguida (Co-Associate Director, Senior Scientist) led the EPC staff. We would like to acknowledge the following EPC staff, Maureen Rice, Librarian, Rachel Morris, Research Assistant, and Mary Gauld, Senior Research Manager. The EPC staff were responsible for managing the systematic review process, searching for and retrieving, reviewing, data abstraction of all articles, preparation of the tables and the formatting and editing of the final manuscripts.

Disclaimer of liability

The information in these guidelines reflects the current state of knowledge at the time of completion. The presentations are designed to provide an accurate review of the subject matter covered. These guidelines are disseminated with the understanding that the recommendations by the authors and consultants who have collaborated in their development are not meant to replace the individualized care and treatment advice from a patient’s physician(s). If medical advice or assistance is required, the services of a competent physician should be sought. The proposals contained in these guidelines may not be suitable for use in all circumstances. The choice to implement any particular recommendation contained in these guidelines must be made by a managing physician in light of the situation in each particular patient and on the basis of existing resources.

Disclosures

All panel members provided full disclosure of conflicts of interest, if any, prior to establishing the recommendations contained within these guidelines.

Open Access

This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Author information

Authors and Affiliations

  1. McMaster University Evidence-based Practice Center, Hamilton, ON, Canada

    Paula D. Robinson & P. Lina Santaguida

  2. Department of Neurosurgery, Henry Ford Health System, 2799 West Grand Blvd, K-11, Detroit, MI, 48202, USA

    Steven N. Kalkanis

  3. Department of Neurosurgery, University of California-Irvine Medical Center, Orange, CA, USA

    Mark E. Linskey

Authors
  1. Paula D. Robinson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Steven N. Kalkanis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mark E. Linskey
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. P. Lina Santaguida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Steven N. Kalkanis.

Appendices

Appendix A: Medline search strategy

See Table 6.

Table 6  
Full size table

Appendix B: Quality assessment criteria

See Table 7.

Table 7  
Full size table

Rights and permissions

Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Reprints and Permissions

About this article

Cite this article

Robinson, P.D., Kalkanis, S.N., Linskey, M.E. et al. Methodology used to develop the AANS/CNS management of brain metastases evidence-based clinical practice parameter guidelines. J Neurooncol 96, 11–16 (2010). https://doi.org/10.1007/s11060-009-0059-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11060-009-0059-2

Keywords

  • Brain Metastasis
  • Clinical Practice Guideline
  • Guideline Paper
  • Systematic Review Result
  • Clinical Guideline Panel