Content validation of the EORTC QLQ-BN20+2 with patients and health care professionals to assess quality of life in brain metastases
- 806 Downloads
- 2 Citations
Abstract
Objective
The validated EORTC quality of life (QOL) questionnaire QLQ-BN20 is a cancer subtype-specific supplement to the QLQ-C30 general QOL questionnaire for patients with primary brain neoplasms. The QLQ-C15-PAL core palliative questionnaire is an abbreviated version of the QLQ-C30 designed to decrease patient burden. We conducted content validation of the QLQ-BN20+2 for patients with brain metastases.
Methods and materials
Patients undergoing treatment for brain metastases, along with health care professionals (HCPs) completed the QLQ-C15-PAL and QLQ-BN20+2 questionnaires. A structured interview followed to assess for any difficulties with the QLQ-BN20+2, irrelevant items, and whether additional pertinent items should be included.
Results
Seventy-four patients and 71 HCPs participated. The majority of patients (84 %) were treated with whole-brain radiotherapy only. Over 50 % of patients felt that seizures, hair loss and trouble controlling bladder were not related to brain metastases. Questions regarding uncertainty about the future were the most difficult, although still a small proportion (12–16 %). All items were endorsed by over 50 % of HCPs as ‘quite’ or ‘very’ relevant to brain metastases patients, with two exceptions: 15 and 12 % of HCPs rated pruritis and future uncertainty as irrelevant, respectively.
Conclusion
We report the first content validation of the QLQ-BN20+2 and QLQ-C15-PAL QOL questionnaires for patients undergoing treatment for brain metastases, demonstrating feasibility and relevance. These questionnaires should be used together as universal QOL assessment tools in this setting.
Keywords
Brain metastases Palliative radiation Quality of life QLQ-BN20 QLQ-C15-PALIntroduction
Brain metastases are a cause of significant morbidity [1] and are a frequent complication of primary neoplasms such as lung, with over 50 % of patients eventually developing spread to the central nervous system [2]. Improvements in the sensitivity of imaging modalities along with more frequent screening may result in the earlier diagnosis of smaller and/or fewer brain metastases. Overall, the incidence of brain metastases is increasing [3] leading to a greater number of patients undergoing various treatments.
Potential neurological symptoms arising from brain metastases include headache, focal weakness, mental disturbances and ataxia. Additionally, nearly 65 % of patients display some form of cognitive impairment [4, 5]. Symptoms may also arise from the treatment of brain metastases.
Whole-brain radiotherapy (WBRT) has long been the standard approach, with the aim of alleviating or reducing neurological symptoms and decreasing the need for long-term corticosteroids. Treatment options have evolved over the past few decades to include more aggressive approaches such as stereotactic radiosurgery or surgical resection and post-operative RT for certain subgroups of patients with favourable performance status [6]. Prognostic indices such as the Graded Prognostic Assessment identify patients who may benefit from more aggressive treatments [7]. However, even the most favourable prognosis group has a median survival of only 11 months versus 2.6 months in the group with worst prognosis [7]. Traditional endpoints such as survival should therefore not be the sole aim of treatment; quality of life (QOL) should also be evaluated [8].
Quality of life is a subjective, multidimensional construct that consists of physical and psychosocial factors [9]. To address the need for standardized assessment of QOL and symptoms in oncology, the European Organization for Research and Treatment of Cancer (EORTC) developed the quality of life core questionnaire (QLQ-C30) [10]. It is now one of the most frequently used measures of QOL in oncology clinical trials. Cancer subtype-specific QOL questionnaires have also been developed to supplement the general core questionnaire. One of these, the EORTC QLQ-BN20, was developed [11] and validated [12] in patients with primary brain tumours. The 15-question QLQ-C15-PAL core questionnaire was developed to decrease the burden of the longer QLQ-C30 on patients with advanced cancer [13].
Studies of patients with brain metastases continue to use the lengthy QLQ-C30 along with the QLQ-BN20 as there is no tool that has been validated specifically for use in this patient population [14, 15, 16, 17]. A previous study assessed QOL in patients with brain metastases prior to and after treatment by administering the QLQ-C15-PAL with the QLQ-BN20+2, a version of the QLQ-BN20 questionnaire with two additional questions to assess cognitive function [18].
The primary aim of this study was to conduct content validation of the EORTC QLQ-BN20+2 in patients with brain metastases and in health care professionals (HCPs) involved in the care of these patients.
Patients and methods
Patients and health care professionals
All patients were accrued between 2009 and 2011 from six centres in three countries (Canada, Cyprus and Spain). All research was conducted following approval from each institution’s research ethics board. Patients over the age of 18 years with histologically or radiographically documented single or multiple brain metastases were eligible. Demographics, primary cancer site, Karnofsky Performance Status (KPS) and current treatment were recorded. Patients who were not native speakers of the language of the questionnaires were excluded. All patients were administered the Mini Mental State Exam prior to enrolment, with a score greater than 23 indicating that the patient was cognitively competent to participate [19]. HCPs involved in the care of patients with brain metastases were accrued from Canada only. Gender, specialty and years of experience were recorded for HCPs.
Questionnaires
The QLQ-BN20+2 was developed by adding a two-item cognitive scale (concentration, memory) to the previously validated QLQ-BN20. Although these items are included in the QLQ-C30, they are not on the QLQ-C15-PAL. The 20 main questions include: 7 single-item symptom scales (headaches, seizures, drowsiness, hair loss, itchy skin, leg weakness and bladder control), along with 4 multi-item scales (future uncertainty, visual disorder, motor dysfunction and communication deficit). The QLQ-C15-PAL consists of 15 questions: 2 multi-item functional scales (physical and emotional functioning), 2 multi-item symptom scales (fatigue and pain), 5 single-item symptoms (nausea/vomiting, dyspnea, insomnia, appetite loss and constipation) and one item regarding overall QOL.
Validation procedure
Patients completed the QLQ-BN20+2 and the QLQ-C15-PAL, which were followed by individual structured interviews. The interview invited further comments regarding: (1) the particular experience to which the item referred (e.g. was this experience related to brain metastases?); (2) the wording of each item (e.g. was the item difficult to respond to, annoying, confusing or upsetting? how would you have asked this question?); (3) items that patients found irrelevant; and (4) additional issues relevant for the patient, but not included in this questionnaire.
A similar procedure was followed by HCPs who were asked to indicate, for each item on the QLQ-BN20+2, its perceived relevance (1 = not at all to 4 = very much). Relevancy was defined as a combination of the frequency with which a specific complaint occurs, and the degree of difficulty it causes. HCPs were also asked to indicate whether there were irrelevant items, and any additional issues not included in either questionnaire.
Statistical methods
Results were expressed as medians (ranges) for continuous variables as well as proportions for categorical variables. The ranking of most to least important items by HCPs was obtained by the frequency of the top five to ten items that were rated to be included in the QLQ-BN20+2. Figures were created to illustrate both the levels of importance for each item of the QLQ-BN20+2 and whether it should be included in the final question, for patients and HCP’s. All descriptive analyses were performed by Statistical Analysis Software (SAS version 9.2).
Results
Patient and health care professional characteristics
| Patient characteristics (N = 74) | |
|---|---|
| Country | N (%) |
| Canada | 39 (53 %) |
| Cyprus | 20 (27 %) |
| Spain | 15 (20 %) |
| Gender | |
| Female | 43 (58 %) |
| Male | 31 (42 %) |
| Age (years) | |
| Median (range) | 61 (32–86) |
| KPS | |
| Median (range) | 70 (30–100) |
| Primary cancer site | |
| Lung | 36 (49 %) |
| Breast | 16 (22 %) |
| Colorectal | 10 (14 %) |
| Melanoma | 2 (3 %) |
| Unknown | 2 (3 %) |
| Other | 8 (11 %) |
| Current treatment | |
| Whole-brain Radiation | 62 (84 %) |
| Chemotherapy | 6 (8 %) |
| Surgery + Radiation | 2 (3 %) |
| None | 4 (5 %) |
| Health care professional characteristics (N = 71) | |
| Gender | |
| Female | 39 (55 %) |
| Male | 16 (23 %) |
| Not specified | 16 (23 %) |
| Discipline | |
| Radiation Therapist | 25 (35 %) |
| Nurse | 15 (21 %) |
| Radiation Oncologist | 18 (26 %) |
| Medical Oncologist | 6 (8 %) |
| Social Worker | 4 (6 %) |
| Palliative Care Physician | 2 (3 %) |
| Neurosurgeon | 1 (2 %) |
| Years of experience | |
| Median (range) | 13 (1–32) |
Patient responses
Patient scores for each QLQ-BN20+2 item
Patient responses to whether they believe each QLQ-BN20+2 item is related to brain metastases
Although a small proportion of patients found each of the QLQ-BN20+2 items difficult to answer, there was no single question uniformly identified as upsetting, confusing, or annoying (Appendix I). The items presenting the most issues were: “Did you feel uncertain about the future?” (16 %); “Did you feel you had setbacks in your condition?” (12 %); and “Were you concerned about disruption of family life?” (16 %). However, nearly all stated that they would not change any of the 22 questions.
Only three patients stated that there were irrelevant items on the QLQ-BN20+2. Three sets of repetitive items were described by two patients (“Was your vision blurred?” and “Did you have difficulty reading because of your vision?”; “Did you have trouble with your coordination?” and “Did you feel unsteady on your feet?”; “Did you have trouble finding the right words to express yourself?” and “Did you have trouble communicating your thoughts?”). One patient felt that the question pertaining to hair loss was irrelevant to those not receiving WBRT. Ideas for additional issues not yet included in the questions included suggestions for additional questions regarding effects on family life; alternative therapy options; and whether patients felt they had received enough information.
Health care professional responses
Health care professional relevancy scores for QLQ-BN20+2 items
Health care professional responses to whether the QLQ-BN20+2 item should be included in the questionnaire
HCPs’ detailed responses to each question are summarized in Appendix II. For the future uncertainty items mentioned above that were suggested to be removed, most comments were that HCPs were “not sure why these questions were specific to brain metastases versus any palliative patient” (n = 8), and that these questions were “too subjective and situational dependent” (n = 3). Many HCPs also stated that the item pertaining to itching of the skin is “of minimal importance and is easy to treat” (n = 11). Additionally, there were questions deemed irrelevant because it had been covered in other questions throughout the questionnaire. The most common similar items included: “Did you feel you had setbacks in your condition?” and “Did your outlook on the future worsen?” (n = 4); “Did you have difficult reading because of your vision?” and “Did you have double visions?” or “Was your vision blurred?” (n = 4); “Did you have trouble finding the right words to express yourself?” and “Did you have difficulty speaking?” (n = 3); “Did you have trouble with your coordination?” and “Did you feel unsteady on your feet?” (n = 3).
Ranking of most to least important items by health care professionals
| Ranka | Item |
|---|---|
| 1 | Seizures |
| 2 | Headaches |
| 3 | Weakness on one side of the body |
| 4 | Difficulty speaking |
| Trouble communicating thoughts | |
| Difficulty remembering things | |
| 7 | Concerned about disruption in family life |
| 8 | Trouble with coordination |
| 9 | Feel unsteady on feet |
| 10 | Difficulty concentrating |
| 11 | Feel uncertain about the future |
| 12 | Trouble finding the right words to express themselves |
| Trouble controlling bladder | |
| 14 | Bothered by hair loss |
| Weakness of both legs | |
| 16 | Double vision |
| Difficulty reading because of vision | |
| 18 | Outlook on the future worsened |
| Feel drowsy during daytime | |
| 20 | Feel had setbacks in condition |
| Blurry vision | |
| 22 | Bothered by itchy skin |
Discussion
To the best of our knowledge, this is the first study to conduct content validation of the EORTC QLQ-BN20+2 for use in brain metastases patients, for which there is currently no widely accepted tool. A review of 14 brain metastases RT trials which evaluated QOL demonstrated a total of 23 different instruments used [20].
While the QLQ-BN20 has become one of the most commonly used QOL tools in brain metastases studies, along with the Functional Assessment of Cancer Therapy Brain subscale [21], a recent review of 13 studies using the QLQ-BN20 and QLQ-C30 reveals challenges with compliance and attrition at follow-up assessments [22]. The QLQ-BN20 has been used to assess QOL in lung cancer patients undergoing prophylactic cranial irradiation [23]. Conducting content validation aims to demonstrate the subjective validity of the questionnaire, as primary brain tumour patients may present with slightly different issues than brain metastases patients.
The use of the EORTC QLQ-BN20+2 with the QLQ-C15-PAL to assess QOL was first reported in 108 patients undergoing various treatments for brain metastases [19]. The questionnaires showed maintenance (no deterioration) of QOL and improvement in a few QOL scores, which was echoed by a study that used the QLQ-BN20 with the QLQ-C15-PAL to reduce patient burden [14]. It was suggested that these two questionnaires replace the use of the QLQ-BN20 and QLQ-C30 combination previously used in many brain metastases studies in order to decrease attrition rates. Future uncertainty was the most prominent symptom at baseline for these two studies. Our results also concurred with those results, with 77–79 % of patients reporting some level of future uncertainty. Validation of the QLQ-BN20+2 will facilitate comparison of QOL outcomes between trials using this tool.
For all 22 items on the QLQ-BN20+2, there were only three items (seizures, hair loss and incontinence) in which the majority of patients stated the issue was not related to their brain metastases. It is possible that patients rated ‘seizure’ as unrelated because they had not experienced a seizure. This is in contrast with HCP responses, as seizures were ranked the most important item to be included on the final questionnaire.
As in any QOL questionnaire that assesses psychological and physical symptoms, it is expected that some questions may be difficult to answer, upsetting, confusing, or annoying depending on the patient. There were a small number of patients with such reactions to each of the 22 items. The three items that assessed future uncertainty were the most difficult; however, only two patients stated that these questions should be removed. Many HCPs also rated two future uncertainty items as not being specific to this patient population.
Patients and HCPs had similar opinions in items perceived as irrelevant because they had been addressed in another question. HCPs felt that pruritus was of low priority for inclusion because it is of minimal importance and easy to treat, which is in accordance with the overall ranking of all 22 items. Only three patients stated items should be included: family life, alternative therapy options and satisfaction with information received. More HCPs (40 %) stated that there were additional issues not covered.
The current study is limited in that the structured interview may have been cumbersome for patients to complete, and therefore patients may have been too tired to provide complete input on irrelevant items or additional important issues that may be missing. Furthermore, as cognitively impaired patients were ineligible for this study, our results may be more applicable to patients who have relatively better functioning. The therapeutic benefits of various treatment options for patients with brain metastases are beginning to be supplemented with more QOL research.
Conclusion
The limited consensus on the method of QOL endpoint measurement in clinical trials of patients with brain metastases is a significant barrier to the identification of the most effective treatment option. As we have demonstrated, content validation of the EORTC QLQ-BN20+2 when used concurrently with the EORTC QLQ-C15-PAL for patients with brain metastases, these two QOL tools should be used in future clinical trials involving these patients.
Notes
Acknowledgements
We thank the generous support of Bratty Family Fund, Michael and Karyn Goldstein Cancer Research Fund, Joseph and Silvana Melara Cancer Research Fund and Ofelia Cancer Research Fund.
References
- 1.Larson DA, Rubenstein JL, McDermott MW (2008) Treatment of metastatic cancer section 1: Metastatic cancer to the brain. In: CANCER: Principles & practice of oncology, 8th edn. Lippincott Williams & Wilkins, Philadelphia, pp 2461–2473Google Scholar
- 2.Lassman AB, DeAngelis LM (2003) Brain metastases. Neurol Clin 21:1–23PubMedCrossRefGoogle Scholar
- 3.Eichler AF, Loeffler JS (2007) Multidisciplinary management of brain metastases. Oncologist 12:884–898PubMedCrossRefGoogle Scholar
- 4.Chang EL, Wefel JS, Maor MH et al (2007) A pilot study of neurocognitive function in patients with one to three new brain metastases initially treated with stereotactic radiosurgery alone. Neurosurgery 60:277–283PubMedGoogle Scholar
- 5.Mehta MP, Rodrigus P, Terhaard CH et al (2003) Survival and neurologic outcomes in a randomized trial of motexafin gadolinium and whole-brain radiation therapy in brain metastases. J Clin Oncol 21:2529–2536PubMedCrossRefGoogle Scholar
- 6.Tsao MN, Lloyd N, Wong RKS, Chow E, Rakovitch E, Laperriere N (2006) Whole brain radiotherapy for the treatment of multiple brain metastases. Cochrane Database Syst Rev 3:CD003869PubMedGoogle Scholar
- 7.Sperduto PW, Berkey B, Gaspar LE et al (2008) A new prognostic index and comparison to three other indices for patients with brain metastases: an analysis of 1,960 patients in the RTOG database. Int J Radiat Oncol Biol Phys 70:510–514PubMedCrossRefGoogle Scholar
- 8.Kirkbride P, Tannock IF (2008) Trials in palliative treatment—have the goal posts been moved? Lancet Oncol 9:186–187PubMedCrossRefGoogle Scholar
- 9.Movsas B (2003) Quality of life in oncology trials: a clinical guide. Semin Radiat Oncol 13:235–247PubMedCrossRefGoogle Scholar
- 10.Aaronson NK, Ahmedzai S, Bergman B et al (1993) The european organization for research and treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85:365–376PubMedCrossRefGoogle Scholar
- 11.Osoba D, Aaronson NK, Muller M et al (1996) The development and psychometric validation of a brain cancer quality-of-life questionnaire for use in combination with general cancer-specific questionnaires. Qual Life Res 5:139–150PubMedCrossRefGoogle Scholar
- 12.Taphoorn MJ, Claassens L, Aaronson NK et al (2010) An international validation study of the EORTC brain cancer module (EORTC QLQ-BN20) for assessing health-related quality of life and symptoms in brain cancer patients. Eur J Cancer 46:1033–1040PubMedCrossRefGoogle Scholar
- 13.Groenvold M, Petersen MA, Aaronson NK et al (2006) The development of the EORTC QLQ-C15-PAL: a shortened questionnaire for cancer patients in palliative care. Eur J Cancer 42:55–64PubMedCrossRefGoogle Scholar
- 14.Steinmann D, Schafer C, van Oorschot B et al (2009) Effects of radiotherapy for brain metastases on quality of life (QoL)-prospective pilot study of the DEGRO QoL working party. Strahlenther Onkol 185:190–197PubMedCrossRefGoogle Scholar
- 15.Yaneva MP, Semerdjieva MA (2010) Assessment of the effect of palliative radiotherapy for cancer patients with intracranial metastases using EORTC-QOL-C30 questionnaire. Folia Med 48:23–29Google Scholar
- 16.Roos DE, Wirth A, Burmeister BH et al (2006) Whole brain irradiation following surgery or radiosurgery for solitary brain metastases: mature results of a prematurely closed randomized trans-Tasman radiation oncology group trial (TROG 98.05). Radiother Oncol 80:318–322PubMedCrossRefGoogle Scholar
- 17.Gerrard GE, Prestwich RJ, Edwards A et al (2003) Investigating the palliative efficacy of whole-brain radiotherapy for patients with multiple-brain metastases and poor prognostic features. Clin Oncol (R Coll Radiol) 15:422–428CrossRefGoogle Scholar
- 18.Caissie A, Nguyen J, Chen E et al (2011) Quality of life in patients with brain metastases using the EORTC QLQ-BN20+2 and QLQ-C15-PAL. Int J Radiat Oncol Biol Phys. doi: 10.1016/j.ijrobp.2011.09.025
- 19.Folstein M, Folstein SE, McHugh PR (1975) “Mini-Mental State” a practical method for grading the cognitive state of patients for the clinician. J Psych Res 12(3):189–198CrossRefGoogle Scholar
- 20.Wong J, Hird A, Kirou-Mauro A et al (2008) Quality of life in brain metastases radiation trials: a literature review. Curr Oncol 15:25–45PubMedCrossRefGoogle Scholar
- 21.Weitzner MA, Meyers CA, Gelke CK et al (1995) The functional assessment of cancer therapy (FACT) scale-development of a brain subscale and revalidation of the general version (FACT-G) in patients with primary brain tumors. Cancer 75:1151–1161PubMedCrossRefGoogle Scholar
- 22.Leung A, Lien K, Zeng L et al (2011) The EORTC QLQ-BN20 for assessment of quality of life in patients receiving treatment or prophylaxis for brain metastases: a literature review. Expert Rev Pharmacoecon Outcomes Res 11(6):693–700PubMedCrossRefGoogle Scholar
- 23.Slotman BJ, Mauer ME, Bottomley A et al (2009) Prophylactic cranial irradiation in extensive disease small-cell lung cancer: short-term health-related quality of life and patient reported symptoms: results of an international phase III randomized controlled trial by the EORTC radiation oncology and lung cancer groups. J Clin Oncol 27:78–84PubMedCrossRefGoogle Scholar



