Abstract
Purpose
Improved survival rates from cancer have increased the need to understand the health-related problems of cancer treatment. We aimed to develop and validate the “Cancer Survivor Core Set” representing the most relevant health-related problems in adult cancer survivors using the International Classification of Functioning, Disability, and Health (ICF).
Methods
First, a Delphi study was conducted to select ICF categories representing the most relevant health-related problems. There were three Dutch expert panels, one each for lung, colorectal, and breast cancer. Each panel comprised lay experts and professionals. The experts reached within- and between-panel consensus in two rounds (≥70 % agreement). Second, a validation study was performed. Generic cancer survivorship questionnaires assessing health-related problems or quality of life among cancer survivors were selected. Items of selected questionnaires were linked to the best-fitting ICF category and to the selected ICF categories from the Delphi study, respectively.
Results
In total, 101 experts were included, of which 76 participated in both rounds, reaching consensus on 18 ICF categories. The Distress Thermometer and Problem List, the Impact of Cancer (v2), and the Quality of Life in Adult Cancer Survivors questionnaires were selected for the validation study, which led to the inclusion of one additional ICF category.
Conclusions
The developed Cancer Survivor Core Set consisted of 19 ICF categories representing the most relevant health-related problems in adult cancer survivors: five from the “body functions and structures” component, eight from the “activities and participation” component, and six from the “environmental factors” component.
Highlights
• Many adult cancer survivors have persistent health-related problems.
• The Cancer Survivor Core Set was developed using the Delphi method.
• The patients’ perspectives were prioritized in this Delphi study
• Content validity was confirmed by validated cancer survivorship questionnaires.
• The Cancer Survivor Core Set may help optimize care for cancer survivors.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Earlier detection of malignant conditions, improved diagnostics, and new treatment modalities mean that the number of adult cancer survivors has increased substantially in most Western countries and is estimated to rise further in the near future [1–3].
Thus, the long-term effects of a cancer diagnosis are important to both research and clinical practice. Primary health-related problems include those related to the malignancy itself, the surgical treatment, and the toxicity of adjuvant therapy [4, 5]. Moreover, psychosocial symptoms are reported, such as fear of recurrence, disturbance of self-image, anxiety, depression, difficulties with return to work, and financial concerns [6–8].
It is important to understand and address the problems affecting adult cancer survivors [5, 9]. Therefore, screening instruments have been developed for specific health-related domains (e.g., health worries or body image concerns [10]) or subgroups of cancer survivors (e.g., prostate cancer survivors [11]). One such tool, the World Health Organization International Classification of Functioning, Disability, and Health (ICF), is a globally accepted classification that broadly represents human functioning, in a unified language. However, the ICF is cumbersome for use in daily practice, and derivatives have been developed for specific patient populations. These “core sets” list the ICF categories for specific conditions (e.g., breast cancer [12]) or settings (e.g., rehabilitation [13]).
To date, no core set has been established for the health-related problems of adult cancer survivors in general. Thus, we aimed to develop and validate the Cancer Survivor Core Set covering the most relevant health-related problems faced by cancer survivors.
Methods
Study design
To develop the Cancer Survivor Core Set, we performed a Delphi study [14] followed by a validation study [15]. In the Delphi study, we aimed to achieve consensus on the most relevant ICF categories for cancer survivors [16, 17] while prioritizing the patients’ perspective. In the validation study, we then assessed the content validity of the ICF categories using a linking procedure.
Delphi study
Composition of the expert panels
We defined adult cancer survivors as adults aged 18 years and over who had survived more than 1 year after diagnosis [18]. Panels were formed for lung, colorectal, and breast cancers. These cancers were selected based on current and projected rates of survivors adversely affected by health-related problems [19]; indeed, large increases in the numbers of survivors are anticipated [20].
There was a minimum of 25 survivorship experts per panel, with balanced proportions for three subpanels: experts by experience (lay experts), medical experts, and other healthcare workers (nine subpanels in total). We aimed to include lay experts who were able to reflect on the relevance of the ICF categories in adult cancer survivors based on more than their personal disease experience (a transcending view). Lay experts were selected through consultation with and advice from patient associations in the Netherlands.
Medical experts and other healthcare workers were selected through healthcare (or healthcare affiliated) organizations. Medical experts could be physicians or nurse practitioners. A physician could either be a medical oncologist, a surgical oncologist, a plastic surgeon, a radiation oncologist, or a radiologist. All healthcare workers had to be directly involved in the treatment of oncology patients or survivors. We invited potential experts to participate in the study by telephone or e-mail, and they provided written information. When lay experts judged themselves as being unable to have a transcending view, they were excluded from participation. Experts who provided informed consent were included in the Delphi study. According to our institutional review board, no approval was needed because this was a noninvasive study and not subject to the Dutch Medical Research Involving Human Subjects Act.
ICF categories
All ICF categories were divided into three components: “body functions and structures,” “activities and participation,” and “environmental factors.” The body functions and structures component covers functioning at the body level, while the activities and participation component covers an individual’s functioning. Environmental factors are factors possibly influencing functioning as either facilitators or barriers [21]. Each ICF component is further subdivided into three levels for more detail.
Delphi procedure
All 265 second-level ICF categories were used for item selection to avoid selection bias. ICF categories related to the body functions and structures component were only sent to the expert medical subpanels, because adequate evaluation required specific medical knowledge. Based on guidelines [17] and similar studies [22, 23], the Delphi study was required to consist of at least two rounds for consensus to exist.
During the first round, experts received the ICF categories with the corresponding description for coding, definition, inclusion, and exclusion. Experts were asked to evaluate the relevance of each ICF category (expressed by severity and/or frequency of a problem) for their cancer type. Response options were as follows: “not relevant” (score 1), “hardly relevant” (score 2), “somewhat relevant” (score 3), “relevant” (score 4), “very relevant” (score 5), and “I cannot judge this ICF category” (score 0). Items selected in the first-round analysis were presented to each panel in a second round, when experts were asked to evaluate whether they agreed with inclusion or exclusion of ICF categories (see “Data analysis” section). Experts did not meet face-to-face, and they completed their assessments independently, either online or on paper. Participation could be refused at any point, and nonresponders received two reminders.
Data analysis
Data analysis was performed using IBM SPSS version 20.0 (IBM Corp., Armonk, NY, USA). The median scores, response frequencies, and percentages of panel responses were calculated per ICF category. Several analyses were performed after the first round to determine which ICF categories to include in the second round:
-
1.
Median scores per subpanel (lay experts, medical experts, other healthcare workers) were calculated for each ICF category.
-
2.
Median scores per panel (lung, colorectal, breast) were calculated for each ICF category. When the lay expert subpanel rated an ICF category as more relevant than the overall panel, the median score was adjusted to that of the lay expert subpanel.
-
3.
An ICF category was included in the second Delphi round as a very relevant category if the median score of at least one of the three cancer panels was scored 5 and the score in the other two panels was ≥3.
-
4.
An ICF category was included in the second Delphi round as a relevant category if the median score of at least one of the three cancer panels scored 4, the other panels evaluated the ICF category with a score ≥3, and no panel gave a score of 1.
After the second round, the content validity index (CVI) was assessed for each ICF category. This index is the proportion of respondents agreeing with the proposed relevance of the ICF categories [24]. If the subpanel of lay experts scored a higher CVI compared to others in their panel, the percentage was adjusted to the highest percentage. ICF categories scoring a CVI ≥0.70 in all cancer panels were included in the initial Cancer Survivor Core Set.
Validation study
Questionnaire selection
To detect cancer survivorship questionnaires that are widely used and sufficiently validated, a semistructured literature review was performed in a single database using a limited number of search terms and strings. Eligible questionnaires were retrieved from the PubMed database (2000–2015) using MeSH terms in the search strings including the following: ((“Survivors” [MeSH]) AND “Neoplasms” [MeSH]) AND “Surveys and Questionnaires” [MeSH]. We selected questionnaires that were developed by patient involvement at some stage. In addition, questionnaires were required to be (1) generic for cancer survivors; (2) assessing health-related problems or quality of life; (3) available online and in English; (4) have sufficient psychometric properties, illustrated by at least two validation studies; and (5) have demonstrated sufficient clinical utility in at least one study describing the use of the questionnaire in a cohort of cancer survivors. All eligible questionnaires were screened using these inclusion criteria.
Linking procedure
Two researchers with experience in oncology and working with the ICF (OG and KW) independently performed the linking procedure, according to the updated ICF linking rules [25]. Both researchers linked the items of the selected questionnaires to the most closely matching ICF category. Any discrepancies were discussed until consensus was reached, and a third independent researcher (AJB) was consulted if disagreements could not be resolved.
Items within questionnaires measuring positive changes after diagnosis (e.g., Having had cancer has made me more willing to help others) were excluded from the linking procedure, because the aim was to select health-related problems. The remaining questionnaire items could either be linked to an ICF category in the initial Core Set, be linked to an ICF category not in the initial Core Set (i.e., a newly identified ICF category), or not be linkable to any ICF category. It was possible to link more than one item to the same ICF category. If a new ICF category was identified on all questionnaires, it was added to the final version of the Cancer Survivor Core Set.
Results
Delphi procedure
Expert panels
In total, 441 potential experts were contacted, 101 of whom confirmed their expertise. Experts were evenly distributed across the panels and subpanels (Table 1). All experts completed the first round, and 76 experts (75 %) completed the second round assessment.
ICF category sampling
The results of the ICF category selection process throughout the Delphi procedure are detailed in Table 2. After the first Delphi round, 21 ICF categories were evaluated as very relevant and 140 ICF categories were evaluated as relevant. In the second Delphi round, all selected ICF categories from the body functions and structures component were included, but two ICF categories from the activities and participation component (d410 Changing basic body position; d530 Toileting) and one ICF category from the environmental factors component (e420 Individual attitudes of friends) were eliminated. Participants agreed not to include any of the 140 ICF categories categorized as relevant in the second Delphi round. Due to the high level of consensus, there was no need for a third Delphi round. Thus, the initial Cancer Survivor Core Set comprised 18 ICF categories, of which 10 (56 %) were added by the lay expert subpanels.
Validation study
Selected questionnaires
In total, 15 questionnaires (Supplementary Table A) were retrieved, of which three met the inclusion criteria: the Quality of Life in Adult Cancer Survivors (QLACS) [10], the Dutch version of the Distress Thermometer and Problem List (DT/PL) [26, 27], and the Impact of Cancer version 2 (IOCv2) [28] (Table 3). These three questionnaires each included 47 items. After exclusion of the positive items, we subjected 116 items to the linking procedure (39 items of the QLACS, 47 items of the DT/PL, and 30 items of the IOCv2).
Items linkable to the ICF categories in the initial Core Set
It was possible to link 70 items to ICF categories in the initial Core Set. We linked 32 items from the QLACS and 15 items from the DT/PL to eight ICF categories and 23 items from the IOCv2 to six ICF categories (Table 4).
Newly identified ICF categories
In total, 43 items were linked to 26 newly identified ICF categories: 6 items from the QLACS, 31 items from the DT/PL, and 6 items from the IOCv2. One new ICF category—b130 Energy and drive functions—was identified in each questionnaire and added to the initial Core Set. Another three ICF categories were identified in two questionnaires (b126 Temperament and personality functions, b144 Memory Functions, and d845 Acquiring, keeping, and terminating a job) but were not added to the core set. The remaining 22 ICF categories were identified by 25 items from the DT/PL and were excluded from further linking (Supplementary Table B).
Nonlinkable items
Three items (one per questionnaire) were not linkable to ICF categories. The items from the QLACS and DT/PL questionnaires focused on body image in cancer survivors, and the IOCv2 item involved an enumeration of related ongoing cancer- and treatment-related symptoms.
Unidentified ICF categories
Seven ICF categories from the initial Core Set were not covered by any of the questionnaire items: three from the activities and participation component and four from the environmental factors component (Table 4).
Final Cancer Survivor Core Set
The final version of the Cancer Survivor Core Set consisted of 19 ICF categories: 5 (26 %) from the body functions and structures component, 8 (42 %) from the activities and participation component, and 6 (32 %) from the environmental factors component.
Discussion
In the current study, we aimed to develop and validate a core set representing the most relevant health-related problems of adults surviving cancer for more than 1 year after diagnosis. This led to the creation of the Cancer Survivor Core Set, consisting of 19 ICF categories.
To the best of our knowledge, no other study has used the ICF to develop a core set generic for cancer survivors. The selected ICF categories in our core set represent the most relevant health-related problems of cancer survivors from a broad perspective. Moreover, we explicitly prioritized the patients’ perspective, which resulted in the addition of several ICF categories in the Delphi study. Although we realize that the cancer survivorship experience most likely consists of a balance between positive and negative impacts, we have decided to only identify the health-related problems in cancer survivors in the current study since we felt that these may significantly hamper a persons’ functioning and require adequate attention from healthcare providers.
Only one ICF category was added to the core set in the validation study, indicating that the experts selected a credible sample of health-related problems experienced by cancer survivors. In addition, it was possible to link 70 questionnaire items to the initial Core Set, further supporting this notion. In contrast, the fact that seven ICF categories in the initial Core Set were not covered by existing questionnaire items may indicate that important issues of cancer survivorship are not always identified by current questionnaires.
Compared with earlier studies in which core sets were developed, we selected a considerably smaller number of ICF categories [12, 22, 23, 29]. A possible reason for this is that we aimed to identify the most relevant ICF categories for a broad yet concise reflection of relevant health problems. Consequently, we applied strict inclusion criteria for ICF categories to be eligible for inclusion in our core set. Moreover, the ICF categories were selected from the second level of detail (e.g., B152 Emotional problems), making them primarily relevant for identification. In clinical practice, further elaboration of an identified health-related problem will likely be needed.
A strength of this study is that we did not preselect ICF categories. Moreover, we included a large, varied panel of experts, strengthening the validity of our results. The fact that written assessments were completed independently and anonymously ensured that experts could not influence each other [17]. The experts achieved a high level of consensus during the Delphi procedure by the second round. Because of this high level of consensus, there was no need for a third round.
A potential limitation is the dropout rate between Delphi rounds (25 %), which was unexpected and higher than that in similar studies [22, 23, 30, 31]. A possible explanation is that some experts, mainly lay experts, regarded the language in the ICF as too formal. However, we provided each ICF category with the ICF definition and the inclusion and exclusion criteria. In addition, we believe that this loss of experts did not affect the overall diversity and proportions within and between the cancer panels in the second round.
Another limitation is that our choice of panels may preclude generalizability to other cancers. However, limitation to the three cancers was based on expected prevalence rates and likely similarities in disease course [19].
In conclusion, with the continued growth in the number of adult cancer survivors, the Cancer Survivor Core Set offers a valid yet concise reflection of the most relevant health-related problems in a general population of cancer survivors. However, although our results are promising, future studies are needed to confirm the generalizability of the Cancer Survivor Core Set in other settings and groups. The core set may be operationalized into a screening instrument to assess persistent health-related problems. Hereafter, targeted interventions may contribute to optimal and integrated care for adult cancer survivors.
References
Berrino F, Verdecchia A, Lutz JM, Lombardo C, Micheli A, Capocaccia R (2009) Comparative cancer survival information in Europe. Eur J Cancer 45:901–908. doi:10.1016/j.ejca.2009.01.018
Maddams J, Utley M, Møller H (2012) Projections of cancer prevalence in the United Kingdom, 2010-2040. Br J Cancer 107:1195–1202. doi:10.1038/bjc.2012.366
Edwards BK, Noone AM, Mariotto AB, Simard EP, Boscoe FP, Henley SJ et al (2014) Annual Report to the Nation on the status of cancer, 1975-2010, featuring prevalence of comorbidity and impact on survival among persons with lung, colorectal, breast, or prostate cancer. Cancer 120:1290–1314. doi:10.1002/cncr.28509
Harrington CB, Hansen JA, Moskowitz M, Todd BL, Feuerstein M (2010) It’s not over when it’s over: long-term symptoms in cancer survivors—a systematic review. Int J Psychiatry Med 40:163–181
Stein KD, Syrjala KL, Andrykowski MA (2008) Physical and psychological long-term and late effects of cancer. Cancer 112:2577–2592. doi:10.1002/cncr.23448
Stanton AL (2006) Psychosocial concerns and interventions for cancer survivors. J Clin Oncol 24:5132–5137. doi:10.1200/JCO.2006.06.8775
de Boer AGEM, Taskila T, Ojajärvi A, van Dijk FJH, Verbeek JHAM (2009) Cancer survivors and unemployment: a meta-analysis and meta-regression. JAMA 301:753–762. doi:10.1001/jama.2009.187
Ell K, Xie B, Wells A, Nedjat-Haiem F, Lee PJ, Vourlekis B (2008) Economic stress among low-income women with cancer: effects on quality of life. Cancer 112:616–625. doi:10.1002/cncr.23203
Howell D, Hack TF, Oliver TK, Chulak T, Mayo S, Aubin M et al (2012) Models of care for post-treatment follow-up of adult cancer survivors: a systematic review and quality appraisal of the evidence. J Cancer Surviv 6:359–371. doi:10.1007/s11764-012-0232-z
Avis NE, Smith KW, McGraw S, Smith RG, Petronis VM, Carver CS (2005) Assessing Quality of Life in Adult Cancer Survivors (QLACS). Qual Life Res 14:1007–1023. doi:10.1007/s11136-004-2147-2
Dis FW, Mols F, Vingerhoets AJJM, Ferrell B, Poll-Franse LV (2006) A validation study of the Dutch version of the Quality of Life–Cancer Survivor (QOL-CS) questionnaire in a group of prostate cancer survivors. Qual Life Res 15:1607–1612. doi:10.1007/s11136-006-0015-y
Brach M, Cieza A, Stucki G, Füßl M, Cole A, Ellerin BE et al (2004) ICF Core Sets for breast cancer. J Rehabil Med 36:121–127. doi:10.1080/16501960410016811
Yen T-H, Lin L-F, Wei T-S, Chang K-H, Wang Y-H, Liou T-H (2014) Delphi-based assessment of fall-related risk factors in acute rehabilitation settings according to the International Classification of Functioning, Disability and Health. Arch Phys Med Rehabil 95:50–57. doi:10.1016/j.apmr.2013.09.006
Hsu C, Sandford B (2007) The Delphi technique: making sense of consensus. Pract Assess, Res Eval 12:1–8. doi:10.1016/S0169-2070(99)00018-7
Cieza A, Brockow T, Ewert T, Amman E, Kollerits B, Chatterji S et al (2002) Linking health-status measurements to the International Classification of Functioning, Disability and Health. J Rehabil Med 34:205–210. doi:10.1080/165019702760279189
Powell C (2003) The Delphi technique: myths and realities. Methodol Issues Nurs Res 41:376–382
Hasson F, Keeney S, McKenna H (2000) Research guidelines for the Delphi survey technique. J Adv Nurs 32:1008–1015. doi:10.1046/j.1365-2648.2000.t01-1-01567.x
Ganz PA (2011) The “three Ps” of cancer survivorship care. BMC Med 9:14. doi:10.1186/1741-7015-9-14
Hewitt M, Greenfield S, Stovall E (2006) From cancer patient to cancer survivor: lost in transition. Committee on cancer survivorship: improving care and quality of life national cancer policy board. Institute of Medicine and National Research Council of the National Academies Press, Washington, DC
DeSantis CE, Lin CC, Mariotto AB, Siegel RL, Stein KD, Kramer JL et al (2014) Cancer treatment and survivorship statistics, 2014. CA Cancer J Clin 64:252–271. doi:10.3322/caac.21235
World Health Organization (2002) Towards a common language for functioning , disability and health ICF. Int Classif 1149:1–22
Wynia K, Middel B, Van Dijk JP, De Ruiter H, Lok W, Ha De Keyser J et al (2006) Broadening the scope on health problems among the chronically neurologically ill with the International Classification of Functioning (ICF). Disabil Rehabil 28:1445–1454. doi:10.1080/09638280600638356
Spoorenberg SLW, Reijneveld SA, Middel B, Uittenbroek RJ, Kremer HPH, Wynia K (2015) The Geriatric ICF Core Set reflecting health-related problems in community-living older adults aged 75 years and older without dementia: development and validation. Disabil Rehabil 00:1–7. doi:10.3109/09638288.2015.1024337
Polit DF, Beck CT (2006) The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health 29:489–497. doi:10.1002/nur.20147
Cieza A, Geyh S, Chatterji S, Kostanjsek N, Üstün B, Stucki G (2005) ICF linking rules: an update based on lessons learned. J Rehabil Med 37:212–218. doi:10.1080/16501970510040263
Ma X, Zhang J, Zhong W, Shu C, Wang F, Wen J et al (2014) The diagnostic role of a short screening tool—the distress thermometer: a meta-analysis. Support Care Cancer 22:1741–1755. doi:10.1007/s00520-014-2143-1
Holland JC, Reznik I (2005) Pathways for psychosocial care of cancer survivors. Cancer 104:2624–2637. doi:10.1002/cncr.21252
Crespi CM, Ganz PA, Petersen L, Castillo A, Caan B (2008) Refinement and psychometric evaluation of the impact of cancer scale. J Natl Cancer Inst 100:1530–1541. doi:10.1093/jnci/djn340
Weigl M, Cieza A, Andersen C, Kollerits B, Amann E, Stucki G (2004) Identification of relevant ICF categories in patients with chronic health conditions: a Delphi exercise. J Rehabil Med (44 Suppl):12–21. doi:10.1080/16501960410015443
Gerritsen A, Jacobs M, Henselmans I, van Hattum J, Efficace F, Creemers G-J et al (2016) Developing a core set of patient-reported outcomes in pancreatic cancer: a Delphi survey. Eur J Cancer 57:68–77. doi:10.1016/j.ejca.2016.01.001
Hopman SMJ, Merks JHM, De Borgie CAJM, Aalfs CM, Biesecker LG, Cole T et al (2013) The development of a clinical screening instrument for tumour predisposition syndromes in childhood cancer patients. Eur J Cancer 49:3247–3254. doi:10.1016/j.ejca.2013.06.015
Acknowledgments
The authors would like to thank all the members of the expert panel in the Delphi study for their participation and dedication. We also thank Dr. Robert Sykes (www.doctored.org.uk) for providing editorial services.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Electronic supplementary material
Supplementary Table A
(DOCX 36 kb)
Supplementary Table B
(DOCX 35 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/), which permits any noncommercial use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Geerse, O., Wynia, K., Kruijer, M. et al. Health-related problems in adult cancer survivors: development and validation of the Cancer Survivor Core Set. Support Care Cancer 25, 567–574 (2017). https://doi.org/10.1007/s00520-016-3439-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00520-016-3439-0