Introduction

Pancreatic cancer (PC) is an important public health problem, as it has the highest incidence-to-mortality ratio of any solid tumour, and it represents 2.6% of total new cancer cases. It accounted for almost as many deaths as new cases in 2020 and represented the seventh leading cause of cancer death in both sexes worldwide [1].

Survival rates are significantly lower when diagnosed at an advanced stage, having a 5-year survival rate of 14.4% and 3% for regional and distant stages at diagnosis, respectively [2]. Therefore, patients with advanced PC have a high risk of dying in the short or medium term, which is conceptualised as the ‘end of life’ (EoL) period [3]. Deciding the most appropriate treatment for patients with advanced PC at the EoL should be based on the best available evidence and considering patient’s values and preferences, since failing to do so could increase patients’ psychological distress and the overutilisation of treatments that may be inconsistent with personal preferences [4, 5].

Therapies prescribed for PC are systemic oncological treatments (SOTs) such as chemotherapy, targeted/biological therapies, and immunotherapy. These treatments continue to be the preferred therapeutic approach for patients with advanced-stage PC since current clinical practice guidelines (CPGs) associate them with an improvement in survival outcomes [6,7,8]. Nevertheless, their usage is also associated with important side effects and toxicity [9].

On the other hand, a conservative strategy based on providing only the best supportive care (BSC) might constitute a valid therapeutic option. BSC constitutes a comprehensive approach focused on symptoms control and improvement of patients’ quality of life, usually involving multidisciplinary teams [10, 11]. Therefore, it represents a therapeutic option with lower toxicity, which is highly valued by patients [12, 13].

It is crucial to note that available CPGs’ recommendations are primarily based on the results of few experimental studies comparing SOTs with each other rather than with BSC, and on their modest survival-related outcomes differences. In contrast, our recent overview of systematic reviews (SRs) based on randomised clinical trials (RCTs) revealed contradictory results and a high uncertainty over the benefits of SOTs on overall survival when compared to BSC [14]. Furthermore, even though treatment decisions could profoundly affect patients’ quality of life, other important outcomes were rarely reported, such as toxicity, functional status, hospital admissions, symptoms, and quality of death [14].

Our overview presented an assessment of the evidence from SRs and, although comprehensive, included few SRs with a limited number of RCTs. Hence, it is key to complement these findings with other available primary studies, and thus get a clearer picture of the whole body of evidence regarding SOTs versus BSC for patients with advanced PC.

Scoping reviews and evidence maps provide a visual approach on the studies that have been conducted leading to the identification of areas that need further research (evidence gaps). Therefore, we developed a scoping review and evidence map to identify, describe, and organise the currently available evidence about the efficacy of SOTs (chemotherapy, biological/targeted therapies, and immunotherapy) compared to BSC for patients with advanced PC, considering all important patient-centred outcomes.

Methods

We conducted a comprehensive scoping review and evidence mapping [15], adhering to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist [16]. The protocol for this study was prospectively registered and is publicly available in Open Science Framework [17].

Eligibility criteria

We used the PICOT framework (Patients, Intervention, Comparison, Outcomes, Type of study) to guide our eligibility criteria [18].

Type of patients

We considered eligible studies including adult patients (over 18 years of age) with PC, primary or recurrent, in stage III or IV, or described as advanced or metastatic by the study authors at the moment of the intervention, as these stages represent the EoL period. We excluded pancreatic neuroendocrine cancers.

Type of interventions

For the intervention arm, we considered any SOT (chemotherapy, biological/targeted therapy, or immunotherapy), either individual or combined, with or without supportive care. We excluded studies that considered only surgery or radiotherapy as intervention, as well as studies that considered only chemotherapy as adjuvant or neoadjuvant therapy.

We considered as comparator any supportive treatment, administered with the purpose of symptomatic or palliative control. This includes either usual treatment or BSC [11]. Studies that did not explicitly define the intervention of the control group, or studies with placebo as control group, were also included. We excluded studies if the control group considered any type of SOT (chemotherapy, biological/targeted therapy, or immunotherapy). We also excluded comparisons comprehending an intervention with non-palliative intent, such as surgery or radiotherapy with curative intent.

Type of outcomes

We considered the following outcomes:

  • Overall survival: As a dichotomous outcome (at 3, 6, 9, 12, 24 months) and as a continuous or time to-event outcome.

  • Progression-free survival: As a dichotomous outcome (at 3, 6, 9, 12, 24 months) and as a continuous or time-to-event outcome.

  • Quality of life: Measured with validated scales.

  • Functional status: Measured with Karnofsky or ECOG scale.

  • Toxicity: Measured as moderate or severe adverse events, according to standardised classification.

  • Symptoms related to the disease: Measured with validated scales that assess one or more symptoms.

  • Admissions to hospital or long-term centre, or emergency consultations: Measured as the total number of admissions and days of admission during the follow-up period.

  • Quality of death:

    • Admission to hospital at the end-of-life: Admission to the hospital in the last 30 days of life.

    • Palliative care provided during the last year: As a dichotomous outcome.

    • Place of death: Home, institutionalised (health community centre or residence), hospitalised (intensive care or other).

Type of studies

We included SRs, RCTs, quasi-experimental studies, and observational studies assessing the impact of SOTs in advanced or metastatic PC. In the case of SRs, we considered only those published from 2008 onwards. We did not apply any language restrictions or publication date restrictions to primary studies.

We considered as a SR any type of secondary research that states: i) an explicit research question, ii) a structured search strategy (defined as explicit search terms and data frame, in at least two databases), iii) explicit inclusion criteria and screening methods, iv) an explicit assessment of the quality or risk of bias of each included study, and v) an explicit approach to data analysis and synthesis [18, 19]. We considered as a RCT any experimental primary study with a randomised allocation of interventions. We considered as quasi-experimental studies those with an inadequate randomisation process, or specific study designs with a non-random allocation of interventions, such as interrupted time series or before-after studies. We considered as observational studies all the case-control and cohort studies, as long as they were controlled and had, at least, 30 included patients.

We excluded descriptive studies, CPGs, case reports, and non-SRs (such as narrative reviews).

Search methods for identification of studies

We performed electronic searches in MEDLINE (access via PubMed), EMBASE (access via OVID), the Cochrane Database of Systematic Reviews, CENTRAL and Epistemonikos from inception until December 2, 2019. We designed search strings adapted to the requirements of each database that combined controlled vocabulary and search terms related to the main concepts of our clinical question. Since this study is part of a wider project, the search strategy included terms for pancreatic, hepatobiliary, and gastroesophageal cancer [17]. The search strategy for PubMed can be found in the online resource 1.

We also searched in PROSPERO and clinicaltrials.gov to identify protocols of potentially eligible studies. We asked experts in the field for relevant studies. We did not use any other strategy to search for grey literature.

Selection of studies

Two reviewers independently screened titles and abstracts of the retrieved search results. A third reviewer solved disagreements. Afterwards, two reviewers independently conducted the full-text screening, with a third author solving any disagreement. For all this process we used Covidence (www.covidence.org).

Data extraction

Two reviewers independently extracted data from the included studies, using a previously piloted data extraction sheet (Google Forms). For each included study, we extracted the following data: year of publication, country, study design, total number of studies included regarding our question (for SRs), total number of patients included (for primary studies), interventions (chemotherapy, biological/targeted therapy and/or immunotherapy), comparators (BSC, placebo, or non-specified), outcomes reported, direction of effect, defined according to its statistical significance as ‘favours intervention’, ‘favours comparison’, or ‘no differences’, and conflicts of interest.

Data synthesis and analysis

We described the results of our search in a tabular view, classifying each included study by type of intervention assessed, methodological design, reported outcomes and direction of the effect. We used evimappr [20], an R package, to produce the bubble plots for the evidence map. We presented an interactive visualisation display that includes the interventions (chemotherapy, biological/targeted therapy, immunotherapy) in rows, and the outcomes in columns. The grids were populated with the corresponding studies in each intersection, classified by study design (SR, RCT, quasi-experimental study or observational study). Due to space limits, if a column (i.e. outcome) did not contain any study for any intervention, this was not plotted within the interactive bubble plot. Thus, we showed a more detailed scheme in a complementary static figure where we identified evidence gaps as those spaces on the grid that did not contain studies.

Results

Study selection

Our search returned 50,601 records for all cancer locations (hepatobiliary, gastroesophageal and pancreatic) once duplicates were removed. After title and abstract screening, we excluded 47,667 references. Of the 2,934 references, we were not able to retrieve 106 reports. Therefore, we reviewed the full text of 2,828 articles. We included a total of 177 studies for all cancer locations, of which 43 included participants with PC. Of these, 2 were SRs, 16 RCTs, 4 quasi-experimental studies, 20 were observational studies, and 1 was a protocol for a quasi-experimental study. Figure 1 summarises the screening process.

Fig. 1
figure 1

PRISMA flowchart

Characteristics of the included studies

  1. 1.

    Chemotherapy

    36 studies published from 1979 to 2018, compared chemotherapy to either BSC (n = 24), or to an intervention not clearly specified (n = 12) for advanced PC. Among these, 34 were primary studies (11 RCTs, 3 quasi-experimental, and 20 observational) and included a number of participants that ranged from 31 to 303 for RCTs, 47 to 90 for quasi-experimental and 39 to 1085 for observational studies. We included two SRs with a total number of primary studies of 50 and 60, while the number of primary studies included in those SRs relevant to our question were six and nine (Table 1).

    The interventions assessed in primary studies included both monotherapy and combination therapy. Of those evaluating monotherapy, seven used gemcitabine, three fluorouracil, two S-1 and one glufosfamide. Combination therapies were 5-FU based (n = 9), gemcitabine–based (n = 3) and both 5-FU and gemcitabine-based (n = 5). Four studies did not specify the type of chemotherapeutic agent used. Both SRs assessed combination therapy. Most studies (64%) did not specify the line of therapy. Fifteen primary studies reported co-interventions, namely stents (n = 2), endoscopic procedures (n = 2), palliative surgery (n = 3), and radiotherapy (n = 8). One SR included radiotherapy and palliative surgery as co-interventions (Table 1).

    In addition to the 36 studies mentioned, we found one protocol for a quasi-experimental study that will compare gemcitabine-based chemotherapy to BSC (Table 1).

    Twenty-two (59.45%) of the studies did not report conflicts of interest. Of the 15 (40.54%) that did, 12 stated that there were no conflicts of interest to disclose (Table 1).

  2. 2.

    Immunotherapy

    Four studies published from 2010 to 2017, compared immunotherapy to either BSC (n = 2) or placebo (n = 2) for advanced PC. Among these, two were RCTs and two were quasi-experimental studies and included a number of participants that ranged from 47 to 154. All the studies assessed different immunotherapy agents, two as first line therapy and two did not specify the therapy line (Table 1).

    All studies reported their conflicts of interest, of which three (75%) stated that there were no conflicts of interest to disclose (Table 1).

  3. 3.

    Targeted/biological therapy

Table 1 Characteristics of included studies

Four studies published from 2013 to 2019 compared targeted or biological therapy to either placebo (n = 2) or to an intervention not clearly specified (n = 2) for advanced PC. Three were RCTs and one was an observational study and included a number of participants that ranged from 56 to 207.

Two studies evaluated erlotinib, one olaparib, and one sunitinib, all without specifying the line of therapy (Table 1).

All studies reported their conflicts of interest, of which one (25%) %) stated that there were no conflicts of interest to disclose (Table 1).

Figure 2 shows an overall summary of the evidence retrieved, classified by type of SOT administered, reported outcomes, and study design.

Fig. 2
figure 2

Evidence gap map of Systemic Oncological Treatments in patients with advanced pancreatic cancer

Outcomes

  1. 1.

    Chemotherapy

    All the 36 included studies reported survival-related outcomes, with most reporting an effect favouring the intervention [22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40, 42,43,44,45, 47, 48, 51, 54, 55]. Functional status was reported by four studies, including one SR [56], two RCTs [49, 51], one quasi-experimental design [41], with most showing no difference between both interventions, and only one RCT favouring the intervention [51]. Quality of life showed different results among the included studies, with a SR showing no difference [56], two RCTs favouring the intervention [47, 48], and one favouring the comparison [53]. Few RCTs reported toxicity [52, 54], symptoms [48, 52], and hospital admissions [51], and no study reported outcomes related to quality of death. Figure 3 provides a summary of the direction of the effect reported by each study for each outcome.

  2. 2.

    Immunotherapy

    All four included studies reported survival-related outcomes, with most reporting an effect favouring the intervention [43, 58, 59]. One RCT reported no differences between the interventions in functional status and results in favour of the control group for toxicity [59]. None of the studies reported symptoms related to the disease, quality of life, admissions to the hospital or quality of death (Fig. 3).

  3. 3.

    Targeted/biological therapy

Fig. 3
figure 3

Direction of the effects reported by each study for each outcome. OBS observational study; Q-Exp quasi-experimental study; RCT randomised clinical trial; SR systematic review; OS overall survival; PFS progression-free survival; m months; FS functional status; QoL quality of life; QoD quality of death; FI favours intervention (Systemic Oncological Treatment); ND no differences; FC favours comparison (Best Supportive Care/placebo/not specified); NR not reported. TGISG  The Gastrointestinal Study Group

Four studies reported overall survival, with three RCTs showing no difference [61,62,63] and one observational design favouring the intervention [35]. PFS was reported by the same three RCTs, with two favouring the intervention [61, 63] and one showing no difference [62]. Toxicity was reported in two RCTs, one favouring the control group [61], and one showing no difference [63]. Quality of life was reported by one RCT showing no differences between interventions [63]. None of the studies reported functional status, symptoms related to the disease, admissions to the hospital or quality of death (Fig. 3).

Discussion

Our scoping review offers a broad overview of the currently available evidence of primary and secondary studies on the effectiveness and safety of SOTs compared to BSC, placebo or no SOT for patients with advanced PC. The evidence map presents results from 42 studies, 40 of which were either observational (n = 20) or experimental studies (n = 20), and with most of them reporting survival outcomes favouring the use of SOTs. Few studies reported other outcomes, with most reporting no difference in terms of functional status, most reporting results in favour of BSC in terms of toxicity, and heterogeneous results in terms of quality of life. Symptoms related to the disease and hospital admissions were scarcely reported, and no study reported outcomes related to quality of death.

Our exhaustive search resulted in the inclusion of only 42 studies to answer our question. Most studies evaluated chemotherapy as the intervention, and a high proportion were conducted before the year 2000. This could be due to newer studies tending to assess the comparative effectiveness of two SOTs, rather than with BSC as a sole comparator [64, 65]. Moreover, some authors may even consider it unethical to conduct an experimental study with one arm receiving only BSC, since most guidelines recommend SOTs as the standard of care [66]. However, we consider that the trade-off between survival and other relevant outcomes, such as toxicity and quality of life, is not clear enough and could justify the conduction of RCTs comparing active treatment against supportive care in patients with advanced PC at the EoL.

Almost all observational studies reported results favouring SOT in terms of survival. In contrast, about half of the RCTs assessing chemotherapy or immunotherapy and all RCTs assessing biological/targeted therapies reported no difference for the same outcome. This difference may be explained by the higher risk of selection bias in the observational studies, since it was frequent that the patients’ initial clinical assessment determined the type of therapy prescribed. Additionally, we do not know the degree of exhaustiveness of the disclosure of conflicts of interest since it was not reported by the authors of over 50% of the studies. Therefore, it is difficult to examine the extent to which potential conflicts may be associated with findings favouring SOTs.

Overall, there were very few studies reporting outcomes other than survival-related ones and none of the observational studies reported a non-survival outcome. Among the other methodological designs, toxicity was reported in only five studies, which can be explained by our inclusion of reports that assessed toxicity only as a comparison, that is, being reported in both the intervention and the control group. Some studies did provide data about toxicity in the intervention arm, but no information about the control, which limited the interpretation of the results. Lastly, we included only two SRs, which may be due to our strict eligibility criteria for this type of studies.

Our evidence map shows the current landscape of existing research and highlights evidence gaps. Our map shows that a small number of studies have been conducted to assess SOT compared to BSC, and even less reported critical patient centred outcomes. We found absolute evidence gaps, meaning no study reporting data, in the following outcomes: quality of death for all SOTs; quality of life for immunotherapy, and symptoms related to the disease, admissions to the hospital and quality of death for immunotherapy and biological/targeted therapies. In addition, it is important to note that caution is necessary when interpreting the study results that show a potential benefit of some treatments. The reporting of information about the lines of treatment is so scarce that patients with unequal prognosis would wrongfully be equated, which is something particularly relevant in a scenario where the more advanced the incurable disease the less likely it is that treatments will provide any benefit [67]. Therefore, it makes it very difficult to determine which specific patients are the ones that might benefit from specific lines of treatments and the limit beyond which there is no evidence to start a new therapeutic regimen [68]. In consequence, we claim for a more detailed description of administered treatments (i.e., number of cycles, previous treatments, co-interventions).

The main limitation of our review is related to the interpretation of the magnitude of effect of the results. Since this study was designed as a scoping review and evidence mapping, we planned to descriptively show only the direction of the effect of each SOT compared to BSC for the considered outcomes, as reported by the respective authors, but we did not consider reporting the magnitude of the effect nor to perform a quantitative summary of the results (e.g. meta-analysis). Also, we did not assess the risk of bias of each included study. However, our study has several strengths. To our knowledge, this is the only scoping review and evidence map of SOTs compared to BSC in patients with advanced PC. We conducted a comprehensive search including seven electronic databases, with a screening and data extraction process involving independent reviewers to minimise possible errors. Furthermore, we looked for all potentially relevant outcomes for patients at the EoL and we present the results in a reader-friendly graphical display, which strengthened the visibility of both primary and secondary research. In addition to this, we plan to conduct a new SR to update previous ones and include available RCTs to date. We will follow rigorous guidelines to assess the studies’ risk of bias and explore the magnitude of effect of the reported outcomes.

The use of SOTs will likely expand and become a common intervention for advanced PC. However, our results show that much about their effectiveness and safety, when compared to BSC, is still unknown. This uncertainty presents a challenge for health professionals, patients, and their relatives since it is necessary for clinicians to have objective criteria and relevant information in order to weigh potential benefits and side effects before prescribing treatments. Additionally, healthcare professionals must ensure that the patients understand this balance, especially in their particular context.

There is increasing recognition of the need to prioritise patient-centred communication and to have a focus on the patients’ goals of care [5]. For patients with advanced PC with a poor prognosis, these goals inevitably vary and may not necessarily be related only to an increase in survival [5]. Based on the results of our study, these other goals of care are not sufficiently reported. Therefore, it remains unclear if the potential benefits outweigh the risks of SOTs when compared to a conservative alternative such as BSC. In order to thoroughly assess the potential benefits of SOTs over BSC in advanced PC patients, future research should sufficiently report characteristics that will allow a better determination of the type of included patients based on their prognosis and previous treatments, and explicitly assess and report critical patient-centred outcomes such as toxicity, quality of life, admissions to the hospital and quality of death, through well powered, independent, and valid RCTs, included afterwards in the corresponding SR.