Background

A comparative review of palliative care development in the Middle Eastern Cancer Consortium (MECC) member countries identified ‘lack of awareness and understanding of palliative care needs at public, government and professional levels’ as barriers to provision of palliative care to cancer patients in this region [1]. These observations maintain their relevance today for cancer patients living in MECC member countries including the setting for this study, Cyprus. Palliative care as ‘ … an approach that improves the quality of life of patients and their families … through the prevention and relief of suffering by means of early identification and impeccable assessment and treatment of pain and other problems, physical, psychosocial and spiritual’ [2] is rarely recognized [3]. As a concept, palliative care is only equated with management of pain in cancer and available only in oncology inpatient and intensive care units [4].

Within Cyprus, resources for health services including community home-based services are scarce and receive no or little government support. The health expenditure is the lowest compared to other European Union member countries and 25% of the population has no access to public health services [5]. Early palliative care as cost-effective intervention in cancer patients has already been demonstrated [6]. Evidence of the effectiveness and cost-effectiveness of palliative care services may promote their integration for persons living with all serious illnesses in Cyprus. After years of lobbying, local cancer charities have been formally authorized to deliver community home-based palliative care services in Cyprus [4, 7]. This recognition may serve as a ‘catalytic action’ [8] that may increase the coverage of the palliative care services beyond inpatient and intensive care unit settings to the community. The charities must support home services through fundraising and ensure their resources address the most important concerns early. This has necessitated availability of a brief and valid patient-reported outcome measure (PROM) to describe the most important concerns of people with living with cancer.

Routine use of PROMs can improve the quality and relevance of services [9] and also can help build awareness in healthcare providers about the most important needs of patients and families [10]. The Integrated Palliative care Outcome Scale (IPOS) is a valid brief PROM that addresses the most important concerns such as symptoms, information needs, practical concerns, anxiety and low mood, family anxieties and overall feelings of being at peace of persons living with serious illnesses, such as cancer [11, 12]. IPOS has been used with cancer patients [13, 14] and adapted to many cultures [15,16,17].

In this study, we first translated and culturally adapted IPOS into Turkish, and evaluated the cross-cultural validity and responsiveness of IPOS in Turkish speaking community of cancer patients in Cyprus. The findings of the study could have implications for millions of patients living with serious illnesses around the world who have Turkish as their native language [18].

Methods

The study commenced after attaining permissions from the POS Development Team as the copyright holder of IPOS, the EuroQol Group for use of Turkish version of EQ-5D-3L. Ethical approval was obtained from the Eastern Mediterranean University Publication and Research Ethics Committee (ETK00–2017-103). Written informed consent was obtained from all participants included in the study.

Participants and procedures

Patients seen by the community palliative care team including new or old referrals, of Help Those with Cancer Society in Cyprus (KHYD), aged 18 and above were eligible to participate in the study. Patients who were not referred to the community palliative care services, or were younger than 18, were excluded from the study. Invitation and recruitment was consecutive and stopped once the target size of at least 10 cases per item [19] were reached. Two hundred and thirty-four consenting patients were asked to complete the Turkish IPOS alongside the EQ-5D-3L. For follow-up, 82 participants were asked to complete the Turkish IPOS a second time during their next routine visit. Due to unavailability of resources, the follow-up visit and assessment could only carried out in the next scheduled routine visit by the community palliative care team rather a specified time period. Data were collected by the 4 community nurses during routine home visits.

Patients were also asked to complete questions about their age, gender, education, marital status, occupation, number of children, how they were meeting treatment and care expenditures, their sources of support and co-morbidities. Clinical information on the primary tumour site including stage was extracted by the Community Palliative Care Team (CPCT) from their membership registration files. The testing and reporting of the measurement properties of the Turkish IPOS followed the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) recommendations [20].

Measures/questionnaires

Integrated Palliative care Outcome Scale (IPOS)

IPOS is a 10 question, 17-item brief PROM addressing symptoms, information needs, practical concerns, anxiety, low mood, family anxieties and overall feeling of being at peace of persons living with life-threatening illnesses. It is scored on a 5-point Likert scale (0–4) with higher scores indicating an overwhelming presence of symptoms and needs not addressed. Patients may also list their main problems and concerns and any additional symptoms. The 7 day patient version recommended for use in community-based services was used in this study [21]. An earlier study identified Physical Symptoms, Emotional Issues and Support (Social issues and Quality of Care) as three sub-scales of IPOS [11].

EuroQol Group’s Generic Health Status Preference based Measure - EQ-5D-3L

EQ-5D-3L evaluates a person’s health status based on 5 dimensions: mobility; self-care; usual activities; pain/discomfort; and anxiety/depression. It is scored on a scale from 1 to 3 where 1 represents ‘no problems’, 2 denotes ‘some problems’, and 3 ‘extreme problems.’ It is accompanied by a Visual Analogue Scale (EQ VAS) which records the patient’s self-rated health on a vertical VAS with the endpoints ‘Best imaginable health state’ and ‘Worst imaginable health state’. Turkish version of EQ-5D-3L has been validated in cancer patients [22] and therefore was chosen as comparative measure.

Translation and cross-cultural adaptation

The ‘Manual for cross-cultural adaptation and psychometric validation of the IPOS development group’ [23] was rigorously followed for the translation and cross-cultural adaptation. Literature review and consultations with patient, their families and clinicians was used to establishing IPOS’ face and content validity. Face and content validity were reconfirmed in the validation phase of the study by the free text entries of respondents.

Four translators and two mediators followed the independent forward- blind backward translation method to translate IPOS (English) to Turkish. Two translators who carried out the two independent forward translations, were native in Turkish and fluent in English. One of the translators were an English teacher, the second one was a general practitioner. Two translators, who carried out the blinded backward translations were native English speakers, who have moved to Cyprus from the UK, and were fluent in Turkish. Both were English teachers. The mediators were two cancer patients. The expert review panel included all four translators and two mediators, and the first author. The expert review panel reviewed and synthesized the translations, and prepared the pre-final Turkish IPOS for piloting (cognitive testing).

A total of 5 cancer patients and 6 clinicians including nursing staff and counsellors, completed the pre-final Turkish IPOS in order to test the alternative wording and to check understandability, interpretation, and cultural relevance of the translation [24]. Probes such as ‘What does the term practical problems mean to you?’, ‘In your own words can you repeat what this question is asking?’, ‘Was that question easy or hard to answer?’ and ‘I can see that you have chosen moderately or 2 as your response or score, why is that?‘were used [24]. Participants found the questionnaire easy to understand. Completed reports on the general information on participants, translators and expert review panel members, summary of all phases of the process and on the synthesis of the two forward translations and the two backward translations together was collated in a final report. These documents with the Turkish IPOS Pre-Approval Version as agreed by the research team and the copyright holder, were sent to POS Development Team at King’s College London for review and final approval before proceeding to validation phase.

Statistical analysis

Descriptive and multivariate analyses were carried out to present participant characteristics and to assess data completeness, distribution, internal consistency, reliability, validity and internal responsiveness of Turkish IPOS using IBM SPSS Statistics 25.0 and Amos 25.0 [25]. Pairwise deletion was used in multivariate statistical analyses [26]. Participant characteristics were summarized as percentages of the total participants. Mean or median with standard deviation or range of values were presented where relevant. Data completeness was assessed by Missing Value Analysis (MVA). For acceptability, means, standard deviation, range of values, skewness, kurtosis as well as the ceiling and floor effects were assessed for the total scores as well as for the three sub-scales of IPOS. Content validity were re-confirmed through patient responses to two free-text parts of the Turkish IPOS, one about main problems and concerns, and the second on any other symptoms not listed.

A first order Confirmatory Factor Analysis (CFA) was used to assess how well the hypothesized 3-factor model fits the observed data. The model parameters were estimated using Full Information Maximum Likelihood (FIML) method to make maximal use of all data [26]. Post-hoc modifications were undertaken to improve model fit. As the chi-square statistic has been shown to fail to discriminate between good fitting models and poor fitting models in small sample sizes (n ≤ 250) [27], combinational rules and cut-off criterion for fit statistics that minimize Type I and Type II errors in small samples were considered [28]. Comparative Fit Index (CFI) and Standardized Root Mean Square Residual (SRMR) were used to evaluate the model fit with CFI ≥ 0.95 and SRMR< 0.09 suggested good fit.

Internal consistency of each sub-scale was evaluated with Cronbach’s α coefficient [29] where α values in the range of 0.70–0.90 is indicative of good internal consistency [30]. In order to estimate the reliability, Interclass Correlation Coefficients (ICCs) using two-way mixed effect model was obtained and ICCs for single measurement are reported. The choice of the model was informed by the fact that multiple administrators from a selected pool carried out the assessments and consistency of measurement was critical [31]. ICCs less than 0.5 are indicate poor, between 0.5 and 0.75 indicate moderate, 0.75 and 0.9 are indicate of good, and above 0.90 indicate excellent reliability [31].

Construct validity where conceptual convergence and divergence between Turkish IPOS and EQ-5D-3L items were evaluated with bivariate correlation analysis, where Pearson’s correlation coefficient (r) between 0 and 0.2 indicated weak, 0.2–0.4 low, 0.4–0.6 moderate and 0.6–0.8 strong relationship given statistical significance. Known groups (discriminant) validity was assessed by independent samples t-test comparing total and sub-scale scores in participants with early (Stages I-II) versus advanced cancer (Stages III-IV).

Standardized Response Mean (SRM) was calculated to estimate change in scores standardized relative to variability between the participants to assess internal responsiveness [32]. Baseline and follow-up scores were compared using paired t-test. Bonferroni corrected p ≤ 0.01 was used for significance to account for multiple comparisons.

Results

Literature and consultations confirmed that IPOS covered all of the relevant concepts in relation needs and concerns and had face and content validity. Pain and emotional difficulties emerged as the most prevalent issues. In the 2 forward translations there were differences in the grammatical tense used; translators used present continuous tense, but the mediators used past tense. The item on practical problems resulting from illness was particularly challenging, therefore the word ‘practical’ was removed and the question revised to ask about ‘personal and financial problems’ caused by illness. The 2 blind backward translations produced from final reconciled forward translation of Turkish IPOS were both similar with no significant differences in meaning. The expert panel reviewed all versions to improve clarity and produced the pre-final Turkish IPOS.

Following cognitive testing, instructions were reworded and further shortened. The response options were generally clear and well understood; the only difficulty was with ‘occasionally’ which was suggested to be changed to ‘zaman zaman’ rather than ‘ara sıra’. Patients struggled with the information item which was revised to emphasize that the question was not about the knowledge the patients possessed but the information given to them. Turkish IPOS Pre-approval Version was sent to the Cicely Saunders Institute POS Team for independent review. Following this and minor amendments, Turkish IPOS was produced and validation study was initiated.

For the validation study, data collection took place between July 2017 and October 2018. Participants were mostly women (73.5%), almost all were struggling with treatment expenses (91.5%) and most received support from family members (83.3%). Of the 43.6% who reported having comorbidities, 50% had hypertension and 28.4% had diabetes (Table 1). Fifty three percent of the participants had advanced cancer and breast cancer was the most prevalent (48.3%).

Table 1 Participant clinical and socio-demographic characteristics (n = 234)
Full size table

MVA identified four items with higher number of missing responses in baseline assessment (9.4–7.7%) (Table 2). As the data were not missing completely at random (Little’s MCAR test χ2 = 291.512, DF = 184, p < 0.0001), listwise deletion or imputation of missing values was not undertaken. Patients at moderate stages of their illness (Stage II and III) had more than 5% of responses missing for these items. Only two items were missing 1 response each in the follow-up assessment.

Table 2 Data Completeness: Numbers and percentages of complete responses and non-responses in baseline and follow-up assessments
Full size table

CFA fit indices were CFI = 0.756 and SRMR = 0.0002 indicated poor fit of the model to the data (χ2 = 496.369, df = 87, χ2/df = 5.705, p < 0.0001) and post-hoc modifications were made. Post-hoc modification involved adding in covariances of error terms based on theoretical and relevant associations of items measured. The model fit improved where CFI = 0.855 and SMRM = 0.0002 (χ2 = 321.874, df = 78, χ2/df = 4.127, p < 0.0001). Even though the CFI and SMRM parameters approached the minimums, they were not within the required defined parameters recommended for small samples. For this reason, the CFA was inconclusive and cross-cultural validity could not be confirmed or negated. The standardized parameter estimates of the modified model are shown in Fig. 1. Physical factor accounted for 73–21% of variance, Emotional factor for 25–11% and Social Impact and Quality of Care (Support) for 50–32% of the relevant IPOS items. Emotional subscale, had poorly loading items where Anxiety and Anxiety of Friend and Family had factor loadings of 0.32 and 0.35 respectively (see Table 3 and Fig. 2 for distribution of scores).

Fig. 1
figure 1

Cross-cultural validity: Standardized measurement model following post-hoc modification for Confirmatory Factor Analysis (n = 234)

Full size image
Table 3 Acceptability: Distribution of Turkish IPOS scores
Full size table
Fig. 2
figure 2

Distribution of Turkish IPOS total scores (n = 204) where 0 = No needs, concerns and/or symptoms, 68 = Highest needs, concerns and/symptoms

Full size image

The Emotional sub-scale showed poor internal consistency (α = 0.64), three of the items were worthy of retention but deletion the item on anxiety of family and friends would increase α to 0.75. The reliability of this subscale was also poor (ICC = 0.31, 0.24–0.39, 95% CI). The Physical subscale showed good internal consistency (α = 0.91) but moderate reliability (ICC = 0.51, 0.45–0.56 95% CI). Social and Quality of Care Issues subscale showed good internal consistency (α = 0.75) and marginally moderate reliability (ICC = 0.50, 0.42–0.57 95% CI).

The participants listed feeling worried, financial difficulties, lack of support, impact of cancer on the family on activities of everyday life as their main concerns in response to the open-ended first question in IPOS. As these topics were all covered by IPOS, its content validity was reconfirmed.

Correlations with EQ-5D-3L domains were significant and, mostly in the directions and strength predicted (Table 4). For example, IPOS Emotional subscale, had low correlations with EQ-5D Mobility, Self-care, Usual Activity, slightly higher but still low correlations with Pain/Discomfort and Anxiety/Depression and moderate negative correlation with self-rated health.

Table 4 Construct Validity: Bivariate Correlational Analysis (Pearson’s rho) of IPOS and EQ-5D
Full size table

Known-group validity was indicated as there was a significant difference in the total scores for early (M = 22.03, SD = 10.39) and advanced (M = 25.51, SD = 9.27) stages; t (128.526) = − 2.274, p = 0.025. Similarly, participants at earlier disease stage had significantly lower Social and Quality of Care sub-scores (M = 4.87, SD = 2.75) than participants at advanced stages of cancer (M = 6.41, SD = 2.25), t (123.635) = − 3.955, p < 0.0001. The Physical and Emotional sub-scale scores for participants at early and advanced stages were not significantly different.

The mean time between the two administrations were 4.6 weeks (Range = 2–7, SD = 1.5). SRM of − 0.94 suggests large responsiveness [33]. Total scores at follow-up were significantly lower compared to baseline with a mean difference of 9.87 (7.18–12.58, 95% CI), t (57) = 7.33, p < 0.0001. A similar trend was observed for the physical (x1-x2 = 7.02, t (72) =10.3, p < 0.0001) and quality of care/social support subscales (x1-x2 = 2.11, t (61) =6.35, p < 0.0001). However, emotional concerns significantly worsened compared to baseline (x1-x2 = − 1.74, t (61) = − 4.2, p < 0.0001). Figure 3 maps change scores for 58 cancer patients with complete data across all four scales and assessments (Fig. 3).

Fig. 3
figure 3

Internal responsiveness: Change scores from baseline for IPOS total and subscale scores (negative difference suggests improvement) (n = 58)

Full size image

Discussion

In this study we adapted IPOS to Turkish and evaluated its cross-cultural validity and responsiveness in cancer patients. Most of the items were translated easily and perceived to be culturally relevant. Contrary to experiences of teams working on other language translations [16, 34], “at peace” item was particularly easy to adapt to Turkish as this is a very culturally relevant concept. Items on “practical problems addressed” and “information” were the most challenging to translate and adapt because the word “practical” is commonly used interchangeably to refer to “application”, and “information” can translate to “knowledge possessed”. Both items were clarified during cognitive testing.

Studies with cancer patients may be missing data [35] and higher rates of responses may be missing in palliative care studies compared to other studies [36]. Data for the baseline and follow-up assessment were impressively complete for most of the items. The baseline assessment of items on depression, information, anxiety of friends and family, and sharing feelings with friends and family generated the most non-responses. It is possible that patients may be struggling to come to terms with their cancer diagnosis or struggling to express the emotional impact of cancer on themselves, friends and family [37, 38]. Also, participants may have felt uncomfortable expressing their true responses to the item on “information” as not to offend the community palliative care staff caring for them, as was observed in the Japanese IPOS validation study [14].

Evaluation of SRMR and CFI values of the final CFA model could not confirm or negate that the three-domain structure proposed in the original IPOS was an acceptable fit to our data [39], in the original validation study 2-factor solution was implicated to be better fitting [11]. Even though CFI and SMRM parameters approached the minimums, they were not within the required defined parameters recommended for small samples. Future larger studies may be needed to confirm the three-domain structure. Emotional subscale, specifically had poorly loading items. Lack of consensus on cut off criteria for factor loadings in studies with small samples [40], necessities future larger studies before further actions are taken in relation to removal of items.

Turkish IPOS is acceptable, with no floor or ceiling effects. The mean and standard distribution of scores are consistent with findings from a recent validation study in cancer patients [14]. Turkish IPOS illustrated moderate to marginally moderate internal consistency and good to moderate reliability with its Physical and Social and Quality of Care subscales. However, the Emotional sub-scale showed poor internal consistency and reliability. These results agree with the findings in the original validation study [11], which reported low internal consistencies for Emotional and Social and Quality of Care subscales. In line with observations from the CFA, the removal of the item ‘Have any of your family or friends been anxious or worried about you?’ is indicated for improving internal consistency.

Content and face validity, ascertained through the translation and cross-cultural adaptation phase as well as at the validation phase, was also good as all of the main concerns such as feeling worried about treatment, the future, loss of independence and dying, the impact of the illness on the family, financial impact of illness, issues with getting support and pain were the main concerns brought up in the open-ended questions were covered in IPOS.

Construct validity was demonstrated with significant but moderate to low correlations with EQ-5D-3L items and VAS scale in the predicted direction. These findings were consistent with the findings of the Japanese IPOS [14]. Turkish IPOS also demonstrated known-groups validity as cancer patients at advanced stages had significantly higher total IPOS scores.

Turkish IPOS was able to detect statistically significant changes in concerns and symptoms between baseline and follow-up assessments. The effect size statistics were large. These findings supported internal responsiveness of the Turkish IPOS. The improvement in the total score was mostly due to significant improvement in the physical and quality of care/social support aspects. However, small but significant deterioration was reported with the emotional subscale. The general improvement or deterioration in the scores could be the effect of home palliative care services, but further studies are required to understand these changes in the context of clinical and subjective meaning [41].

There are further limitations of this study which need to be acknowledged. Patients were recruited through convenience sampling and may not be representative of all cancer patients. Additionally, patients receiving community palliative care services from the cancer charity may be more financially disadvantaged compared to the overall population of cancer patients. Patients with breast cancer were over-represented in the study as the charity was established by a breast cancer survivor and attracts more memberships among women living with breast cancer. Also, more women participated in the study as men may be less willing to share their experiences of having cancer [42]. These limitations may affect the generalizability of the findings.

The potential regional differences in Turkish language must also be taken into consideration. For this reason, minor amendments might be needed before Turkish IPOS is used in other Turkish speaking communities.

A team of researchers in Turkey have recently completed the cognitive testing of Turkish IPOS and have confirmed initiation of validation work with no revisions or modifications. Further research is needed to establish the range of Turkish IPOS scores that indicate clinical change meaningful to the patient and to establish its reliability and validity in non-cancer patient populations.

Conclusion

Turkish IPOS is simple to complete and clearly understood. It measures the important aspects of needs and concerns that are relevant to Turkish speaking cancer patients and it is acceptable. Physical and Social and Quality of Care subscales are internally consistent and reliable, can be used to evaluate needs and concerns in these areas. There is good evidence that Turkish IPOS is a valid measure of concerns and needs, and responds to the severity of illness and is able to measure change over a specified time frame. Future studies are necessary to investigate the performance of the Emotional subscale, to clarify the factor structure and to evaluate the extent to which change in a IPOS relates to corresponding change in a reference measure of clinical or health status. Observing regional differences, Turkish IPOS may have implications for use in other Turkish speaking communities.