Background

The concepts of quality of life and patient-centered outcomes have become popular in medical communities; however, the wide application of quality-of-life investigations remains an obstacle for most clinicians due to the limited validation studies performed to date and the lack of disease-specific measuring instruments. Health-related quality of life has become an indispensable component of outcomes research, particularly for cancer therapy. Measurement instruments, particularly self-administrated questionnaires, enable a quantitative approach to the multi-dimensional perception of quality of life, and such surveys may provide important outcome variables in addition to conventional clinical results such as morbidity and disease-free survival [1].

Colorectal cancer is the leading cause of human malignancies in Taiwan according to the Bureau of Health Promotion, and ranks the third among all cancer deaths [2]. The burden of colorectal cancer is rapidly increasing due to the high incidence and consequences of cancer therapy. Patients who survived colorectal cancer therapies may continue to suffer from physical or psychological problems [3]. For example, chemotherapy may hamper quality of life considerably, and colon/rectum resection may result in long-term prolonged diarrhea or fecal incontinence. Therefore, development and validation of a measuring instrument is an urgent requirement for medical professionals and cancer patients.

The European Organisation for Research and Treatment of Cancer (EORTC) QLQ-CR29 [4, 5] is a colorectal cancer-specific module supplementary to the core quality-of-life questionnaire QLQ-C30 [6]. However, the validity and reliability of the Taiwan Chinese version have never been conducted, and only the early results had been reported in Mainland China using the Simplified Chinese version, which is distinct from the Traditional Chinese version used in Taiwan [7]. The present study aimed to assess the reliability and validity of the EORTC QLQ-C30 and QLQ-CR29 for patients with colon and rectal cancer in Taiwan.

Methods

Translation of the Taiwan Chinese version of the EORTC QLQ-CR29

Traditional Chinese (Mandarin) language used in Taiwan is linguistically different from the Simplified Chinese used in Mainland China. The translation and pilot study were conducted during the years 2007 and 2008, shortly after the introduction of the updated English version of colorectal cancer-specific module QLQ-CR29. Fifty-seven Taiwanese patients were enrolled as part of the multi-national validation study [5]. The Taiwan Chinese EORTC QLQ-CR29 was developed using a standard procedure of translation and back-translation [8], after which the questionnaire was reviewed and approved by the EORTC Quality of Life Group.

Study population

Patient recruitment began on November 1, 2015 and ended on March 31, 2016 at Cathay General Hospital. Patients over 18 years of age with pathology-proved colon or rectum cancer were invited during the enrollment period. Patients’ status was categorized into the active treatment or follow-up group. Pre-operative patients or patients under chemotherapy constituted the active treatment group, and these patients were interviewed before surgery or after the first day of chemotherapy. Follow-up patients were those who had completed surgery, chemotherapy, or any adjuvant therapy for at least six months, and their interviews were conducted during returning visits at outpatient clinics. Exclusion criteria included disagreement to participate, concurrent secondary malignancy, concurrent engagement in another quality-of-life study, and declaration of critical illness. Study purpose and privacy protection policy were effectively explained with written consent obtained from all participants.

Measuring instruments

The EORTC QLQ-C30 core questionnaire is a quality-of-life measuring instrument for cancer patients, and the Taiwan Chinese (Traditional Chinese) version has been validated and descripted previously [9, 10]. The clinical applicability for breast cancer, lung cancer, head and neck cancer, gastric cancer, and esophageal cancer has been demonstrated [9,10,11,12,13]. The QLQ-C30 consists of a global health status/quality of life, five multi-item functional scales and several multi-item symptomatic scales or single items. With linear transformation, seven- and four-level Likert scales (seven for the global health status/quality of life scale and four for the others) were converted to a 0 to 100 score with 100 representing the best global health, functional status, or worst symptom depending on the measuring characteristic of each multi-item scale or single item [14].

The EORTC QLQ-CR29 is a 29-item colon and rectum cancer site-specific supplemental module that aims to enhance the sensitivity and specificity for colorectal cancer quality of life measures [4, 5]. The original English version comprises 4 multi-item scales (body image, urinary frequency, blood and mucus in stool, and stool frequency) and 17 functional/symptomatic single-items (anxiety, weight, sexual interest, urinary incontinence, dysuria, abdominal pain, buttock pain, bloating, dry mouth, hair loss, taste, flatulence, fecal incontinence, sore skin, embarrassment, stoma care problem, impotence or dyspareunia), with higher scores indicating better functional or worse symptomatic status. Of these 21 scales or items, only body image, anxiety, weight, and sexual interest are functional domain scales/items, and all the remaining are symptomatic. One item (Q18) of the QLQ-CR29 is an indicator of colostomy/ileostomy construction, and different contents are designed for patients with/without a stoma in stool frequency, flatulence, fecal incontinence, sore skin, and embarrassment. Separate items are arranged for patients with a stoma (Q19-Q25) and those without it (Q19-Q24). The stoma care problem is only eligible to patients with a colostomy/ileostomy (Q25). Moreover, sexual interest, impotence, and dyspareunia items are only applicable to the corresponding gender (Q26-Q27 for male and Q28-Q29 for female). Permission to use the QLQ-C30 and QLQ-CR29 was obtained in advance from the EORTC Quality of Life Department.

Additional measures

Additional measures were rated by two investigators (MHS and CCH, both of who are qualified colorectal surgeons) to assess patients’ performance status and colonic transit time in the week prior to administering the questionnaires. Eastern Cooperative Oncology Group (ECOG) Performance Status, evaluates a patient’s level of functioning, and is widely used in cancer research, with Grade 0 representing fully active and Grade 5 representing dead status [15]. Bristol Stool Scale is adopted from Lewis et al. [16], which categorizes the form of stool representing colonic transit time. In brief, Type 1 and 2 indicate stool constipation, while Type 5-7 indicate diarrhea.

Reliability and validity

Internal consistency reliability was evaluated for multi-item scales, and a referable reliability was indicated by Cronbach’s alpha coefficient greater than 0.70 [17]. For multi-item scales, both convergent and discriminant validity were evaluated by item-scale correlations. Convergent validity was indicated by item and item-own scale correlation greater than 0.40, and item and item-own scale correlation greater than item-other scale correlations demonstrated discriminant validity [18]. A subset of follow-up patients was re-assessed within 7-14 days for the test-retest reliability (reproducibility) by evaluating the correlation coefficients between repeated measures during December 2017.

Known-groups comparisons, which compared patients of different treatment conditions, ECOG Performance Status, and Bristol Stool Scale, were conducted for the purpose of evaluating clinical validity. We postulated that patients under active treatment may suffer from disease burden or treatment adverse effects, and higher symptomatic and lower functional scores were discernable. Patients with higher degree of diarrhea according to the Bristol Stool Scale may have worse diarrhea-related symptoms, and patients with better ECOG Performance Status may report higher functional and lower symptomatic scores. Additional comparisons regarding the presence of a stoma, the type of adjuvant therapy, and different surgical procedures were evaluated as well.

Statistical analysis

Wilcoxon rank sum test was used for comparing group means since most quality-of-life scores were skewed and not normally distributed. All tests were two-sided, and a P-value less than 0.05 was considered as statistically significant. Sample size was calculated by G*Power3 [19] and was estimated as follows: assuming the standard deviation was 20, in order to detect a difference of 10 to 15 scores between two groups, the number needed in each group was 51 and 23, respectively, under the two-sided Z test with 80% power and α level of 0.05. Consequently a total of 50 patients in each group were a prerequisite for the validation purpose. The presuming quality-of-life score difference as well as standard deviation were estimated from our previous validation study for the QLQ-BR23, QLQ-STO22, and the suggestion of Osoba et al. [9, 10, 20].

Results

Demographic features

During the enrollment period, 108 colorectal cancer patients (53 from the active treatment and 55 from the follow-up group) were successfully interviewed. There were 63 males and 45 females, with the mean age being 63.7 years (range: 22.2~ 89.1, SD: 13.2). Among them, 20 (18.5%) patients were presented with an obstructive lesion during initial diagnosis. The response rate was 88% for the active treatment and 87% for the follow-up group (refusers: 7 for active treatment and 8 for the follow-up group), with no significant difference (Fisher’s exact test, P = 0.21). Of the 53 patients in active treatment, 20 were planned for surgery and 33 for chemotherapy. Descriptive statistics are listed in Table 1. There was no difference in demographic and clinical features except more female patients in the follow-up group, and more stage IV and chemotherapy patients in the active treatment group (P < 0.05). There was no difference in terms of the ECOG Performance Status and the Bristol Stool Scale between these two groups. The distributions of the EORTC QLQ-C30 and QLQ-CR29 scale scores are detailed in Table 2.

Table 1 Demographic and clinical features of study population
Table 2 Distributions of the EORTC QLQ-C30 and QLQ-CR29 scores for Taiwanese colorectal cancer patients

Reproducibility

Table 2 also displays reproducibility (test-retest reliability) for multi−/single- item scales of the EORTC QLQ-C30 and QLQ-CR29. A subset of 30 follow-up patients were approached, and 20 completed repeated measures between the first and second assessments within 7-14 days. Most scales indicated moderate to high correlation coefficients (0.51-1), augmenting the reproducibility of the measuring instruments. Exceptions were cognitive function (r = 0.48), pain (r = 0.11), dyspnea (r = 0.29), and financial difficulty (r = 0.47) from the QLQ-C30, as well as anxiety (r = 0.47), weight (r = 0.48), sexual interest (r = 0.47), blood and mucus in stool (r = 0.34), urine incontinence (r = 0.11), bloating (r = 0.40), dry mouth (r = 0.09), fecal incontinence (r = 0.47), and embarrassment (r = 0.50) scales from the QLQ-CR29. It is noteworthy that test-retest reliability was performed for the same follow-up group separately during December 2017.

Reliability

Table 3 exhibited the reliability of the Taiwan Chinese version of the EORTC QLQ-C30 and QLQ-CR29. Convergent validity was indicated by item-own scale correlation (corrected for overlap) above 0.40 for all multi-item scales, and discriminant validity was convinced as the item own scale correlation was higher than item-other scale correlations for all multi-item scales. Cronbach’s alpha coefficient indicated good internal consistency reliability (> 0.70) for the QLQ-C30 and the QLQ-CR29 except cognitive function (0.45) and pain (0.61), both of which were from the QLQ-C30.

Table 3 Reliability, convergent and discriminative validity of the Taiwan Chinese EORTC QLQ-C30 and QLQ-CR29

Clinical validity

Table 4 presented the results of clinical validity. Follow-up patients reported a higher functional score in global health status/quality of life than those undergoing active treatment (P = 0.005). On the other hand, worse blood and mucus in stool was reported by patients in the active treatment group (19 versus 4, P < 0.001). The EORTC QLQ-CR29 recognized this as a colorectal cancer-specific symptom.

Table 4 Clinical validity: known-group comparisons of the Taiwan Chinese EORTC QLQ-C30 and QLQ-CR29

When ECOG Performance Status was used for partitioning, better global health status/quality of life (P < 0.05, QLQ-C30); better role function (P < 0.05, QLQ-C30); better physical function (P < 0.01, QLQ-C30); improved sexual interest (P < 0.01, QLQ-CR29); fewer complaints of fatigue (P < 0.01, QLQ-C30); lesser constipation, pain, and appetite loss (P < 0.05, QLQ-C30); and lesser problems with urinary frequency (P < 0.01, QLQ-CR29) were observed for ECOG Performance Status Grade 0 patients compared with patients having Grades 1-3. Types 5 and 6 patients on the Bristol Stool Scale experienced less appetite loss, and had better social function compared to Types 1 to 4 patients on the Bristol Stool Scale (P < 0.05, QLQ-C30).

Further comparisons evaluating the impacts of colostomy/ileostomy construction, adjuvant therapy, and surgical methods upon quality of life are detailed in Table 5. Stoma construction inevitably hampered quality of life in sore skin and fecal incontinence (P < 0.05, QLQ-CR29), while less insomnia (P < 0.05, QLQ-C30) was also revealed for the stoma group. Minimally invasive surgery benefited colorectal cancer patients with better social function, and fewer buttock pain and nausea/vomiting symptoms (P < 0.05). Adjuvant therapy deteriorated quality of life with worse hair loss and compromised social function (P < 0.01).

Table 5 Additional known-group comparisons of the Taiwan Chinese EORTC QLQ-C30 and QLQ-CR29

Discussion

During the past decade, the Taiwan Chinese version of the EORTC QLQ-C30 (3.0) and the breast (QLQ-BR23), head and neck (QLQ-HN35), stomach (STO22), lung (QLQ-LC13), and esophageal (QLQ-OES18) cancer-specific modules have shown good acceptability for Taiwanese cancer patients [9,10,11,12,13]. This is not the case of the EORTC colon and rectum-specific module. The QLQ-CR29 is the revised and shorter version of the QLQ-CR38 [21], with the Chinese version validated and reported in Hong Kong [22] and Mainland China [23]. The QLQ-CR38 questionnaire was limited in terms of missing data and lack of specificity, particularly with regard to emerging new technologies such as pre-operative chemo-radiotherapy, ultra-low anterior resection, and minimally invasive surgery [4]. The initial 6 scales and 11 items construct of the QLQ-CR29 was reformatted into the final structure of 4 scales and 17 items. Thaysen et al. have summarized that EORTC QLQ-CR29 contains 17 unchanged questionnaire items from the QLQ-CR38, 5 reworded items, and 7 new items [24].

The present study may be the first validation study of the Taiwan Chinese QLQ-CR29 questionnaire. Most multi-item scales exhibited adequate internal consistency reliability. The only two exceptions were cognitive function and pain scale of the QLQ-C30. Cronbach’s alpha of cognition function was much lower than 0.70, and compromised coefficients were also noted when Taiwanese breast, lung, gastric, and head and neck cancer patients were approached [9,10,11,12]. We have suggested that elimination of cognitive function may enhance the conceptual structure of the Taiwan Chinese version of the EORTC QLQ-C30 in the higher-order formative health-related quality of life model [25]. All item and item-own scale correlations (corrected for overlap) were greater than 0.40 and all item-own scale correlations were greater than item-other scale correlations, and satisfactory discriminant and convergent validities for both the QLQ-C30 and QLQ-CR29 were evidenced.

For clinical validity, we hypothesized that pre-operative patients were negatively affected by the colorectal lesion, and patients with chemotherapy experienced worse quality of life from treatment side effects or psychological distress. For example, worse blood and mucus in stool complaint in the active treatment group was compatible with concurrent disease burden. Follow-up patients reported a higher global heath/quality-of-life score, demonstrating good recovery after completion of cancer therapy. Better functions and fewer symptoms, including sexual interest and urine frequency of the QLQ-CR29, among patients with the lowest ECOG Performance Status (Grade 0) also suggested convincing clinical validity. It is noteworthy that Types 5 and 6 patients on the Bristol Stool Scale experienced more flatulence with a borderline significance (P = 0.059, Table 5). Additional comparisons identified worse hair loss and social function from adjuvant therapy as well as worse sore skin and fecal incontinence from colostomy/ileostomy. Interestingly, patients with a stoma reported a lower insomnia symptomatic score. Our study also revealed that minimally invasive surgery might benefit patients with better social function, and less buttock pain, and nausea/vomiting symptoms.

During the validation of the Dutch QLQ-CR29, Stiggelbout et al. suggested decreasing the number of single items, improving the scales, and increasing the reliability of the entire questionnaire [26]. Indeed, the number of scales/items displaying a significant difference between the active treatment and follow-up group had significantly reduced compared with that of the Taiwan Chinese QLQ-STO22 validation study [10]. The QLQ-STO22, which is seven items shorter than the QLQ-CR29, contains 5 multi-item scales and 3 single items while the QLQ-CR29 is composed of 4 multi-item scales and 17 single items. The significantly higher proportion of single items (59% versus 14% or 17/29 versus 3/22, compared to the QLQ-STO22) of the colorectal module may limit its ability to detect all minute differences under high dimensionality, raising concerns about sensitivity loss for single-item measures, and the problem of an excessive number of single items substantially compromising the measuring performance of the QLQ-CR29.

The current study has some limitations. First, our modest sample size may have resulted in compromised statistical power, considering that QLQ-CR29 is arranged with significantly greater number of single-item than multi-item scales, and inadequate sample size may result in fewer detected differences. For example, up to 16 distinguished multi−/single-item scales were observed in the original international validation study involving 351 participants with three rounds of known-group comparisons, but only one multi- and two single-item scales were discriminative when the Polish QLQ-CR29 was validated with an extremely compromised sample size of 20 [5, 27]. The yield of known-group analysis is largely influenced by the characteristics of the targeted population, stratification factor, as well as the number of colorectal cancer patients enrolled; a survey of 108 participants may just fulfil the purpose of a validation study, but are inadequate to detect all quality-of-life fluctuations across broad clinical scenarios. The clinical applicability of the QLQ-CR29 will be evaluated when more samples are enrolled in the future.

Second, reproducibility (test-retest reliability) was not conducted at the time when enrolled patients were initially contacted but was performed one year later. The non-concurrent, add-on design might hamper comparability and efficiency, and inevitably compromise reproducibility. It is noteworthy that the agreement in anxiety was not maintained when the Bahasa Malaysia version of the QLQ-CR29 was evaluated for test-retest correlations either [28].

Conclusion

The validity and reliability of the Taiwan Chinese EORTC QLQ-C30 and QLQ-CR29 questionnaire were ascertained. Quality-of-life investigation is complimentary to traditional outcomes such as morbidity and mortality, while patients’ perspective reported by the EORTC QLQ-C30 and QLQ-CR29 will greatly enhance our understanding of quality of life of colorectal cancer survivors, for whom improved survival has been observed but subjective well-being has rarely been addressed. The combination of cancer core questionnaire and site specific module provides an effective way to measure quality-of-life status with excellent sensitivity and specificity, which in turn will facilitate colorectal cancer therapy and enhance comprehensive outcomes research.