Background

Since quality of life has gained increasing importance in clinical oncology over the last 15 years, current quality of life inventories now focus on physical, mental, cognitive, social and other dimensions along with chemotherapeutical effects. These comprise the EORTC QLQ C30 [1] of the European Organisation for Research on Treatment of Cancer, including additional scales for specific types of tumours [2] or the Functional Assessment of Cancer Therapy – FACT [3] which, next to the basic module, also contains symptom-specific supplementary modules [4]. Generic questionnaires such as the Medical Outcome Study SF-36, which is also used for oncologic patients, capture the rehabilitative, physical, emotional and social functional status [5].

New studies have yielded some evidence that questionnaires capturing the individual skills of adaptation such as the 'sense of coherence' [6] or 'self-regulation' (Grossarth-Maticek 1999) could be more appropriate as prognostic tools in oncology or in other chronic conditions than conventional health-related quality of life (HRQL) scales [7]. However, inventories which capture the 'Sense of Coherence' (SOC) based on Antonovsky's concept of salutogenesis have mainly been validated in psychosomatic and psychiatric patients [6, 8]. Antonovsky's initial question was: What keeps a person healthy? For Antonovsky, health is a continuum between total disease (dis-ease) and complete health (ease). Salutogenesis is a concept based around stress and resilience. The question of salutogenesis contrasts with a central question of scientific medicine into pathogenesis: What makes a person ill? [6]. The SOC is based on three components which are considered prerequisites for salutogenesis: comprehensibility, meaningfulness and manageability.

  1. 1)

    According to Antonovsky, these three factors determine to what extent a person can rely an existing, enduring but also dynamic feeling of trust, which gives structure to the course of internal as well as external events and makes them understandable.

  2. 2)

    These resources have to be available when required and

  3. 3)

    the situation must be understood as challenges which deserve rising to [9].

New epidemiological studies have articulated the potential prognostic relevance of SOC for cancer patients [7]. However, Antonovsky was a sociologist and did not extend his work to people with chronic illness, focusing instead on survivors of the Holocaust. Thus, although the current SOC scale includes general questions about life style, attitudes to life, and mental health [10] which are relevant to all groups of people, it does not address physical health. But rather than containing references to physiological parameters as postulated by Antonovsky [8, 9], due to its origin, it focuses in particular on mental health. Already, in 1923 a first medical approach to salutogenesis was discussed [11]. All in all, it therefore there is a need to develop a questionnaire with a stronger focus on patients with chronic diseases, particularly cancer.

Here we report a two stage validity study which aimed to validate the ICS which was developed based on a non-standardised open questioning process of cancer patients before starting the study and expert ratings from questions on disease management, outlook on life and drive, perception of health and thermoregulation for oncological patients. We followed development of the instrument by testing reliability, and validity of construct and content, as well as its responsiveness to chemotherapy.

Methods

On the basis of a former non-standardised questioning process in 2001 in our centre of tumour therapy, cancer patients described the following symptoms as their major complaints under chemo- and radiotherapy: 1) fatigue, 2) lack of motivation, 3) asthenia, 4) sleepiness, 5) lack of concentration and 6) cogitation, 7) disturbance of memory, 8) depressive symptoms, 9) visual, 10) acoustic, 11) olfactory and 12) gustatory hypersensitivity, 13) feeling indifferent, 14) feeling being not really present, 15) feeling not being coherent, 16) feeling discouraged, .17) feeling uncomfortable, 18) doing activities in a "mechanical manner", 19) having cold hands and feet, 20) often and quick freezing. The symptoms 1 – 7 were integrated in the parallel development process in the CFS-D [19], the symptoms 9–13 have been integrated in the questionnaire as single items.

Based on the symptoms 13 – 20, a group of experts (oncologist, internist, gastroenterologist, somnologist, general practitioner and statistician) formulated twelve items on the topics of meaningfulness, manageability and resilience in dealing with cancer disease and formation of perspective. According to our experience in cancer patients, we also integrated items on heat regulation, because a feeling of comfort and well-being is often associated with good thermoregulation being a precondition on the subject of inner coherence.

Study 1: item detection, reliability and validity

We carried out this study in the Departments of General Internal Medicine and Gastroenterology at the Gemeinschaftskrankenhaus Havelhöhe (Berlin), as well as in the specialist oncology practice at the hospital between January 2003 and February 2004.

Consecutively recruited patients with histologically confirmed malignant tumours were matched according to age (± 5 years) and gender with participants of a healthy control group who had no known acute or chronic disease. Table 1 shows the demographic, table 2 the clinical and treatment characteristics of the participants. Participants with malignancies had a broad range of tumour localisations (table 3). At the time of being surveyed, at least two weeks had elapsed since a participant's last operation, chemotherapy or radiotherapy session. Further exclusion criteria were patients with a Karnofsky's Index (KPI) < 50%, patients aged < 18 years or > 85 years, patients with a manifest psychosis or uncontrollable pain.

Table 1 Sociodemographic overview of the participants of studies 1 and 2
Table 2 Overview of tumour stage, diagnosis duration, Karnofsky performance index, haemoglobin and therapy
Table 3 Diagnosis of cancer patients in study 1

Participants in the control group were recruited opportunistically from hospital staff and their families. Any history of malignancy or severe chronic conditions was a criterion for exclusion.

After the study was explained and consent was obtained, the ICS questionnaire was administered. The target for the test-retest analysis was at least 50% of all participants. The questionnaire was re-administered opportunistically without rejection on 65 participants (57.3%) after a median of four weeks (mean of 5.2 weeks, SD = 4.2).

Next to the 12 ICS items (table 4) the following questionnaires were conducted:

Table 4 Items of the ICS
  1. 1)

    The short questionnaire on 'self-regulation' (SRQ) is a scale with 16 items in two subscales for measuring self-regulation and health-building activity with a six-point-Likert scale. The 16 items are added and divided by 16 to obtain a total score. Subscale 1 is termed "Ability to Change Behaviour in order to reach goals", and subscale 2 "Achieve Satisfaction and Well-Being", which thus has a hedonistic connotation. Higher scores indicate better self-regulation. The validity and reliability of the sum and subscales are satisfactory until very good: Cronbach-alpha = 0.80 – 0.95 (and test-retest reliability = 0.73 – 0.82). We used this scale because of its conceptual congruence (convergent validity) with aspects of internal coherence [12, 13]

  2. 2)

    The long version questionnaire on 'autonomic regulation' (aR) measures the autonomic functioning of an individual with an 18-item scale in three subscales (orthostatic-circulatory, rest/activity regulation and digestive). AR measures with a three point Likert-scale (18 – 54) with a satisfactory/good reliability and good validity [14, 15]. Questions on thermoregulation are integrated into this scale, so we used it to measure convergent validity of items concerning heat regulation [15].

  3. 3)

    The German version of the 'Hospital Anxiety and Depression Scale' (HADS-D) consists of 14 items (7 for anxiety and 7 for depression) on which people rate on a four-point Likert scale (0–21 both). Higher scoring indicate more symptoms, ≥ 11 points anxiety or depression are probable, ≥ 8 – 10 possible cases, < 7 no cases. The HADS is highly reliable and valid and is an extensively used scale in internal medicine research [16, 17].

  4. 4)

    The Karnofsky Performance-Index (KPI) [18] which is a general and robust indicator of physical functioning daily life.

  5. 5)

    Questions on autonomic state and heat sensitivity were also collected [15].

Results of the co-validation procedure of the German version of the Cancer Fatigue Scale (CFS-D) have been published elsewhere [19].

Moreover, we documented the last haemoglobin level in the blood (g/dl) before inclusion of all tumour patients. A retest was carried out on 65 participants after a median of 4 weeks.

Study 2: ICS responsiveness for chemotherapy treatment

From April 2003 to March 2007, the Centre for Tumour Therapy at the Gemeinschaftskrankenhaus Havelhöhe, the oncological practice Öschelbronn and the oncological practice Havelhöhe carried out study 2 to capture responsiveness of the ICS questionnaire to chemotherapy treatment. Consecutively recruited breast cancer and colorectal carcinoma (CRC) patients were examined before or during adjuvant or palliative chemotherapy with mistletoe therapy examining ICS responsiveness.

The following groups were formed in the process:

  1. 1)

    Breast cancer patients who received adjuvant complementary treatment with standardized and commercially available whole plant extracts from Viscum album L. (mistletoe) as standard therapy from the first cycle of chemotherapy (B) or

  2. 2)

    The colorectal cancer (CRC) group (C) was also surveyed prior to the first cycle of chemotherapy with adjuvant mistletoe therapy.

After explanation of the procedure and obtaining informed consent, the following criteria were applied to both groups for adjuvant or initially curatively conceived or palliative chemotherapy with good general condition and a KPI ≥ 70%. The oncologically scheduled chemotherapy, radiotherapy or mistletoe therapy was not impacted or changed by the study so that this second part of the validation study only measured the changing sensitivity (responsiveness) of the instruments. Thus, study 2 is not a pharmacological study to test effectiveness of the treatment which was administered as a routine procedure, but as a sensitivity testing of the instrument.

For this purpose, the surveys were carried out 1 – 5 days prior to the start of chemotherapy (B, C), 1 – 5 days after the third cycle as well as 4 – 8 weeks after the end of chemotherapy using the ICS, CFS-D [19], State autonomic regulation aR [20] and EORTC QLQC30 [1]. For KPI, stage of cancer, surgery and chemotherapy see table 2. The data on CFS-D, State aR and EORTC are published elsewhere.

Statistics of both parts of the study

A reliability analysis of all 12 items of the ICS was carried out for all participants of study 1 with SPSS 15.0 to check for item-item and item-total-correlation of r ≥ 0.40 and a Cronbach's-α-reliability of r ≥ 0.70. The test-retest reliability was assessed with the 65 persons completing the questionnaire by Spearman's rank correlation. For all participants, we performed an orthogonal principal components analysis (rotation: varimax with Kaiser normalisation). We used the self-regulation questionnaire as a main convergence criterion because it's two dimensional scale is measuring the adaptive capacitiy. "Ability to Change Behaviour", and "Achieve Satisfaction and Well-Being" dealing with oncological disease. In addition, we performed a Spearman's rank correlation analysis for the whole sample, testing for associations between the ICS sum- and subscales on one hand and the assumed convergence criteria on the other. We assessed the discriminant validity by applying the Mann-Whitney U-test to check whether ICS sum- and subscales and self-regulation are differentiating between cancer and healthy controls, and by comparing both results. We estimated the responsiveness in measuring

  1. 1)

    chemotherapy sensitivity within the B and C group with the one-sided Wilcoxon's signed-rank test as well between first and second as second and third test-point.

Results

Part 1 of the study

Participants

59 consecutive patients with malignant conditions and 59 healthy controls were invited to participate in the study 1. In total, 114 persons agreed to participate (recruitment rate of 97%). From the 57 recruited cancer patients, we had 41 men and 16 women with a mean age of 59.3 years. Age and gender matching with the comparison group was successful (table 1).

Twenty-two patients had no metastases, 35 had a metastatic or generalized disease. The median KPI at the time of recruitment was 90%. The duration of the disease was on average 2.9 years. The mean haemoglobin (Hb) level was 12.1 g/dl (SD = 1.84). Further participant details are listed in table 2.

Analysis of reliability

All 12 items were checked: In the first step "when I felt warm I felt well" and "I had nightmares" were eliminated because of insufficient item-total correlation (0.20 and 0.32 respectively). The other 10 items fulfilled all reliability criteria:

Item-Item-correlations: r = 0.49, min – max = 0.25 – 0.84. The mean of item-variance is = 1.06 (min – max = 0.76 – 1.28). The corrected item-total correlation is:

rtr = 0.53 – 0.82. Cronbach's-α of the ICS sumscore rα = 0.91, retest-reliability rrt = 0.80 (p < 0.001) (table 4).

Principal component analysis

Primary factor analysis points to a two-principal-components model. The two-principal-components model (8 resp. 2 items) exhibits the attractive feature of unambiguousness in factor loading. Principal component 1 (inner resilience and coherence) is measured by 8 items (range: 8 – 40) explaining 44.2% of the variance, the second principal component (thermo coherence) is analysed by 2 items (2–10) which explains 23.0% of variance. The total scale explains a variance of 67.2%. In this model, the factors show a largely unambiguous item analysis pattern (table 4).

Cronbach's-α of the ICS inner resilience and coherence rα = 0.91, retest-reliability rrt = 0.74 (p < 0.001), and Cronbach's-α thermo coherence rα = 0.85, retest-reliability rrt = 0.54 (p < 0.001) (table 4).

The ICS significantly correlates with the concurrence criteria Trait aR, orthostatically-circulatory regulation, rest/activity regulation, anxiety and depression scores of the HADS-D, KPI, and with the convergence criteria self-regulation and it's subscales "achieve change in behaviour" and "achieve satisfaction" (r = 0.30 – 0.70, each with p = 0.001). Inner resilience and coherence correlates with the convergence criteria of r = 0.26–0.70 (p = 0.008), and thermo coherence of r = 0.19–0.32 (p = 0.04) (table 5). Of particular emphasis is the strong correlation between the "inner resilience and coherence" and the SRQ scale (ability to) "Achieve satisfaction" (r = 0.70), and the strong negative association with depression (r = 0.67) which is sound from a conceptual point of view.

Table 5 Correlation matrix studies 1 and 2 (first survey) of internal coherence, inner resilience and coherence, thermo-coherence with convergence criteria

The malignant group has a lower internal, inner resilience (both p < 0.001) and thermo coherence (p = 0.028) than the control group, whereas with self-regulation only "achieve satisfaction" (p = 0.012) shows a significant difference, whereas this does not hold for the subscales "achieve change in behaviour" and the total scale (p = 0.517, p = 0.079) (table 6).

Table 6 Mean values of ICS score of gender, age groups, cancer, breast cancer, colorectal cancer and healthy controls

Part 2 of the study

  1. 1)

    18 patients who were consecutively surveyed for the B section were included in the study, with one patient refusing a third questionnaire. The questionnaires of the 17 remaining patients were available at all times and could be evaluated without curtailing validity.

  2. 2)

    27 patients with CRC were surveyed for the C section before, during and after chemotherapy. 25 of these could be fully evaluated at all three stages.

ICS shows relations in varying degrees to quality of life as assessed with the EORTC (r = 0.08 – 0.71) and partly weak to moderate correlations to the symptom scales of the EORTC as fatigue or loss of appetite (= -0.53 – -0.28), but also partly no correlation at all such as with constipation etc. Of outstanding relevance is the strong correlation between "Inner Resilience and Coherence" and EORTC's "Emotional Functioning" (r = 0.73) and "Global Health" (r = 0.58) (table 5).

The pooled breast cancer group and CRC group showed a significant reduction of the ICS sum- and subscales during chemotherapy and a significant ICS increase after finishing chemotherapy (p < 0.044), with the exception of thermo coherence 4 to 8 weeks after chemotherapy (table 6). These results are consistent with the main results of the EORTC-QLQ C30 with a significant reduction of physical and cognitive functioning, and a significant increase of physical and role functioning and global health (table 7). The above mentioned results point towards a relevant correlation with quality of life and a scale sensitive to change during chemotherapy.

Table 7 Mean values of EORTC QLQ C30 functional scales of breast cancer and colorectal cancer

Discussion

We were able to develop a short inventory on internal coherence (ICS) with a 2-factor structure – with the factors 1) inner resilience and coherence and 2) thermo coherence – with good to very good internal consistencey [21] and a sufficient – good test-retest reliability. As the initial expert rating for item generation was based on a previous cancer patient symptoms list, we renounced designing the study further patient reports and interviews. The responsiveness of the ICS was tested with chemotherapy treatment:

As the decrease in quality of life, or the increase in adverse events (AE) during chemotherapy respectively is well known [22] chemotherapy sensitivity (responsiveness) in the pooled B and C group was documented. Moreover, compared to the SRQ according to Grossarth-Maticek, the ICS sum scale and subscales show a better sensitivity for tumour patients in study 1 [12]. During chemo- or radiotherapy, the 'locus of disease control' is completely externalised, and thus measures of "self-autonomy" should be low. Even after chemotherapy, a more depressive state of "self-competence" may persist in several patients, particularly those with a poorer prognosis. The scale "Inner resilience and coherence" in fact was strongly associated with emotional functioning and depression and thus is expected to be a more sensitive measure of the stressful situations, but it did not correlate with tumour stage in our data. In study 2, compared to the EORTC quality of life subscales with 42% significant test results, the ICS showed in 83% significant test results. Interestingly, the EORTC show above all chemotherapy sensitivity in physical, cognitive and role functioning and not in the scales being strongly correlated with the ICS, as emotional functioning and only at one point in the global health scale. This could be related to the individual self-management. Hence, the ICS as a scale capturing the individual skills of adaptation could be more sensitive for responsiveness as the fixed passive emotional functioning HRQOL-measure.

High ICS, including high inner resilience and coherence and thermo coherence level, are consistent with higher self-regulation, autonomic regulation, quality of life, lower depression and anxiety, along with better perception of health and quality of life (table 5), which emphasizes the salutogenetic significance. On the other hand, lower ICS points towards oncological morbidity, worse performance-index, more chemotherapeutical side effects and increase in symptoms, as well as reduced salutogenetic counter-regulation (table 4). Even if thermo coherence correlations coefficients to the convergence criteria are rather moderate until low, there is face validity that thermal comfort influence not only quality of life and a feeling of coherence [15]. There are further data showing that feeling cold and cold hands are well known distinctive side-effects under chemotherapy [23]. To what extent an accumulation of risk factors is involved remains to be clarified.

Antonovsky's Sense of Coherence Scale (SOC) is a reliable, valid and transculturally common instrument [24] which surveys long-term life orientation and beliefs, partly looking backwards, partly looking into the future, which reflect the understandability, importance and manageability of life events and stressors [8, 9]. According to Antonovsky, SOC stabilises as a trait during adolescence [6]; however, new empirical data show changes following interventions and life events [10, 25]. It has been very clearly shown that the focus of the SOC scale is not suitable for the capture of current, clinically relevant feeling and state of coherence for clinical questions in internal oncological patients, because of the very backward-looking, general style of questions and the face validity [24].

Our ICS scale refers to the previous week and queries perception of comfort and health; questions on inner balance, particularly with respect to the ability of problem solving, security and inner congruence and resilience in terms of importance and manageability, and two additional items addressing perceptions of coldness/chillness and warmth ('thermo coherence'). In the moderate correlation of the two items of the thermo coherence subscale with the inner resilience and coherence subscale and self-regulation, we recognized a first confirmation of our hypothesis that thermoregulation and coherence in cancer patients could be related. Particularly, because tolerance of cold is moderately associated with less perspiration and high level thermo coherence which could be linked with the thermo-regulatory threshold between perspiration and vasoconstriction is depending on circadian rhythm, vigilance, personality coherence and gender [26]. Hence, we decided to let both subscales integrated in the ICS scale, but this factor structure should be controlled with a larger number of patients. The recorded higher sensitivity of the ICS to differentiate between cancer patients and healthy controls as compared to self-regulation indicates a higher cancer sensitivity. To what extent the postulated cancer and treatment sensitivity of the ICS in contrast to the SOC questionnaire is cancer specific, remains to be verified in further studies.

A limitation of SOC is that the three-factor structure, as postulated by Antonovsky, could not be reproduced and factor-loading pattern are varying significantly in the different languages ([27, 28]. Moreover, the scale was mainly used and validated sociologically, socio-medically and psychiatrically [24]. As most existing studies are cross-sectional studies, Antonovsky's basic assumption that the SOC is a principal determinant of health in terms of an ability to maintain particularly mental health despite of significant 'stressors', has not yet been sufficiently verified. Even if the data generated in the process show moderate to strong negative correlation between SOC on the one hand and anxiety, depression and distress on the other hand, as well as positive correlations to quality of life and subjectively gauged health, in particular mental health, there is still controversial discussion if SOC is an independent predictor for anxiety and depression or depends on un-existence of anxiety and depression [29, 27]. In earlier prospective studies, the results were initially inconsistent [30], but now there are studies which seem to have a prognostic implication, amongst others, for cardiovascular mortality [31], for the risk of stroke [32], as well as a 46% increased prevalence of Diabetes mellitus Type 2 over a period of 17 years was associated with weak SOC [33].

Recently a large Finnish study showed a marginally higher 12-year cancer incidence with lower SOC in elderly [34]. The EPIC-Norfolk-Study has also shown that lower SOC is associated with an increased global mortality and cancer mortality [31]. These results match a cross-sectional study from Hawaii which systematically examined oncological patients with unusually long survival rates which did not differ from a control group with regards to their quality of life but only with regards to their SOC levels [7]. These results are concordant with higher life expectancy of cancer patients with higher self-regulation level as compared to matched pairs – with an additional positive effect discovered amongst those receiving complementary mistletoe therapy [35]. In fact, we can confirm strong correlations between the SRQ and the ICS and inner resilience and coherence scale and moderate with the thermo coherence scale. Despite these interesting results which indicate a positive influence of changing behaviour to reach goal and well-being orientated lifestyle in the context of salutogenesis on cancer incidence and progression, the importance of the SOC in large prospective studies has not yet been conclusively validated and requires further validation. The clinical and prospective importance of the new ICS remains to be clarified in future studies, but we intend to use it to capture more appropriately inner attitudes in palliative and disease-free cancer patients under chemo or mistletoe therapy, and to measure the influence of psychosocial support with this cancer specific individual skills of adaptation detecting tool.

There are significant limitations in our study in the lack of parallel recording of the SOC scale in the first and second part of the study. In unpublished data of our group, ICS correlates in cancer patients under treatment moderately with the SOC scales (comprehensibility: r = 0.50, meaningfulness: r = 0.49, manageability: r = 0.47 (all p < 0.05) indicating clearly the difference of the SOC, being a trait-marker and ICS as a more clinical tool referring to the last week. It must also be mentioned that the ten items of the ICS only query comprehensibility indirectly. In the second part of the study, we used a 1-side Wilcoxon test for measuring chemotherapy sensitivity of the scale because of clear hypothesis that ICS scores will decrease during chemotherapy and raise afterwards, and to minimize alpha-error due to the small patient number and because of concomitant mistletoe therapy already reducing side-effects of chemotherapy [36, 37]. Hence, we accepted a potential over-estimation of the beta-error. The correlative associations between ICS and its subscales, anxiety and depression scale are rather less strong than with the SOC; Geyer [38] discusses to what extent the SOC would be largely dependent on symptoms of anxiety and depression (♂: r = 0.42, ♀: r = 0.53 – 0.85). Nevertheless, further studies should clarify if ICS is more than simply the absence of anxiety and depression.

Conclusion

The development of an Internal Coherence Scale (ICS) was achieved with good to very good reliability. First validity tests showed good convergence (Self-regulation), concurrence and discriminant validity between cancer patients and healthy control and confirmed a good responsiveness of the ICS during cancer treatment. Therefore, ICS could be an interesting instrument to capture the feeling of inner coherence and resilience among cancer patients. Further studies to confirm the scale structure and clinical relevance are required.