Background

In a recent report on the global economic impact of dementia [1], costs of dementia are estimated to be slightly over US$600 billion pro year worldwide. Costs include direct medical costs, direct costs of social care and costs attributed to informal care. As a consequence of the growing number of dementia patients, costs will rise in the future. Alzheimer’s Disease International has tentatively estimated an 85% increase in costs in 2030, based only on predicted increases in the number of people with dementia. As a consequence, there is a strong plea to invest in research and the development of cost effective approaches that meet the needs of people with dementia and their caregivers across the course of the illness.

Most people with dementia live at home and are cared for by their spouses, children or other family members. These caregivers play a crucial role in the quality of life and quality of care of their family members. Caring for a spouse with dementia can be a highly stressful experience associated with negative caregiver outcomes such as high rates of burden, psychological morbidity, depression and poorer immune function [2, 3]. Different kinds of interventions have been developed for caregivers of people with dementia [4–7]. The majority of these interventions consists of psycho-educational programs providing information on dementia and the consequences for daily living, how to cope with related problems, which services are available and how to get help.

Research has shown that particular types of interventions are effective. One of the main characteristics of effective interventions is a psychological rather than purely educational approach [8]. Psychological treatment is aimed at improving caregivers’ abilities to cope with problem behavior or stressful situations or to enhance communication skills and asking support from others [9]. A recent review shows that psychological therapies and psychosocial interventions may be a potentially cost effective approach to improve outcomes and quality of life in both people with dementia and their family caregivers [10].

Several meta-analysis of randomized controlled trials on the effectiveness of internet interventions for depression or anxiety focusing on other target groups such as younger adults with depression, show that interventions are effective [11–14], even more if therapist support is part of the intervention [15]. There is also growing evidence that internet-based interventions are cost effective [16]. Family caregivers may favor internet interventions instead of meeting in a group or meeting with a professional face-to-face, due to lack of time or preferences concerning privacy. Caregivers may also be unwilling to visit a mental health care institute for themselves because in their view they are not the ones who need help. Given the growing internet sophistication of middle aged and older adults, it is expected that the number of potential users of internet interventions will grow substantially.

Until recently internet-based interventions were not developed for family caregivers of people with dementia. In November 2008, the innovative eMental Health intervention for family caregivers of people with dementia, called ‘Mastery over Dementia’, was launched in the Netherlands (for an English demo: http://www.masteryoverdementia.com). In this paper the design of the RCT to evaluate the effectiveness and cost-effectiveness of ‘Mastery over Dementia’ for caregivers of people with dementia will be described. The specific research questions are:

  1. 1.

    Is ‘Mastery over Dementia’ superior compared to ‘care as usual’ in terms of a clinically significant reduction in depressive symptoms, symptoms of anxiety, role overload and caregiver perceived stress?

  2. 2.

    Are effects maintained up to six months after ending the internet intervention?

  3. 3.

    Which caregivers respond best to the intervention compared to others?

  4. 4.

    Is the internet intervention cost effective from a societal perspective compared to the comparison group?

Methods and design

To evaluate the effectiveness of ‘Mastery over Dementia’, we carry out a pragmatic randomized control trial (RCT). In the RCT there are two parallel groups. The experimental condition in which caregivers take part in the intervention (Mastery over Dementia) will be compared with a comparison condition in which caregivers receive a ‘minimal intervention’. The study protocol, information brochure and informed consent procedure were approved by the Medical Ethics Committee (METIGG, CCMO: NL27434.097.09).

Recruitment

Participants are recruited in several ways: the website itself, the monthly digital newsletter of the Alzheimer’s Society in the Netherlands, leaflets at meetings of Alzheimer Cafes and information letters to memory clinics and other relevant care institutions. Participants are invited to fill in a first short questionnaire on the website. This questionnaire serves as a screening tool on the basis of which can be decided if participants are suitable for treatment. Caregivers will be included with a score > 4 on the Center for Epidemiological Studies-Depression scale, or a score > 3 on the HADS-A, or a minimum score of 6 on a one item burden scale ranging from 0-10. Caregivers with high scores on the CES-D and the HADS-A or having suicidal thoughts, were first contacted by an elderly care physician.

Randomization

Randomization into two groups (experimental group and comparison group) takes place after assessment. Before randomization participants are stratified on the basis of two factors (sex: male/female and relationship: spouse/other). As a method for randomization block randomization with variable sizes is used. The allocation schedule is made with a computerized random number generator by an independent researcher and is unknown to the investigators of this study.

Interventions

Experimental condition

The intervention ‘Mastery over Dementia’ was developed by the Netherlands Institute of Mental Health and Addiction in collaboration with a specialized Dutch health care provider (Geriant) and the Alzheimer’s Society in the Netherlands (Alzheimer Nederland) [17]. The program offered is a combination of evidence-based support strategies: psycho-education, cognitive behavioral therapy, problem solving therapy and assertiveness training. Relaxation is also incorporated. During the intervention, caregivers are supported on-line by a psychologist (coach) who gives feedback on the exercises sent by the caregivers. The coach has been trained in cognitive behavioral therapy.

‘Mastery over Dementia’ consists of eight lessons and a booster session (follow-up). Each lesson consists of information, practice rehearsal and some homework. Themes covered in the course are, for example:

  • coping with behavioral problems

  • arranging help from others

  • non-helping en helping thoughts

  • communicating problems

Comparison group

Caregivers in the comparison group receive a minimal intervention. There is no contact with a coach. The intervention consists of eBulletins with practical information about caring for someone with dementia. The bulletins are sent by mail according to a fixed schedule. Topics of the bulletin do not overlap with the content of ‘Mastery over Dementia’. Topics covered in the bulletins include:

  • Driving and dementia

  • Holiday breaks

  • Medication and dementia

  • Activities throughout the day

  • Grieving and dementia

  • Safety measures in the home

Measures and measurement

There are 3 measurements in both groups. The first measurement is at baseline (pretest). The second measurement takes place halfway during the intervention course (after the fourth lesson) or after the receipt of the fourth bulletin (comparison group). This is approximately at 3 months after baseline. The third measurement (post-test) is conducted directly after the intervention (about 6 months after baseline). Additional measurements for the experimental group are at three months (9 months after baseline) and six months after completion (12 months after baseline). All measurements are self-report measures and are administered through the Internet. In both conditions automated emails are sent to participants asking them to fill in the questionnaires. This is repeated when participants do not respond within a week, and for a second time after two weeks. If participants do not answer a research assistant contacts them by phone.

Outcome measures in the RCT

For an overview of the instruments see Table 1.

Table 1 Overview of instruments (measures)
Full size table
Primary outcome measure: depressive symptoms

Depressive symptoms are measured with the Centre for Epidemiological Studies Depression scale (CES-D). The CES-D is a widely used self-report measure for the screening of depressive symptoms, and has also been used in research on caregiving. The Dutch version of the CES-D [18] is used in this study. It consists of 20 items for which subjects rate the frequency of symptoms during the past week. Scores range from 0 (rarely or none of the time present [less than 1 day]) to 3 (most or all of the time present [5-7 days]). The total score range is 0–60. Items represent major components of depressive symptomatology such as depressed mood, feelings of guilt and worthlessness, feelings of helplessness and hopelessness, psychomotor retardation, loss of appetite, and sleep disturbance. A shortened version of the CES-D on internet (not used in this study) was found to be reliable in an adult population [19].

Secondary outcome measure: anxiety symptoms

The 7-item anxiety subscale (Dutch version) of the Hospital Anxiety and Depression Scale [20] is used to measure the severity of anxiety symptoms. The Hospital Anxiety and Depression Scale (HADS) is an extensively used, brief self-report screening scale to investigate the prevalence of depression and anxiety symptoms. The anxiety subscale consists of 7 items rated on a scale ranging from 0 (not at all) to 3 (a great deal of the time). Total score ranges from 0 to 21 with higher scores indicating more anxiety. The Dutch version of the HADS shows good reliability in normal and clinical Dutch samples [21].

Secondary outcome measure: role overload

Feelings of role overload are measured by means of the Self Perceived Pressure from Informal Care scale (SPPIC) [22]. The SPPIC consists of 9 items, answers vary from 0 (totally disagree) to 4 (totally agree). The SPPIC is a one-dimensional hierarchical scale; higher scores mean more perceived pressure. The items are summed on the basis of dichotomized scores (cut off: totally disagree and disagree = 0; other answers = 1). Total scores range from 0 – 9. The original study [23] shows that reliability is good and that perceived pressure did not differ for male and female caregivers, and for spouse and non-spouse caregivers.

Secondary outcome measure: caregiver perceived stress

The Dutch version [24] of the Revised Memory and Behavioral Problem Checklist (RMBPC) [25] is used for measuring caregiver perceived stress. The questionnaire lists 24 items reflecting a variety of problems caregivers can encounter. Respondents have to rate the frequency of the occurrence of the specific behavior from 0 (never) to 4 (always). Each item rated with a score of 1 (seldom) of higher, is presented again raising the question how much people are stressed by the occurrence of the behavior (4-point scale from not at all stressed to very much stressed). The Caregiver Reaction Score is calculated as a mean score for all items together and additionally can be divided in separate reaction scores on depressive behavior (9 items), disruptive behavior (8 items) and memory-related behavioral problems (7 items). Overall scale reliability is good [24].

Additional measures in the RCT

Perceived control

Perceived control of events and ongoing situations will be assessed using a translated and abbreviated 5-item version of the Pearlin Mastery Scale. The original scale has 7 items regarding how much an individual perceives having control over things in his or her life. The scores per item vary from 0 (totally disagree) to 4 (totally agree). The Mastery Scale [26] has good psychometric properties. Compared to the original questionnaire, in the abbreviated version two items phrased in a positive way (‘I can do just about anything I really set my mind to’ and ‘What happens to me in the future mostly depends on me’) are left out. This abbreviated version shows good reliability [27]. Items are summed for a total mastery score (ranges from 0 to 20) with lower scores indicating greater perceived control.

Sense of competence

Caregiver’s sense of competence will be assessed by means of the Short Sense of Competence Questionnaire (SSCQ) [28]. The SSCQ consists of 7 items. Responses are rated on a 5-point scale with possible answers, ranging from totally agree (0) to totally disagree (4). The questionnaire has three dimensions: consequences for personal life of the caregiver (2 items), satisfaction with role of the caregiver themselves (2 items) and satisfaction with role of the person with dementia (3 items). The items are summed on the basis of dichotomized scores (cut off: totally disagree and disagree = 1; other answers = 0). Total score range from 0 – 7.

Frequency of reported behavioral problems

The 24 items of the Revised Memory and Behavioral Problem Checklist (RMBPC) [25] are used to make an inventory of the number of problems family caregivers encounter. Respondents have to rate from 0 to 4 the frequency of the occurrence of the specific behavior (0 = never; 1 = seldom; 2 = regularly; 3 = often; 4 = always). The total number of behaviors problems (0 – 24) will be calculated as well as the total mean score (Behavior Frequency Score). The Behavior Frequency can be subdivided into scores on Depression (9 items), Disruptive behavior (8 items) and Memory-related problems (7 items).

Other variables that may act as confounders or modifying variables will be measured. This concerns the following demographic characteristics of caregivers: sex, age, relationship (spouse, child or other), level of education and living arrangement (living together with care recipient). Relevant patients characteristics are: sex, age, duration of symptoms (as perceived by caregiver), functional status (assessed by means of a Dutch translation of a short version of the IQCODE [29]) and living condition (independently or within care facility).

Outcome measures in the economic evaluation

For an overview of the instruments see Table 1.

Quality of life

Quality of life will be measured using the 6-item self report instrument EQ-5D+C [30]. The EQ-5D+C is an extended version of the EuroQol [31] which measures health related quality of life and consists of five dimensions (mobility, self-care, main activity, pain and mood). The EQ-5D+C adds ‘cognition’ as a sixth dimension. Each dimension is rated as causing 'no problems', 'some problems' or 'extreme problems'. The EuroQol valuations appear to have good test-retest reliability [32]. QALYs will be calculated using the Dutch EuroQol tariff to estimate utilities [33].

Health care utilization

An adapted version of the iMTA Questionnaires on Costs Associated with Psychiatric Illness (TIC-P) will be used to measure health care utilization and productivity losses [34]. In this study both the direct costs related to the person with dementia with dementia and the direct costs related to the situation of the family caregivers themselves are measured. Direct costs will include the number of consultations with health care providers (e.g. general practitioner, physical therapist, psychologist, medical specialist, etcetera), medication, and admissions to hospitals and other institutions. Indirect costs are defined as the productivity lost due to absenteeism from paid and unpaid work and reduced efficiency at work (presenteeism).

Time spent on caregiving

This is measured by four questions tapping several main areas of caregiving (household tasks, personal hygiene, transportation outside, finances and administration). Caregivers are asked to estimate to total numbers of hours in the past week. In addition to this we also collect information on the availability of other informal caregivers and volunteers and the amount of time these others spent on caregiving for the person with dementia. Total amount of time the family caregiver spends on providing care and also the total amount of time spent by other informal caregivers or volunteers is calculated.

Sample size

Symptoms of depression are the primary outcome measures and are used as starting point for the power calculations. A standardized effect size (Cohen's d) of 0.50 is considered a relevant treatment effect. Assuming an alpha of 0.05 and a statistical power (1-Beta) of 0.80 in a two-tailed test, we need 63 respondents in each of the conditions. Overall, we need 126 respondents to complete the study in total. Because we expect a minimum of 25 percent of caregivers to drop out during the data collection, we will recruit at least 175 caregivers. The numbers are calculated in Stata 7.0 (StataCorp 2001).

Statistical analysis

All analyses in the RCT-study will be conducted according to the intention to treat principle. Missing data on follow-up measurements will be imputed using regression imputation. To examine differences between the outcomes for experimental and comparison group, paired t-tests will be conducted and estimates of effect sizes will be calculated. By using multiple regression analyses, we can correct for possible confounders. With a ‘generalized estimated equations’ (GEE) analysis the research question regarding the maintenance of the effectiveness of the intervention will be answered. In addition, profiles of caregivers who respond best to the intervention will be described by means of a multiple regression analysis which also contains modifying variables (modifier analysis). All analyses will be conducted using SPSS for Windows, version 19.

Economic analyses

This economic evaluation will involve both a cost-effectiveness analysis (CEA) and a cost-utility analysis (CUA). Incremental cost-effectiveness ratios will be calculated by dividing the difference in total costs between conditions by the difference in average effect size. Because we calculate costs over a period of six months, correction for inflation is not necessary. Missing data on follow-up measurements will be imputed using multiple imputation. Bias-corrected and accelerated bootstrapping with 5000 replications will be used to calculate 95% confidence intervals around the mean difference in total costs between the treatment groups. Bootstrapping will also be used to estimate the uncertainty surrounding the ICERs which will be graphically presented on cost-effectiveness planes. Cost-effectiveness acceptability curves and net monetary benefits will also be calculated. Cost-effectiveness acceptability curves show the probability that collaborative care is cost effective in comparison with usual care for a range of different ceiling ratios thereby showing decision uncertainty. Sensitivity analyses will be carried out to ascertain the robustness of the findings under different scenarios, e.g. under varying values of key-variables.

Discussion

This study assesses the effectiveness and cost-effectiveness of an internet intervention for family caregivers of people with dementia. In the context of the fast growing number of people with dementia in years to come, there is an urgent need to develop cost-effective approaches that meet the needs of people with dementia and their family caregivers across the course of the illness. Some family caregiver may apply for help in the beginning of the course of the illness, others may use the intervention in a later stage. The potential effect of the internet intervention may act immediately or help people to keep on caring and prevent them from developing (more) health problems.

The RCT-study is conducted in the practical setting of a health provider who is specialized in dementia care and offers case management and a variety of support strategies for persons with dementia and family caregivers. Because internet delivered intervention is highly structured and leaves little room for the therapist to adapt it, in practice the structure remains intact without major adaptation [35]. Important advantage of such a pragmatic study is that results of the study have a high level of generalizibility.

As is the case with internet therapy (or research studies in this domain) in general [36], we expect participants to be more highly educated, with a high proportion of them having a university degree. It is also rather common that clients drop out of (research into) internet therapy. In a recent review on dropout from internet-based treatment for psychological disorders an average rate of 31% was found [37]. Evidence on any specific variables that may make an individual more likely to drop out is currently limited [37]. In this study we expect some family caregivers to drop out for specific disease related reasons like admission to an nursing home or death of the person with dementia. All together this may have a negative effect on the generalizability.

Primary outcome measure in the RCT is severity of depressive symptoms of the family caregiver. Anxiety symptoms, feelings of burden and caregiver stress are secondary outcomes. In a review article about consensus on outcome measures for psychosocial intervention research in dementia care, some recommendations are made for use of specific measures [38]. It is suggested that if depression is the primary intervention target, the CES-D has potential (although it requires further validation across Europe). Also the HADS is mentioned as an useful instrument. With regard to measuring feelings of burden, authors recommend the use of the Zarit Burden Interview (ZBI). This scale has been extensively used in intervention studies, however, only a few studies show significant changes on this scale. In this study we used the Self Perceived Pressure from Informal Care scale (SPPIC) which focuses on the aspect of role overload. To measure caregiver perceived stress we use the Revised Memory and Behavioral Problem Checklist (RMBPC).

In contrast to the CES-D and the HADS, both the SPPIC and RMBPC are not often used in a web-based manner. This means that scale properties like reliability may be influenced. However, research has shown that in the case of two scales measuring depression no statistically significant differences between paper and internet-based administration were found [39]. It is recommended that format of administration should not be changed when repeated measurements are made. Main advantage of web-based administration [40] is completeness and reliability of data (no missing values, no data entry errors). Other advantages are time flexibility for the family caregivers and low costs.

In conclusion, we expect that this study can add important information to the knowledge base on the effectiveness and cost-effectiveness of interventions to reduce psychological symptoms in informal caregivers of dementia persons with dementia. Given the steep rise in the number of people with dementia and the crucial role family caregivers play in caring for them, interventions that reach family caregivers at an early stage are essential [41].