A randomized controlled trial on errorless learning in goal management training: study rationale and protocol
- 6.5k Downloads
Many brain-injured patients referred for outpatient rehabilitation have executive deficits, notably difficulties with planning, problem-solving and goal directed behaviour. Goal Management Training (GMT) has proven to be an efficacious cognitive treatment for these problems. GMT entails learning and applying an algorithm, in which daily tasks are subdivided into multiple steps. Main aim of the present study is to examine whether using an errorless learning approach (preventing the occurrence of errors during the acquisition phase of learning) contributes to the efficacy of Goal Management Training in the performance of complex daily tasks.
The study is a double blind randomized controlled trial, in which the efficacy of Goal Management Training with an errorless learning approach will be compared with conventional Goal Management Training, based on trial and error learning. In both conditions 32 patients with acquired brain injury of mixed etiology will be examined. Main outcome measure will be the performance on two individually chosen everyday-tasks before and after treatment, using a standardized observation scale and goal attainment scaling.
This is the first study that introduces errorless learning in Goal Management Training. It is expected that the GMT-errorless learning approach will improve the execution of complex daily tasks in brain-injured patients with executive deficits. The study can contribute to a better treatment of executive deficits in cognitive rehabilitation.
(Dutch Trial Register): http://NTR3567
KeywordsGoal management training Errorless learning Executive deficits Acquired brain injury
Acquired brain injury
Behavioural assessment of the dysexecutive syndrome
Cognitive failures questionnaire
Category fluency test
Executive function index (Dutch version)
Executive observation scale
Goal attainment scaling
Goal management training
(Instrumental) Activities of daily living
Letter fluency test
National adult reading test
RAND-36 item short form health survey
- RBMT III
Rivermead behavioural memory test-third edition
Statistical package for the social sciences
Specific measurable attainable reasonable timely
Test for attentional performance
- WAIS III
Wechsler adult intelligence scale-third edition
Brain-injured patients referred for outpatient rehabilitation frequently experience difficulties with planning, problem solving, reasoning and goal directed behaviour [1, 2, 3]. These difficulties can be characterized as executive deficits [1, 4, 5, 6] and compromise daily functioning and even functional independence [7, 8]. More specifically, dysfunction of these higher-level control processes leads to real-life everyday disorganization  and even subtle executive deficits often provoke difficulties in the performance of everyday-life tasks . Because of the high prevalence of executive dysfunction in the brain-injured population  and its considerable impact on everyday life, effective treatment is warranted.
Goal management training
Errorless learning in goal management training
In errorless learning, the occurrence of errors during the learning phase is prevented in contrast to standard learning, or trial and error learning, in which errors may occur naturally. Fillingham et al.  described the mechanism of errorless learning using the Hebbian learning model . Learning is described as a strenghtening of the connection between neurons that fire together. If a stimulus is followed by a reponse, the subsequent pattern of neural activitivity will be more likely to be activated again in similar situations. This means that the same response can be expected, even if it is an incorrect action . If an errorless learning approach is applied in this process, the activation of incorrect neural patterns will be prevented and erroneous actions will not be evoked.
In clinical practice, several errorless learning techniques can be applied during training of complex daily tasks. Task steps can be taught using cue cards, (feed-forward) verbal instructions and visual demonstration or modeling by the trainer [23, 24, 25]. Several studies have shown that the quality of task performance after errorless learning is superior compared to errorful learning in patients with cognitive impairments of different aetiologies [26, 27, 28, 29, 30, 31, 32]. Most studies on errorless learning have focussed on patients with memory deficits. In these studies the efficacy of errorless learning is explained by the mechanism that errors are not consciously corrected because of impairments in explicit memory, but implicitly consolidated through a relatively intact implicit memory system [33, 34, 35]. However, other studies do not agree with this hypothesis and describe the benefits of errorless learning by residual explicit memory processes [36, 37]. Another mechanism that may explain the advantage of errorless learning in patients with executive disorders is that errors are not detected due to a failing error-monitoring system [38, 39] and the inability to adjust behaviour on the basis of feedback . By preventing the occurrence of errors in learning the execution of a task, both these systems are circumvented.
The main aim of the current study is to examine the efficacy of Goal Management Training using an errorless learning approach in the treatment of executive impairments in patients with acquired brain injury, focusing on (instrumental) activities of daily living ((i)ADL). Both GMT and errorless learning are two well investigated instructional methods of proven effectiveness. However, to date they have never been combined. Using an errorless learning approach in GMT may optimize both the acquisition of the GMT algorithm and the execution of complex tasks in daily living. To examine the efficacy of these combined techniques, (i)ADL task performance will be evaluated using a standardized observation scale taking correct, ineffective and missing steps into account . The primary hypothesis is that combining errorless learning and GMT will result in a more efficacious intervention, when applied to (re)learning daily tasks in patients with executive disorders after acquired brain injury. This study may contribute to a better treatment of disorganized behaviour after brain injury and improve the cognitive rehabilitation of patients with executive disorders. From a patient perspective, it might consistently contribute to enhance the functional independence of brain-injured patients.
To evaluate the efficacy of GMT in which errorless learning is integrated, this approach will be compared with conventional GMT treatment in which an errorful approach is used. This comparison will be investigated in a double blind randomized controlled trial that is registered at the Dutch Trial Register (No. NTR3567). The Medical Review Ethics Committee region Arnhem-Nijmegen approved the study (No. NL38019.091.11).
Participants and setting
The study population consists of brain-damaged patients referred for outpatient cognitive rehabilitation. Participants eligible for the study must have executive disorders due to acquired brain injury (ABI) of non-progressive nature (i.e. traumatic brain injury, stroke) in the chronic phase of the illness. Executive deficits will be assessed by an extensive neuropsychological examination.
Non-progressive acquired brain injury;
Minimal post-onset time of 3 months;
Being in outpatient rehabilitation;
Having executive deficits, as established by neuropsychological examination;
Living independently at home;
Age: 18–70 years at onset.
Inability to speak/understand the Dutch language;
Severe premorbid psychiatric problems;
Severe cognitive comorbidity.
Patients will be recruited from the Rehabilitation Medical Centre Groot Klimmendaal in Arnhem, the Netherlands and the outpatient rehabilitation clinic for brain injured patients and the department of Neurorehabilitation of the Sint Maartenskliniek in Nijmegen, the Netherlands. In the course of 18 months 64 participants will be recruited.
After fulfilling the inclusion criteria and obtaining the signed informed consents, participants will be randomly assigned to GMT with an errorless learning approach (experimental treatment) or to conventional GMT (treatment as usual) using trial and error learning.
Content of GMT sessions for both treatment arms
Providing information about training;
Providing information about cognitive functioning after acquired brain injury in general with an emphasis on executive impairments;
Increasing awareness of individual executive dysfunction;
Preparing the setting of two individual treatment goals
Setting two individual chosen treatment goals (i)ADL tasks);
Filling out the Goal Attainment Scale forms for each treatment goal
Defining steps concerning treatment goal 1 using cue cards and other errorless learning techniques
General information about GMT and the GMT algorithm
Defining steps concerning treatment goal 2 using cue cards and other errorless learning techniques
Filling out GMT scheme by participant concerning treatment goal 1
Performance of the steps concerning treatment goal 1 using errorless learning techniques
Filling out GMT scheme by participant concerning treatment goal 2
Performance of the steps concerning treatment goal 2 using errorless learning techniques
Performance of treatment goal 1 according to the GMT algorithm
Integrating the steps of treatment goal 1 into the GMT algorithm using errorless learning techniques;
Performance of treatment goal 2 according to the GMT algorithm
Performance of treatment goal 1 according to the GMT algorithm using errorless learning techniques
Integrating the steps of treatment goal 2 into the GMT algorithm using errorless learning techniques;
Improvement of GMT schemes concerning one or both of the treatment goals and/or practicing performance of one or both of the treatment goals
Performance of treatment goal 2 according to the GMT algorithm using errorless learning techniques
GMT-errorless learning condition
The experimental treatment consists of GMT with an errorless learning approach, i.e., both the acquisition and application of GMT will be taught using error controlling methods. This implies active guidance from a therapist to prevent the occurrence of errors or guessing. Therefore, errorless learning techniques, such as verbal instructions, modeling and cue cards will be used, as well as written instructions of the chosen (i)ADL tasks. After the two tasks have been subdivided into multiple steps and have been rehearsed verbally during sessions 3 and 4, the actual execution of these steps is practiced in sessions 5 and 6 of the treatment. In these sessions cues will be faded after successful execution of the steps (i.e., without hesitation or errors). In sessions 7 and 8 the patient will be taught to check after each task step if the action was performed correctly and if it has led to the planned (subordinate) goals. ‘Checking’ is part of the final stage of the GMT algorithm and therefore both treatment goals will be fully integrated into the GMT algorithm and errorless execution of both complex tasks according to the GMT algorithm will be practiced.
GMT-trial and error learning condition
In the conventional GMT errors are allowed to occur. Patients will learn to use the GMT algorithm and the performance of the tasks using trial and error learning. In this condition the therapist is not required to prevent errors during the application of the GMT strategy, but he/she only provides feedback in response to errors (i.e. afterwards). Also, therapists will not provide clues as how to solve problems and will not actively prompt or guide the execution of tasks. After having chosen two (i)ADL tasks in sessions 1 and 2, session 3 consists of a general description of the GMT algorithm by the therapist. In sessions 4 and 5 the participant is asked to define the task steps and- complete the GMT schemes for both treatment goals. The therapist will not help in defining the task steps and the main aim is to motivate the participant to complete the schemes. If errors occur, the therapist will not intervene, and the participant will have to detect these during the training. In sessions 6 and 7 the actual performance of the (i)ADL tasks will be practised, again using the above described trial and error approach. The participant will be motivated to actively practice performance and to seek solutions in the case of problems. Session 8 is again devoted to the execution of the tasks and to eventually improve the execution of task steps or the previous completed GMT schemes.
The primary objective of this investigation is to examine the efficacy of a combined errorless learning and GMT intervention for the treatment of executive problems in patients with acquired brain injury (ABI). These patients are in the chronic phase of their illness and the study will focus on individually chosen complex daily tasks ((i)ADL), such as cleaning a bathroom, processing mail or preparing a meal. The hypothesis is that brain-injured patients will (re)learn performance of (i)ADL tasks more efficiently if an errorless learning method is used. That is, more task steps will be performed correctly and in the right sequence and less irrelevant and missing steps will be present. Consequently, more goals and sub goals will be attained by applying errorless learning in GMT.
Recruitment- and outcome variables
Primary outcome measure
(i)ADL task performance
Standardized scale evaluating task steps
Secondary outcome measure
Goal attainment scale
Brixton spatial anticipation test
Category fluency test
Go/No-go task, subtest TAP
Letter fluency test
Letter number sequencing, subtest WAIS III
Modified six elements test
Zoo map test, subtest BADS
Rivermead behavioural memory test-third edition
Attention & Concentration
Alertness task, subtest TAP
National adult reading test (Dutch version)
Subjective cognitive functioning
CFQ (Cognitive failures questionnaire)
DEX (Dysexecutive questionnaire)
Self-reported executive functioning
EFI-NL (Executive function index)
Observed executive functioning
EOS (Executive observation scale)
Quality of life
RAND 36-item short form health survey
A secondary outcome measure will be goal attainment using Goal Attainment Scaling (GAS) . GAS is an individualized method to evaluate the extent to which individual treatment goals are achieved by defining several levels of outcomes (‘as expected’, (much) more than expected, (much) less than expected). GAS is scored in a standardized way to allow statistical comparisons between individual treatment goals and is widely used in rehabilitation [47, 48]. During session 2, GAS schemes for both treatment goals will be completed by the trainer in cooperation with the participant. During the post-treatment measurement, two GAS scores will be obtained, one by the patient and one by the trainer.
Additional study parameters
Questionnaires will be administered to measure several aspects of executive functioning. The Dysexecutive Questionnaire (DEX) , both the patient and the proxy version, will be used for the assessment of dysexecutive behaviour. Self-reported executive functioning will be measured using the Dutch version of the Executive Function Index (EFI-NL) . The Executive Observation Scale (EOS) (based on Pollens ), completed by a proxy, will be used as an observation measure for executive function. The Cognitive Failures Questionnaire (CFQ)  will assess self-reported subjective cognitive complaints in general. Quality of life will be determined using the RAND 36-item Short Form Health Survey (RAND-36) .
After the second session, in which two individual treatment goals ((i)ADL tasks) are established and the GAS schemes are completed by the trainer in cooperation with the participant, the baseline measurement will take place. During this assessment execution of both treatment goals will be filmed to secure the blind nature of the design. The recorded performance will be assessed by an independent research assistant using the standardized scale to guarantee blinding of condition.
After treatment, (i)ADL task performance will be assessed again by filming and scoring task performance. The previous completed GAS schemes will be scored by participant and by trainer to evaluate goal attainment. The questionnaires and neuropsychological assessment, using parallel versions of the same tests, will be administered after treatment as well, to control for nonspecific recovery. The data gathered with the questionnaires and the neuropsychological tests provide measures for change in insight, executive complaints, subjective and objective executive functioning for moderator analyses, to examine possible determinants for treatment success.
Determination of the sample size for this study is based on data from a RCT examining the effects of a structured 6-week Goal Management Training . In each group 32 participants are required to detect an effect size of d = .6 with a power = .80 and α. = 05. These estimated sample sizes are comparable with other studies evaluating the efficacy of different types of GMT [17, 54].
Randomization and blinding
Allocation of participants to either condition will be established using a computer generated block randomization procedure (block size n = 4) without stratification. The written information to inform patients about the study only mentions that two types of GMT will be compared. To achieve participant blinding, no information will be given about specific differences between the two conditions. Assessor blinding will be achieved by filming the (i)ADL task performance of the participants. All hints of treatment condition will be avoided and performance will be scored by research assistants who are not involved in delivering GMT.
All data will be analyzed with IBM SPSS 19. The normality of all variables will be checked and corrected for, if necessary. The performance on the neuropsychological tests will be compared with normative data and corrected for age and education. Descriptive statistics of relevant variables will be obtained and compared for the two treatment arms using analysis of variance.
To evaluate the efficacy of GMT-errorless learning compared to conventional GMT with trial and error learning, pre- and post training data will be analyzed using a 2 × 2 repeated measure analysis of variance (General Linear Model) with treatment condition (GMT-errorless learning and conventional GMT) as between-subject factor and measurement (pre- and post-treatment) as within-subject factor. The dependent variable will be the standardized scale score (quantitative). The same analysis will be done for the secondary outcome measure, the GAS scores. Appropriate post-hoc tests will be performed and effect sizes (partial eta-squared) will be computed. Moreover, correlations will be computed between moderator variables (questionnaires and neuropsychological tests) and treatment effects (difference score: post treatment minus baseline).
The background variables of the participants in both treatment conditions are expected to be comparable (age, education level, estimation IQ) because of the randomization procedure. In case of significant differences, appropriate statistical adjustment for confounding variables will be performed (ANCOVA). All statistical tests will be two-tailed, alpha set at 0.05.
Both Goal Management Training and errorless learning are two methods that have been separately well studied and shown to be effective. Up to now however, the two methods have never been combined. Combining an errorless learning approach with GMT is expected to optimize the acquisition of the GMT algorithm and improve the performance of complex daily tasks in brain-injured patients with executive deficits. Consequently, the efficacy of the intervention is increased, which may contribute to functional independence of patients with acquired brain injury. Not only does the combination of methods provide an evidence-based intervention for clinical practice, the present study may also contribute to more insight into the underlying mechanisms of errorless learning. Previous studies investigating errorless learning have often focussed on patients with profound memory impairments, such as patients with Alzheimer’s disease or Korsakoff’s syndrome [26, 30]. The assumption was that due to a dysfunctional explicit memory system errors were not consciously corrected and implicitly consolidated . However, the beneficial effects of errorless learning may also be related to a failing error monitoring system. That is, the inability of patients with executive dysfunction to detect errors . The current study proposal focuses on patients with primarily executive impairments in whom the presence of memory impairments is less prominent. This suggests that explicit memory is relatively spared in these patients, whereas their error-monitoring system is failing. As a result, the current study may contribute to a better understanding of these two underlying mechanisms of errorless learning.
Previous studies evaluated GMT used paper-and-pencil tasks  or fixed (i)ADL tasks, such as meal preparation  and financial management . A strength of this study is that participants will choose their own individual (i)ADL tasks that will be (re)learned during the training. Individual goals correspond to individual lifestyles and demands and may therefore provide a more fitting contribution to daily functioning and enhance functional independence of the participants.
In summary, the aim of the study is to examine the efficacy of Goal Management Training combined with an errorless learning approach as a treatment of executive problems in patients with acquired brain injury in the chronic phase, focusing on execution of complex daily-life tasks. This study could contribute to a better treatment of executive deficits in cognitive rehabilitation.
Current study status
The errorless learning in Goal Management Training trial has started recruitment from June 2012.
The study is funded by the National Initiative Brain and Cognition (NIHC, grant # 056-11-011). This quick-result project is embedded in the pillar “The Healthy Brain, Program Cognitive Rehabilitation”.
- 2.Lezak MD, Howieson DB, Bigler ED, Tranel D: Neuropsychological assessment. 2012, New York: Oxford University PressGoogle Scholar
- 6.Shallice T: Philosophical transactions of the royal society of London series B: biological sciences. Volume 298. Specific impairments of planning. 1982, London: The Royal Society, 199-209.Google Scholar
- 13.Robertson IH: Goal management training: a clinical manual. 1996, Cambridge: PsyConsultGoogle Scholar
- 14.Fish J, Evans JJ, Nimmo M, Martin E, Kersel D, Bateman A, Wilson BA, Manly T: Rehabilitation of executive dysfunction following brain injury: “content-free” cueing improves everyday prospective memory performance. Neuropsychologia. 2007, 45: 1318-1330. 10.1016/j.neuropsychologia.2006.09.015.CrossRefPubMedGoogle Scholar
- 17.van Hooren SA, Valentijn SA, Bosma H, Ponds RW, van Boxtel MP, Levine B, Robertson I, Jolles J: Effect of a structured course involving goal management training in older adults: a randomised controlled trial. Patient Educ Couns. 2007, 65: 205-213. 10.1016/j.pec.2006.07.010.CrossRefPubMedGoogle Scholar
- 19.Baddeley A: Implicit memory and errorless learning: a link between cognitive theory and neuropsychological rehabilitation?. Neuropsychology of memory. Edited by: Squire LR. 1992, New York: Guilford Press, 309-314. 2Google Scholar
- 21.Hebb DO: Distinctive features of learning in the higher animal. Brain mechanisms and learning. Edited by: Delafresnaye JF. 1961, Oxford: Blackwell, 37-46.Google Scholar
- 24.Voigt-Radloff S, Leonhart R, Rikkert MO, Kessels R, Hull M: Study protocol of the multi-site randomised controlled REDALI-DEM trial-the effects of structured relearning methods on daily living task performance of persons with dementia. BMC Geriatr. 2011, 11: 44-10.1186/1471-2318-11-44.CrossRefPubMedPubMedCentralGoogle Scholar
- 27.Dechamps A, Fasotti L, Jungheim J, Leone E, Dood E, Allioux A, Robert PH, Gervais X, Maubourguet N, Olde Rikkert MG, Kessels RP: Effects of different learning methods for instrumental activities of daily living in patients with Alzheimer’s dementia: a pilot study. Am J Alzheimer Dis Other Demen. 2011, 26: 273-281. 10.1177/1533317511404394.CrossRefGoogle Scholar
- 28.Ehlhardt LA, Sohlberg MM, Kennedy M, Coelho C, Ylvisaker M, Turkstra L, Yorkston K: Evidence-based practice guidelines for instructing individuals with neurogenic memory impairments: what have we learned in the past 20 years?. Neuropsychol Rehabil. 2008, 18: 300-342. 10.1080/09602010701733190.CrossRefPubMedGoogle Scholar
- 35.Kuzis G, Sabe L, Tiberti C, Merello M, Leiguarda R, Starkstein SE: Explicit and implicit learning in patients with Alzheimer disease and Parkinson disease with dementia. Neuropsychiatry, Neuropsychol Behav Neurol. 1999, 12: 265-269.Google Scholar
- 40.Wilson BA, Alderman N, Burgess PW, Emslie H, Evans JJ: Behavioural assessment of the dysexecutive syndrome. 1996, Bury St. Edmunds: Thames Valley Test CompanyGoogle Scholar
- 41.Zimmermann P, Fimm B: Test for Attentional Performance (TAP), Version 2.1, Operating Manual. 2007, PsyTest: HerzogenrathGoogle Scholar
- 42.Wechsler D: Wechsler adult intelligence scale-third edition. 1997, San Antonio: The Psychological CorporationGoogle Scholar
- 43.Burgess PW, Shallice T: The Hayling and Brixton Tests. 1997, Bury St. Edmunds: Thames Valley Test CompanyGoogle Scholar
- 44.Wilson B, Greenfield E, Clare L, Baddeley A, Cockburn J, Watson P, Tate R, Sopena S, Nannery R: Rivermead behavioural memory test–third edition. 2008, Toronto: PearsonGoogle Scholar
- 49.Burgess PW, Alderman N, Wilson BA, Evans JJ Emslie H: Validity of the battery: relationship between performance on the BADS and ratings of executive problems. BADS: Behavioural assessment of the dysexecutive syndrome manual. Edited by: Wilson BA. 1996, Bury St Edmunds: Thames Valley Test CompanyGoogle Scholar
- 51.Pollens RD, McBratnie BP, Burton PL: Beyond cognition: Executive functions in closed head injury. J Cogn Rehab. 1988, 6: 26-32.Google Scholar
- 54.Spikman JM, Boelen DH, Lamberts KF, Brouwer WH, Fasotti L: Effects of a multifaceted treatment program for executive dysfunction after acquired brain injury on indications of executive functioning in daily life. Journal J Int Neuropsych Soc. 2010, 16: 118-129. 10.1017/S1355617709991020.CrossRefGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2377/13/64/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.