Introduction

Attention deficit hyperactivity disorder (ADHD) is a prevalent neuropsychiatric disorder for which impulsivity (e.g. tendency to interrupt, difficulty awaiting turn) is considered to be a cardinal feature (Barkley 1997; Halperin et al. 1995; Nigg 2000). Children with ADHD are often rated by parents, teachers, clinicians and themselves as displaying more ‘impulsive’ behaviours than their peers (Chamberlain and Sahakian 2006). These clinical symptoms can be quantified using laboratory tasks of impulsivity in children. Given the multi-factorial nature of the impulsivity construct (Evenden 1999; Reynolds 2006), existing tasks fall within three core domains. Inhibition of pre-potent responses can be assessed with the Stop Signal Task (SST; Logan et al. 1984) or with go/no go (Aron and Poldrack 2005) or continuous performance tasks (CPT; Rosvold and Delgado 1956). Delay impulsivity, defined as the choice of a smaller immediate reward over larger delayed reward can be assessed with tasks of temporal discounting or delay-of-gratification (Scheres et al. 2006; Schweitzer and Sulzer-Azaroff 1995; Sonuga-Barke et al. 1992). A third domain, which has received less attention, refers to impulsivity at the pre-decisional stage, when the individual gathers and evaluates information. Kagan (1966) first defined the concept of reflection–impulsivity using his Matching Familiar Figures Test (MFFT) where the aim is to determine which of six figures is identical to a standard. Kagan defined ‘reflectives’ as those subjects with long decision latencies but low error rates, whilst ‘impulsives’ decided quickly and made more errors. ‘Reflectives’ not only gather more information, but also use a more systematic approach to comparing the figures than ‘impulsives’(Drake 1970). Hyperactive children (i.e. the diagnosis that later became ADHD in the DSM-III) were classed as ‘impulsives’ more often than their peers on the MFFT (Messer 1976; Sandoval 1977). However, Block et al. (1974) criticised the concept of reflection–impulsivity as defined by the MFFT for disregarding those subjects who perform quickly and well or slowly and poorly simply because they do not meet the original definition of ‘reflective’ or ‘impulsive’ (Block et al. 1974).

An alternative measure of reflection–impulsivity, the Information Sampling Task (IST; (Clark et al. 2006)), has recently been developed to circumvent some of the criticisms of the MFFT and to allow for a more direct analysis of information sampling and quality of decision-making. In this task, subjects sample information from a covered array of 25 boxes in order to decide which of two colours lies in the majority under the board. Although the subjects are able to sample information until a point of complete certainty, healthy young adults typically make their decision at a point of uncertainty, such that there is around a 20% chance of error. Substance users dependent upon stimulants or opiates, as well as regular cannabis users, show impulsivity and lack of sufficient sampling (Clark et al. 2006, 2008). One objective of the present study was to examine task performance on the IST in children with ADHD in a case–control design. A further aim was to characterise the effects of ADHD treatment on this variety of impulsivity.

Methylphenidate (MPH) is the first-line treatment for ADHD and acts to increase dopamine and noradrenaline availability by blocking their reuptake (Berridge et al. 2006). MPH remediates impulsivity in children and adults with ADHD on behavioural symptom ratings (Solanto et al. 2001) as well as laboratory tests of response inhibition (Aron et al. 2003; Konrad et al. 2004; Tannock et al. 1989) and the MFFT (Brown and Sleator 1979).

In this study, we compared the effects of MPH on two forms of impulsivity: response inhibition measured by the SST (Aron et al. 2003) and reflection–impulsivity measured by the IST (Clark et al. 2006).

Methods

Methods and materials

Parental written informed consent and ethics committee approval were obtained. Patients were regular attendees at a childhood ADHD outpatient clinic and were consecutively referred to the study by their psychiatrists. All patient participants had undergone a psychiatrist-led 3-h clinical assessment based on Kiddie-Schedule for Affective Disorders and Schizophrenia and provided developmental and family histories and teacher reports as part of standard care at the outpatient clinic. All met the DSM-IV guidelines for ADHD combined type, including pervasiveness of symptoms (APA 1994) and were stabilised on MPH for therapeutic purposes prior to their referral to the study. ADHD patients (N = 21) were males, aged 7–13 years with no primary learning disabilities or concomitant neurological, psychiatric or behavioural disorders (except history of oppositional defiant disorder; N = 14). A healthy control group (HC; N = 21; aged 7–12 years) was recruited with posters from the local community. Groups were matched for age and years of education.

The ADHD boys underwent a double-blind, placebo-controlled, cross-over design of placebo or a single 0.5-mg/kg dose (rounded up to the nearest 0.5 mg) of immediate-release MPH delivered in capsules. One child received 0.25 mg/kg (10 mg) since his regular MPH dose with therapeutic efficacy was low in comparison with his higher bodyweight. Participants abstained from MPH for 21–28 h (approximately five to seven half-lives) prior to testing sessions. MPH reaches peak plasma concentration in approximately 2 h (Volkow et al. 2002). Questionnaires were completed once at the start of a visit to avoid treatment effects. Neuropsychological testing began at least 1 1/2 h after capsules were ingested. HCs attended two sessions but received no capsules. Sessions were separated by approximately 1–2 weeks. For case-controlled comparisons, each HC participant had his first or second visit randomly designated as a ‘placebo’ control session. HC data was thus matched for age, visit and test order to the ADHD-placebo sessions.

Participants completed the Junior I6 questionnaire (Eysenck 1981), which is designed to measure self-reported impulsive, venturesome and empathetic traits, as well as the Mood and Feeling Questionnaires (Wood et al. 1995), a measure of depressive symptoms. Parents completed disruptive behaviour questionnaires [Achenbach Child Behaviour Checklist (Achenbach 1991); Conners Symptom Behaviour Checklist (Conners 1989)] based on their sons’ behaviour without medication. The order of task administration and task conditions were counter-balanced and matched between groups.

Information Sampling Task

The IST (Clark et al. 2006) is a measure of ‘reflection–impulsivity’. Subjects were told they would be presented with ten trials in each of two conditions [fixed win (FW), decreasing win (DW)] and that the task would last for 10 min. On each trial, a 5 × 5 matrix of grey boxes with two larger coloured panels below it was presented. Subjects were told to press on a box to reveal its colour and to open as many boxes as they chose prior to deciding which of the two colours they thought was in the majority amongst the 25 boxes. Boxes remain open for the duration of the trial to minimise working memory load. To register their decision, they pressed on one of the two coloured panels displayed. In the FW condition, if the subject chose correctly, they earned 100 points, but lost 100 points if they chose incorrectly. In the DW condition, subjects begin with the ability to win 250 points, but with every box they opened the amount they could win decreased by 10 points. An incorrect choice was still penalised with a loss of 100 points regardless of the amount of boxes opened. Therefore, in the FW condition, extensive information sampling prior to decision was optimal, whilst in order to gain points in the DW condition the subject must adjust to sample less information. A variable inter-trial interval was used such that the minimum trial duration was 30 s (e.g. if the subject responded after 10 s, the inter-trial interval would be 20 s). This feature was included to prevent unduly rapid responses leading to shorter task duration and thus an earlier escape of the experimental setting. This task is described in more detail by Clark et al. (2006).

Within each condition (FW and DW), there are five key measures. ‘Boxes opened’ is the number of boxes they chose to open, which represents the amount of information they sample prior to making a decision. ‘Box adjustment’ is the differences in number of boxes opened in the FW versus DW conditions and represents the degree to which subjects adjust their behaviour to the reward contingencies. ‘Quality of information’ is the probability that the colour in the visible majority at the time of choice is the true majority colour given the number of boxes remaining covered and assuming each uncovered box has a 0.5 probability of being each colour. For details of the calculation, see Clark et al. (2006). ‘Quality of information’ is the primary measure for information sampling on this task since it accounts for the amount of boxes opened as well as the proportion of each colour visible in the uncovered areas of the matrix at the time of decision. ‘Choice latency’ is the time between opening the final box and guessing which colour is in the majority within the matrix. A ‘poor decision’ is when the colour in the minority amongst the unveiled boxes is chosen.

A further measure, ‘sampling errors’, was employed to confirm that the model of ‘reflection–impulsivity’ provides a reasonable account of the data. This measure was not used to analyse subjects’ task performance. Sampling errors occur when the colour in the visible majority is chosen, but by chance is not the colour within the majority of the matrix. In a reflection–impulsivity task, the long-term probability of sampling errors should be inversely related to the quality of information: such errors are more likely to occur when less information is sampled (i.e. fewer boxes are opened).

Stop Signal Task

The SST (Aron et al. 2003) is a well-established measure of response inhibition. On each trial, subjects are asked to make a rightward or leftward button press as quickly as possible when presented with an arrow in the centre of the screen pointing in the corresponding direction (go stimulus). On a minority of the trials (25%), an auditory ‘stop signal’ beep is presented at a variable delay (stop signal delay, SSD) following the go stimulus. Subjects are instructed to inhibit their responses on the trials with a stop signal beep. Subjects complete five blocks of 64 trials; each of the SSD is titrated to the subject’s ability using a tracking algorithm (Osman et al. 1990) to converge on 50% successful stop rate. The primary outcome measure is stop signal reaction time (SSRT), an estimate of the subject’s capacity for inhibiting pre-potent motor responses. To ensure accurate estimation of the SSRT for subjects who did not converge exactly on 50% successful stops, the SSRT was computed using the integration method (Logan 1994). The SSRT as estimated by the integration method produced qualitatively similar results as the race-model estimation in this data set. Additional measures of interest are the median (median go) and standard deviation (SD; variability go) of the go reaction times.

Statistical analyses

T tests or non-parametric equivalents (Wilcoxon signed ranks or Mann–Whitney U tests), where appropriate, and chi-squared analysis compared ADHD-placebo with ADHD-MPH and healthy controls on IST and SST measures, rating scales and demographic variables. Data were examined for statistical outliers (defined as >3 × interquartile range outside either quartile boundary) before analysis. The exclusion of outliers did not alter the pattern or significance of results. On measures that significantly improved on MPH, ADHD-MPH was compared directly with the HC group. Effect sizes were calculated as d = (μ 1 − μ 2)/√[(σ 1 2 + σ 2 2)/2] (Dunlap et al. 1996). Exploratory correlations (Pearson’s or Spearman’s) were carried out between the core task measures that showed significant impairments or changes on MPH and behavioural ratings. Due to the large number of correlations, only those significant to p < 0.01 will be reported.

Results

ADHD and HC groups were matched for age (t = −0.872, p = 0.388; meanADHD = 10.00, SDADHD = 2.04; meanHC = 10.47, SDHC = 1.43), test order (t = −0.302, p = 0.765), visit used (t = 0.302, p = 0.765), days between visits (t = −0.710, p = 0.482), years of education (t = −1.063, p = 0.297) and distribution of younger (7–10) versus older (11–13) children (df = 1, χ 2 = 1.52, p = 0.22). The ADHD group had significantly higher disruptive behaviour ratings (AchenbachTotal t = 6.795, p < 0.001; ConnersTotal t = 8.777, p < 0.001) and a trend towards higher depressive symptoms (Mood and Feeling Questionnaire t = 1.852; p = 0.072). Two ADHD subjects who received MPH on session 1 did not return for their second sessions and were excluded from the analyses.

Information Sampling Task

Participants demonstrated sensitivity to the task contingencies by opening fewer boxes in the DW condition than the FW condition (HC z = −3.980, p < 0.001; ADHD-placebo z = −3.680, p < 0.001; ADHD-MPH z = −3.920, p < 0.001). A core criterion for a test of reflection–impulsivity is that the extent of information sampling should predict the accuracy of the eventual decision. This criterion was generally evident in the data as negative correlations between sampling errors and the number of boxes opened in the FW condition (HC r = −0.771, p < 0.001; ADHD-placebo r = −0.634, p = 0.005; ADHD-MPH r = 0.109, p = 0.648).

IST group effects (ADHD-placebo versus healthy controls)

ADHD-placebo did not differ significantly from healthy controls in either condition on the amount of boxes opened (FW z = −0.620, p = 0.549, d = 0.18; DW z = −0.930, p = 0.364, d = 0.18), box adjustment (z = −0.592, p = 0.568, d = 0.28), choice latency (FW z = −1.155, p = 0.257, d = 0.37; DW z = −1.465, p = 0.148, d = 0.51) or quality of information available at the time of choice (FW z = −0.509, p = 0.626, d = 0.13; DW z = 1.296, p = 0.202, d = 0.40; see Table 1). In both conditions, ADHD-placebo made significantly more poor decisions (i.e. chose the colour in the visible minority) than the HC group (FW z = −2.954, p = 0.006, d = 1.06; DW z = −3.097, p = 0.003, d = 0.90; see Fig. 1a).

Fig. 1
figure 1

Group and drug effects on IST poor decisions and SST SSRT

Table 1 IST key measures

IST drug effects (ADHD-MPH versus ADHD-placebo)

MPH did not significantly alter the performance of the ADHD group on the key IST measures. ADHD-MPH did not significantly differ from ADHD-placebo visits on the number of boxes opened (FW z = −0.828, p = 0.407, d = 0.25; DW z = −1.045, p = 0.296, d = 0.24), box adjustment (t = −0.251, p = 0.805, d = 0.07), choice latency (FW z = −1.328, p = 0.184, d = 0.20; DW z = −0.240, p = 0.811, d = 0.11), quality of information available at the time of choice (FW z = −1.086, p = 0.278, d = 0.35; DW z = −0.806, p = 0.420, d = 0.12) or number of poor decisions (FW z = −1.078, p = 0.281, d = 0.32; DW z = −0.405, p = 0.685, d = 0.12).

IST effects of trial type (poor decision trials versus sensible decision trials)

To further investigate the higher rates of poor decisions in the ADHD group on placebo, post hoc analyses were carried out to compare trials where poor decisions were made with sensible decision trials within each group and condition (see Table 2).

Table 2 IST poor decision trials versus sensible decision trials

Within ADHD-placebo, poor-quality decision trials did not differ from sensible trials in terms of choice latency (FW z = −0.245, p = 0.807, d = 0.10; DW z = −0.785, p = 0.433, d = 0.10). However, the quality of information available at the time of choice was lower for ADHD-placebo on poor decision trials than sensible trials in the FW condition only (FW z = −2.29, p = 0.022, d = 0.66; DW z = −0.722, p = 0.470, d = 0.36). Within ADHD-MPH, poor and sensible decision trials did not differ significantly in terms of quality of information available at the time of choice (FW z = 0.000, p = 1.000, d = 0.30; DW z = −0.80, p = 0.424, d = 0.35), but ADHD-MPH had significantly shorter choice latencies on poor-quality decision trials than sensible trials in the FW condition only (FW z = −2.045, p = 0.041, d = 0.67; DW z = −1.511, p = 0.131, d = 0.51).

In addition, ADHD-MPH did not significantly differ from ADHD-placebo on choice latency or quality of information measures within poor or sensible decision trials in either condition.

IST effects of task duration on probability of correct choice

A post hoc analysis was performed to determine whether higher rates of errors in the ADHD group were related to fatigue or loss of motivation across the duration of the task. The probability that the subjects’ choices were correct given the information available at the time of decision was calculated for each trial using a variant of the equation for ‘quality of information’. Whilst ‘quality of information’ represents the probability of being correct if the subject chooses the colour in the visible majority at the time of decision (i.e. the ‘sensible’ choice), the calculation for probability of correct choice instead considers the colour actually chosen by the subject. Therefore, poor decisions always have a probability of being correct of less than 0.5. This novel measure was introduced because it accounts for poor decisions but the data meets the assumptions of normality necessary for inclusion in an analysis of variance (ANOVA). A mixed-model ANOVA measured the change in the probability of being correct across the within-subject factors of trial (1–10) and condition (FW, DW) and between-subject factors of group (ADHD-placebo, HC) and condition order (FW–DW, DW–FW). There were significant main effects of group (F = 5.804, p = 0.021) and trials (F = 7.668, p < 0.001) on the probability of being correct. The main effect of trials was due to a fluctuation from trial to trial (the precise sequence of colours revealed in a session was taken from the same pseudo-random sequence for all participants), rather than a clear trend across the task duration. There were no significant trial by group (F = 1.434, p = 0.186), trial by condition order (F = 1.231, p = 0.283) or trial by group by condition order (F = 1.469, p = 0.168) interactions. Thus, this analysis provides no evidence to suggest that group differences arose through differences in fatigue or motivation over the course of a session.

Stop Signal Task

SST group effects (ADHD-placebo versus healthy controls)

Compared with the HC group on the SST, ADHD-placebo had significantly slower median go reaction time (F = 3.20, p = 0.005, d = 1.00), larger SD of go reaction times (z = −4.049, p < 0.001, d = 1.53) and longer SSRTs (t = 3.78, p = 0.001, d = 1.28; see Table 3).

Table 3 SST key measures

SST drug effects (ADHD-MPH versus ADHD-placebo)

Compared with ADHD-placebo, ADHD-MPH had less variable go reaction times (z = −3.501, p < 0.001, d = 1.10) and shorter SSRTs (t = −4.169, p = 0.001, d = 1.54), but did not significantly differ on median go reaction times (t = −1.573, p = 0.133, d = 0.23).

SST medicated ADHD group effects (ADHD-MPH versus healthy controls)

ADHD-MPH and HC groups were only directly compared on measures that were significantly affected by MPH. ADHD on medication (ADHD-MPH) no longer significantly differed from healthy controls on SSRT (t = −4.75, p = 0.638, d = 0.26; see Fig. 1b) or SD of go reaction time (z = −1.648, p = 0.099, d = 0.50).

Associations between measures of impulsivity

Measures from the SST (SSRT, SD of go reaction time) and IST (quality of information, poor decisions) were compared with each other as well as with self-rated trait (I6 impulsivity, venturesomeness, empathy subscales) and parent-rated behavioural (Conners total score, Achenbach total score) questionnaires.

In the ADHD group, higher self-rated impulsivity (I6) was associated with reduced quality of information tolerated in the FW condition on placebo (r 18 = −0.661, p = 0.003; see Fig. 2). Higher self-rated trait venturesomeness (I6), which involves questions in regard to risky but hedonic adventures, was associated with better response inhibition (SSRT) in the ADHD group on MPH (ADHD-MPH; r 19 = −0.605, p = 0.006). The reason for this association requires further investigation.

Fig. 2
figure 2

More uncertainty tolerated prior to decision-making associated with self-rated impulsivity in ADHD-placebo

In the ADHD group, self-rated empathy, but not impulsivity or venturesomeness (I6), correlated negatively with parent-rated disruptive behaviours (AchenbachTotal r = −0.612, p = 0.003) and ADHD symptoms (ConnersTotal r = −0.599, p = 0.005; see Fig. 3).

Fig. 3
figure 3

Self-rated empathy not impulsivity associated with behaviour ratings

Discussion

On the SST, response inhibition was improved by MPH as was variability of reaction time. These findings replicate previous results in children (Konrad et al. 2004; Lijffijt et al. 2006; Tannock et al. 1989) and adults (Aron et al. 2003) with ADHD. On the IST, ADHD children did not differ from healthy control children in terms of the amount of information they sampled, the degree of uncertainty tolerated prior to making a decision or the speed at which they made their final choice. However, the ADHD group on placebo made significantly more poor decisions than the healthy controls. MPH did not significant affect any of the primary IST measures. Post hoc analyses revealed that within the ADHD group on placebo, these subjects tolerated a lower probability of being correct on the trials where they made poor decisions, signifying a degree of cognitive impulsivity contributing to their higher error rate. These problems were not ameliorated by MPH. The ADHD group on MPH took less time to make their final decision on the trials where they made poor decisions compared with the trials where they chose the colour in the visible majority, perhaps suggesting less attention to the trials where errors were made.

The lack of correlations between IST and SST measures is consistent with the idea that response inhibition and reflection–impulsivity are separate forms of impulsivity (Evenden 1999). Despite the widely accepted value of both rating scales and laboratory measures, it is common to find a lack of statistical associations between these measures of impulsivity (Lijffijt et al. 2004; Swann et al. 2002). This has been attributed to unreliable or biased reporting on ratings scales (e.g. children’s poor insight into their personality or behaviour; tendency for adults to respond with socially appropriate answers) or to the different forms of measurement tapping into different aspects of impulsivity (e.g. trait versus state). Therefore, it is significant that in the children with ADHD off medication, toleration of less quality of information prior to deciding was correlated strongly with their self-rated impulsivity. Parent ratings of disrupted behaviours did not relate to IST or SST measures, they were also not related to children’s self-rated impulsivity. The strong association between children’s self-rated empathy and parent-rated behavioural scales suggests that poor social perception or difficulty appreciating the impact of one’s behaviour on others (Clark et al. 1999) may contribute to disruptive behaviours in ADHD.

This study is the first demonstration of the IST in healthy children or children with ADHD, both on and off MPH. The lack of group effects on some measures of IST was interesting, given that impulsive responding (e.g. less information sampling prior to deciding) was previously demonstrated in current and former drug users (Clark et al. 2006, 2008) as well as adults with major depressive disorder (Taylor Tavares et al. 2007) on this task. The children appeared to comprehend the task requirements by adjusting their information sampling according to the condition (FW, DW) and choosing the colour in the visible majority on the majority of trials. Poor quality of decision-making distinguished children with ADHD from their peers, but was not accompanied by significantly less information sampling or differences in speed of decision-making. Therefore, the impairment in quality of decision-making on IST does not appear to be attributable to greater motor impulsivity in this context. The fact that patients do tolerate a lower quality of information on the trials in which they make errors may suggest that fluctuations in their attention or cognitive impulsivity across the duration of the task may contribute to their poor-quality decisions. These effects cannot easily be explained by reduced motivation as a result of fatigue in the ADHD group since statistical analyses showed no group differences on the performance effects of time on task. In regards to the limitations of this study, these findings await replication and extension to a larger group of ADHD patients including other ADHD subgroups and females.

The traditional concept of reflection–impulsivity predicts that impulsive subjects would respond quickly (i.e. prior to gathering sufficient information) and consequently make more errors than reflective subjects (Kagan 1966). However, we demonstrated increased errors without significantly lower levels of information sampling in the ADHD group. These findings are consistent with Block et al. (1974) who found that symptoms associated with hyperactivity in healthy children were most commonly observed in those subjects who made many errors on the MFFT despite responding slowly. In fact, subjects who responded quickly and inaccurately were not more likely to display hyperactive traits (Block et al. 1974). Although the prevalent method of analysing the MFFT incorporates latency and error rates, latency can be influenced by minor manipulations, such as changing task instructions to encourage slower responding. In contrast, error rates could only be improved by teaching systematic strategies or presenting the figures as component parts to encourage systematising (Block et al. 1974). Therefore, they concluded that error rates are a more reliable and stable measure of cognitive style than latency.

The lack of impulsive information sampling in children with ADHD with accompanying high error rates suggests they may be failing to use the available information to their advantage as well as their peers. This tendency is not ameliorated by MPH, despite its robust effects on other forms of impulsivity and response control measured in the same session. Poor quality of decision-making resistant to treatment with MPH has been previously demonstrated in an earlier study of children with ADHD on the Cambridge Gamble Task (DeVito et al. 2008). Methods for improving decision-making are, therefore, an important target for pharmacological as well as non-pharmacological treatments.

Conclusions

Although MPH reversed the impairments in motor control and response inhibition in children with ADHD, it did not significantly improve their poor quality of decision-making.