Abstract
Neurocognitive heterogeneity is increasingly recognized as a valid phenomenon in ADHD, with most estimates suggesting that executive dysfunction is present in only about 33%–50% of these children. However, recent critiques question the veracity of these estimates because our understanding of executive functioning in ADHD is based, in large part, on data from single tasks developed to detect gross neurological impairment rather than the specific executive processes hypothesized to underlie the ADHD phenotype. The current study is the first to comprehensively assess heterogeneity in all three primary executive functions in ADHD using a criterion battery that includes multiple tests per construct (working memory, inhibitory control, set shifting). Children ages 8–13 (M = 10.37, SD = 1.39) with and without ADHD (N = 136; 64 girls; 62% Caucasian/Non-Hispanic) completed a counterbalanced series of executive function tests. Accounting for task unreliability, results indicated significantly improved sensitivity and specificity relative to prior estimates, with 89% of children with ADHD demonstrating objectively-defined impairment on at least one executive function (62% impaired working memory, 27% impaired inhibitory control, 38% impaired set shifting; 54% impaired on one executive function, 35% impaired on two or all three executive functions). Children with working memory deficits showed higher parent- and teacher-reported ADHD inattentive and hyperactive/impulsive symptoms (BF10 = 5.23 × 104), and were slightly younger (BF10 = 11.35) than children without working memory deficits. Children with vs. without set shifting or inhibitory control deficits did not differ on ADHD symptoms, age, gender, IQ, SES, or medication status. Taken together, these findings confirm that ADHD is characterized by neurocognitive heterogeneity, while suggesting that contemporary, cognitively-informed criteria may provide improved precision for identifying a smaller number of neuropsychologically-impaired subtypes than previously described.
This is a preview of subscription content, access via your institution.

Notes
As recommended in the K-SADS, oppositional defiant disorder was diagnosed clinically only with evidence of multi-informant/multi-setting symptoms. ODD comorbidity is 48% in the ADHD group and 16% in the Non-ADHD group based on parent-reported symptom counts.
Stop-signal reaction time (SSRT) was also computed for each task block due to current debate in the literature regarding the optimal metric for estimating inhibitory control from the stop-signal task. When substituted for SSD, these SSRT variables failed to load with the inhibitory control variables from the go/no-go task when factor analyzed (loadings = 0.06–0.28), and were therefore excluded from further analysis.
References
Alderson, R. M., Rapport, M. D., & Kofler, M. J. (2007). Attention-deficit/hyperactivity disorder and behavioral inhibition: a meta-analytic review of the stop-signal paradigm. Journal of Abnormal Child Psychology, 35(5), 745–758.
Alderson, R. M., Rapport, M. D., Sarver, D. E., & Kofler, M. J. (2008). ADHD and behavioral inhibition: A re-examination of the stop-signal task. Journal of Abnormal Child Psychology, 36, 989–998.
Alderson, R. M., Rapport, M. D., Kasper, L. J., Sarver, D. E., & Kofler, M. J. (2012). Hyperactivity in boys with attention deficit/hyperactivity disorder (ADHD): The association between deficient behavioral inhibition, attentional processes, and objectively measured activity. Child Neuropsychology, 18(5), 487–505.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, D.C.: American Psychiatric Association.
Baddeley, A. (2007). Working memory, thought, and action. Oxford Press.
Baddeley, A. (2012). Working memory: Theories, models, and controversies. Annual Review of Psychology, 63, 1–29.
Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009). Assessing inattention and impulsivity in children during the Go/NoGo task. British Journal of Developmental Psychology, 27, 365–383.
Biederman, J., Monuteaux, M. C., Doyle, A. E., Seidman, L. J., Wilens, T. E., Ferrero, F., et al. (2004). Impact of executive function deficits and attention-deficit/hyperactivity disorder (ADHD) on academic outcomes in children. Journal of Consulting and Clinical Psychology, 72(5), 757.
Castellanos, F. X., & Tannock, R. (2002). Neuroscience of attention-deficit/hyperactivity disorder: the search for endophenotypes. Nature Reviews Neuroscience, 3(8), 617–628.
Chacko, A., Kofler, M., & Jarrett, M. (2014). Improving outcomes for youth with ADHD: A conceptual framework for combined neurocognitive and skill-based treatment approaches. Clinical Child and Family Psychology Review, 17(4), 368–384.
Coghill, D., Nigg, J., Rothenberger, A., Sonuga-Barke, E., & Tannock, R. (2005). Whither causal models in the neuroscience of ADHD? Developmental Science, 8(2), 105–114.
Coghill, D. R., Seth, S., & Matthews, K. (2014). A comprehensive assessment of memory, delay aversion, timing, inhibition, decision making and variability in attention deficit hyperactivity disorder: advancing beyond the three-pathway models. Psychological Medicine, 44, 1989–2001.
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005). Working memory span tasks: A methodological review and user’s guide. Psychonomic Bulletin and Review, 12(5), 769–786.
Cortese, S., Kelly, C., Chabernaud, C., Proal, E., Di Martino, A., Milham, M. P., & Castellanos, F. X. (2012). Toward systems neuroscience of ADHD: A meta-analysis of 55 fMRI studies. American Journal of Psychiatry, 169(10), 1038–1055.
DiStefano, C., Zhu, M., & Mîndrilă, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research and Evaluation, 14, 1–11.
DuPaul, G. J., Power, T. J., Anastopoulos, A. D., & Reid, R. (2016). ADHD rating scale-5 for children and adolescents: Checklists, norms, and clinical interpretation. New York: Guilford Press.
Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999). Working memory, short-term memory, and general fluid intelligence: A latent variable approach. Journal of Experimental Psychology: General, 125, 309–331.
Engle, R. W., & Kane, M. J. (2004). Executive attention, working memory capacity, and a two-factor theory of cognitive control. Psychology of Learning and Motivation, 44, 145–200.
Fair, D. A., Bathula, D., Nikolas, M. A., & Nigg, J. T. (2012). Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proceedings of the National Academy of Sciences of the United States of America, 109(17), 6769–6774.
Friedman, N. P., & Miyake, A. (2017). Unity and diversity of executive functions: Individual differences as a window on cognitive structure. Cortex, 86, 186–204.
Friedman, L. M., Rapport, M. D., Raiker, J. S., Orban, S. A., & Eckrich, S. J. (2017). Reading comprehension in boys with ADHD: The mediating roles of working memory and orthographic conversion. Journal of Abnormal Child Psychology, 45(2), 273–287.
Geurts, H. M., van der Oord, S., & Crone, E. A. (2006). Hot and cool aspects of cognitive control in children with ADHD: Decision-making and inhibition. Journal of Abnormal Child Psychology, 34(6), 813–824.
Gomez, R., & Sanson, A. (1994). Effects of experimenter and mother presence on the attentional performance and activity of hyperactive boys. Journal of Abnormal Child Psychology, 22, 517–529.
Hogarty, K. Y., Hines, C. V., Kromrey, J. D., Ferron, J. M., & Mumford, K. R. (2005). The quality factor solutions in exploratory factor analysis: The influence of sample size, communality, and overdetermination. Educational and Psychological Measurement, 65, 202–226.
Hollingshead, A.B. (1975). Four factor index of social status. Yale: New Haven.
Hudec, K. L., Alderson, R. M., Patros, C. H. G., Lea, S. E., Tarle, S. J., & Kasper, L. J. (2015). Hyperactivity in boys with attention-deficit/hyperactivity disorder (ADHD): The role of executive and non-executive functions. Research in Developmental Disabilities, 45, 103–109.
Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19.
Jaroslawska, A. J., Gathercole, S. E., Allen, R. J., & Holmes, J. (2016). Following instructions from working memory: why does action at encoding and recall help? Memory & Cognition, 44(8), 1183–1191.
JASP Team. (2017). JASP (Version 0.8.2 software).
Kane, M. J., & Engle, R. W. (2003). Working-memory capacity and the control of attention: The contributions of goal neglect, response competition, and task set to Stroop interference. Journal of Experimental Psychology: General, 132(1), 47–70.
Karalunas, S. L., Gustafsson, H. C., Dieckmann, N. F., Tipsord, J., Mitchell, S. H., & Nigg, J. T. (2017). Heterogeneity in development of aspects of working memory predicts longitudinal attention deficit hyperactivity disorder symptom change. Journal of Abnormal Psychology, 126(6), 774.
Kasper, L. J., Alderson, R. M., & Hudec, K. L. (2012). Moderators of working memory deficits in children with attention-deficit/hyperactivity disorder (ADHD): a meta-analytic review. Clinical Psychology Review, 32(7), 605–617.
Kaufman, J., Birmaher, B., Brent, D., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980–988.
Kofler, M. J., Rapport, M. D., Bolden, J., Sarver, D. E., & Raiker, J. S. (2010). ADHD and working memory: The impact of central executive deficits and exceeding storage/rehearsal capacity on observed inattentive behavior. Journal of Abnormal Child Psychology, 38, 149–161.
Kofler, M. J., Rapport, M. D., Bolden, J., Sarver, D. E., Raiker, J. S., & Alderson, R. M. (2011). Working memory deficits and social problems in children with ADHD. Journal of Abnormal Child Psychology, 39, 805–817.
Kofler, M. J., Alderson, R. M., Raiker, J. S., Bolden, J., Sarver, D. E., & Rapport, M. D. (2014). Working memory and intraindividual variability as indicators in ADHD. Neuropsychology, 28, 459–471.
Kofler, M. J., Sarver, D. E., Spiegel, J. A., Day, T. N., Harmon, S. L., & Wells, E. L. (2016). Heterogeneity in ADHD: Neurocognitive predictors of peer, family, and academic functioning. Child Neuropsychology, 23(6), 733–759.
Kofler, M. J., Sarver, D. E., Harmon, S. L., Moltisanti, A., Aduen, P. A., Soto, E. F., & Ferretti, N. (2017). Working memory and organizational skills problems in ADHD. Journal of Child Psychology and Psychiatry.
Kofler, M. J., Sarver, D. E., Harmon, S. L., Moltisanti, A., Aduen, P. A., Soto, E. F., & Ferretti, N. (2018). Working memory and organizational skills problems in ADHD. Journal of Child Psychology and Psychiatry, 59(1), 57–67.
Kosten, T. A., & Rounsaville, B. J. (1992). Sensitivity of psychiatric diagnosis based on the best estimate procedure. The American Journal of Psychiatry, 149(9), 1225.
Lerner, J. V., Phelps, E., Forman, Y. E., & Biowers, E. P. (2009). Positive youth development. In R. M. Lerner & L. D. Steinberg (Eds.), Handbook of adolescent psychology (pp. 524–558). NJ: Wiley.
Lijffijt, M., Kenemans, J. L., Verbaten, M. N., & van Engeland, H. (2005). A Meta-Analytic Review of Stopping Performance in Attention-Deficit/Hyperactivity Disorder: Deficient Inhibitory Motor Control? Journal of Abnormal Psychology, 114(2), 216–222.
Martinussen, R., Hayden, J., Hogg-Johnson, S., & Tannock, R. (2005). A meta-analysis of working memory impairments in children with attention-deficit/hyperactivity disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 44(4), 377–384.
Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14.
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.
Navon, D. (1977). Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 9(3), 353–383.
Nigg, J. T., Willcutt, E. G., Doyle, A. E., & Sonuga-Barke, E. J. (2005). Causal heterogeneity in attention-deficit/hyperactivity disorder: do we need neuropsychologically impaired subtypes? Biological Psychiatry, 57(11), 1224–1230.
Pa, J., Possin, K. L., Wilson, S. M., Quitania, L. C., Kramer, J. H., Boxer, A. L., et al. (2010). Gray matter correlates of set-shifting among neurodegenerative disease, mild cognitive impairment, and healthy older adults. Journal of the International Neuropsychological Society, 16(04), 640–650.
Patros, C. H. G., Alderson, R. M., Lea, S. E., Tarle, S. J., Kasper, L. J., & Hudec, K. L. (2015). Visuospatial working memory under-lies choice-impulsivity in boys with ADHD. Research in Developmental Disabilities, 38, 134–144.
Polanczyk, G. V., Willcutt, E. G., Salum, G. A., Kieling, C., & Rohde, L. A. (2014). ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. International Journal of Epidemiology, 43(2), 434–442.
Raiker, J. S., Rapport, M. D., Kofler, M. J., & Sarver, D. E. (2012). Objectively-measured impulsivity and ADHD: Testing competing predictions from the working memory and behavioral inhibition models of ADHD. Journal of Abnormal Child Psychology, 40, 699–713.
Rapport, M. D., Bolden, J., Kofler, M. J., Sarver, D. E., Raiker, J. S., & Alderson, R. M. (2009). Hyperactivity in boys with ADHD: A ubiquitous core symptom or manifestation of working memory deficits? Journal of Abnormal Child Psychology, 37, 521–534.
Rapport, M. D., Orban, S. A., Kofler, M. J., & Friedman, L. M. (2013). Do programs designed to train working memory, other executive functions, and attention benefit children with ADHD? A meta-analytic review. Clinical Psychology Review, 33, 1237–1252.
Redick, T. S., & Lindsey, D. R. B. (2013). Complex span and n-back measures of working memory: A meta-analysis. Psychonomic Bulletin and Review, 20(6), 1102–1113.
Reynolds, C.R., & Kamphaus, R.W. (2015). BASC-3: Behavior assessment system for children.
Rouder, J. N., & Morey, R. D. (2012). Default Bayes factors for model selection in regression. Multivariate Behavioral Research, 47(6), 877–903.
Sarver, D. E., Rapport, M. D., Kofler, M. J., Raiker, J. S., & Friedman, L. M. (2015). Hyperactivity in ADHD: Impairing deficit or compensatory behavior? Journal of Abnormal Child Psychology, 43, 1219–1232.
Sattler, J., Dumont, R., & Coalson, D. (2016). Assessment of Children: WISC-V and WPPSI-IV. San Diego: Sattler Press.
Shipstead, Z., Redick, T. S., & Engle, R. W. (2010). Does working memory training generalize? Psychologica Belgica, 50, 245–276.
Snyder, H. R. (2013). Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychological Bulletin, 139(1), 81.
Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6.
Solanto, M. V., Abikoff, H., Sonuga-Barke, E., Schachar, R., Logan, G. D., Wigal, T., et al. (2001). The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: A supplement to the NIMH multimodal treatment study of AD/HD. Journal of Abnormal Child Psychology, 29(3), 215–228.
Sonuga-Barke, E. J., Sergeant, J. A., Nigg, J., & Willcutt, E. (2008). Executive dysfunction and delay aversion in attention deficit hyperactivity disorder: nosologic and diagnostic implications. Child and Adolescent Psychiatric Clinics of North America, 17(2), 367–384.
Sonuga-Barke, E., Bitsakou, P., & Thompson, M. (2010). Beyond the dual pathway model: Evidence for the dissociation of timing, inhibitory, and delay-related impairments in attention-deficit/hyperactivity disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 49, 345–355.
Soreni, N., Crosbie, J., Ickowicz, A., & Schachar, R. (2009). Stop signal and Conners’ CPT: Test-retest reliability of two inhibition measures in ADHD children. Journal of Attention Disorders, 13, 137–143.
St Clair-Thompson, H. L., & Gathercole, S. E. (2006). Executive functions and achievements in school: shifting, updating, inhibition, and working memory. The Quarterly Journal of Experimental Psychology, 59(4), 745–759.
Tarle, S. J., Alderson, R. M., Patros, C. H. G., Lea, S. E., Hudec, K. L., & Arrington, E. F. (2017). Attention-deficit/hyperactivity disorder and phonological working memory: Methodological variability affects clinical and experimental performance metrics. Neuropsychology, 31(4), 383–394.
Unsworth, N., & Engle, R. W. (2007). The nature of individual differences in working memory capacity: Active maintenance in primary memory and controlled search from secondary memory. Psychological Review, 114(1), 104–132.
Valo, S., & Tannock, R. (2010). Diagnostic instability of DSM–IV ADHD subtypes: Effects of informant source, instrumentation, and methods for combining symptom reports. Journal of Clinical Child & Adolescent Psychology, 39, 749–760.
van Cauwenberge, V., Sonuga-Barke, E. J. S., Hoppenbrouwers, K., Van Leeuwen, K., & Wiersema, J. R. (2015). "Turning down the heat": Is poor performance of children with ADHD on tasks tapping "hot" emotional regulation caused by deficits in "cool" executive functions? Research in Developmental Disabilities, 47, 199–207.
Van der Sluis, S., De Jong, P. F., & Van der Leij, A. (2007). Executive functioning in children, and its relations with reasoning, reading, and arithmetic. Intelligence, 427–449.
van der Ven, S. H., Kroesbergen, E. H., Boom, J., & Leseman, P. P. (2013). The structure of executive functions in children: A closer examination of inhibition, shifting, and updating. British Journal of Developmental Psychology, 31(1), 70–87.
van Lieshout, M., Luman, M., Buitelaar, J., Rommelse, N. N., & Oosterlaan, J. (2013). Does neurocognitive functioning predict future or persistence of ADHD? A systematic review. Clinical Psychology Review, 33(4), 539–560.
Verbruggen, F., Chambers, C. D., & Logan, G. D. (2013). Fictitious inhibitory differences: how skewness and slowing distort the estimation of stopping latencies. Psychological Science, 24(3), 352–362.
Wagenmakers, E., Morey, R. D., & Lee, M. D. (2016). Bayesian benefits for the pragmatic researcher. Current Directions in Psychological Science, 25(3), 169–176.
Wager, T. D., & Smith, E. E. (2003). Neuroimaging studies of working memory. Cognitive, Affective, & Behavioral Neuroscience, 3, 255–274.
Wechsler, D. (2014). Wechsler Intelligence Scale for Children-Fourth/Fifth Edition. San Antonio: Pearson.
Wells, E. L., Kofler, M. J., Soto, E. F., Schaefer, H., & Sarver, D. E. (2018). Assessing working memory in children with ADHD: Minor administration and scoring changes may improve digit span backward’s construct validity. Research in Developmental Disabilities, 72, 166–178.
Westfall, P. H., Johnson, W. O., & Utts, J. M. (1997). A Bayesian perspective on the Bonferroni adjustment. Biometrika, 84(2), 419–427.
Wiemers, E. A., & Redick, T. S. (2018). Working memory capacity and intra-individual variability of proactive control. Acta Psychologica, 182, 21–31.
Wilens, T. E., Biederman, J., Brown, S., Tanguay, S., Monuteaux, M. C., Blake, C., & Spencer, T. J. (2002). Psychiatric comorbidity and functioning in clinically referred preschool children and school-age youths with ADHD. Journal of the American Academy of Child & Adolescent Psychiatry, 41, 262–268.
Willcutt, E. G., Pennington, B. F., Olson, R. K., Chhabildas, N., & Hulslander, J. (2005). Neuropsychological analyses of comorbidity between reading disability and attention deficit hyperactivity disorder: In search of the common deficit. Developmental Neuropsychology, 27, 35–78.
Willoughby, M. T., Blair, C. B., & The Family Life Project Investigators. (2016). Measuring executive function in early childhood: A case for formative measurement. Psychological Assessment, 28(3), 319–330.
Youngstrom, E. A., Arnold, L. E., & Frazier, T. W. (2010). Bipolar and ADHD comorbidity: both artifact and outgrowth of shared mechanisms. Clinical Psychology: Science and Practice, 17(4), 350–359.
Zakzanis, K. K. (2001). Statistics to tell the truth, the whole truth, and nothing but the truth: formulae, illustrative numerical examples, and heuristic interpretation of effect size analyses for neuropsychological researchers. Archives of Clinical Neuropsychology, 16(7), 653–667.
Acknowledgements
This work was supported in part by an NIH grant (R34 MH102499-01, PI: Kofler). The sponsor had no role in design and conduct of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors have no conflicts of interest to report.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Electronic supplementary material
ESM 1
(DOCX 560 kb)
Rights and permissions
About this article
Cite this article
Kofler, M.J., Irwin, L.N., Soto, E.F. et al. Executive Functioning Heterogeneity in Pediatric ADHD. J Abnorm Child Psychol 47, 273–286 (2019). https://doi.org/10.1007/s10802-018-0438-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-018-0438-2
Keywords
- ADHD
- Executive function
- Working memory
- Inhibition
- Shifting
- Heterogeneity