Abstract
Current diagnostic criteria for ADHD include several symptoms that highly overlap in conceptual meaning and interpretation. Additionally, inadequate sensitivity and specificity of current screening tools have hampered clinicians’ ability to identify those at risk for related outcomes. Using machine learning techniques, the current study aimed to propose a novel algorithm incorporating key ADHD symptoms to predict concurrent and future (i.e., five years later) ADHD diagnosis and related impairment levels. Participants were 399 children with and without ADHD; multiple informant measures of ADHD symptoms, global impairment, academic performance, and social skills were included as part of an accelerated longitudinal design. Results suggested eight symptoms as most important in predicting impairment outcomes five years later: (1) Has difficulty sustaining attention in tasks or play activities, (2) Does not follow through on instructions and fails to finish work, (3) Has difficulty organizing tasks and activities, (4) Avoids tasks (e.g., schoolwork, homework) that require sustained mental effort, (5) Is often easily distracted, (6) Is often forgetful in daily activities, (7) Fidgets with hands or feet or squirms in seat, and (8) Interrupts/intrudes on others. The algorithm comprising this abbreviated list of symptoms performed just as well as or significantly better than one comprising all 18 symptoms in predicting future global impairment and academic performance, but not social skills. It also predicted concurrent and future ADHD diagnosis with 81–93% accuracy. Continued development of screening tools will be key to ensuring access to clinical services for youth at risk for ADHD.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Association.
Arias, V. B., Ponce, F. P., & Núñez, D. E. (2018). Bifactor models of attention-deficit/hyperactivity disorder (ADHD): an evaluation of three necessary but underused psychometric indexes. Assessment, 25(7), 885–897. https://doi.org/10.1177/1073191116679260.
Arildskov, T. W., Sonuga-Barke, E., Thomsen, P. H., Virring, A., & Østergaard, S. D. (2022). How much impairment is required for ADHD? No evidence of a discrete threshold. Journal of Child Psychology and Psychiatry, 63(2), 229–237. https://doi.org/10.1111/jcpp.13440.
Carbonneau, M. L., Demers, M., Bigras, M., & Guay, M. C. (2021). Meta-analysis of sex differences in ADHD symptoms and associated cognitive deficits. Journal of Attention Disorders, 25(12), 1640–1656. https://doi.org/10.1177/1087054720923736.
Couronné, R., Probst, P., & Boulesteix, A. L. (2018). Random forest versus logistic regression: a large-scale benchmark experiment. Bmc Bioinformatics, 19(1), 270–283. https://doi.org/10.1186/s12859-018-2264-5.
Das, W., & Khanna, S. (2021). A robust machine learning based framework for the automated detection of ADHD using pupillometric biomarkers and time series analysis. Scientific Reports, 11(1), 1–12. https://doi.org/10.1038/s41598-021-95673-5.
Diedenhofen, B., & Musch, J. (2015). Cocor: a comprehensive solution for the statistical comparison of correlations. PloS One, 10, e0121945.
DuPaul, G. J., Power, T. J., Anastopoulos, A. D., & Reid, R. (1998). ADHD rating Scale—IV: Checklists, norms, and clinical interpretation. Guilford Press.
DuPaul, G. J., Rapport, M. D., & Perriello, L. M. (1991). Teacher ratings of academic skills: the development of the academic performance rating scale. School Psychology Review, 20(2), 284–300. https://doi.org/10.1080/02796015.1991.12085552.
Epskamp, S., & Fried, E. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617–634. doi:https://doi.org/10.1037/met0000167.
Emser, T. S., Johnston, B. A., Steele, J. D., Kooij, S., Thorell, L., & Christiansen, H. (2018). Assessing ADHD symptoms in children and adults: evaluating the role of objective measures. Behavioral and Brain Functions, 14(11), 1–14. https://doi.org/10.1186/s12993-018-0143-x.
Fawagreh, K., Gaber, M. M., & Elyan, E. (2014). Random forests: from early developments to recent advancements. Systems Science & Control Engineering, 2(1), 602–609. doi:https://doi.org/10.1080/21642583.2014.956265.
Goh, P. K., Lee, C. A., Martel, M. M., Karalunas, S. L., & Nigg, J. T. (2020). Subgroups of childhood ADHD based on temperament traits and cognition: concurrent and predictive validity. Journal of Abnormal Child Psychology, 48(10), 1251–1264. doi:https://doi.org/10.1007/s10802-020-00668-x.
Goh, P. K., & Martel, M. M. (2021). Commentary: Extending longitudinal network approaches–a reflection on Funkhouser et al.(2020). Journal of Child Psychology and Psychiatry, 62(2), 195–198. https://doi.org/10.1111/jcpp.13320
Goh, P. K., Martel, M. M., & Barkley, R. A. (2020). Clarifying ADHD and sluggish cognitive tempo item relations with impairment: a network analysis. Journal of Abnormal Child Psychology, 48(8), 1047–1061. https://doi.org/10.1007/s10802-020-00655-2.
Gresham, F., & Elliott, S. N. (2007). Social skills improvement system (SSIS) rating scales: San Antonio. TX: Pearson Education Inc.
Haslam, N., Williams, B., Prior, M., Haslam, R., Graetz, B., & Sawyer, M. (2006). The latent structure of attention-deficit/hyperactivity disorder: a taxometric analysis. Australian & New Zealand Journal of Psychiatry, 40(8), 639–647.
Hong, S. B., Dwyer, D., Kim, J. W., Park, E. J., Shin, M. S., Kim, B. N., Yoo, H. J., Cho, I. H., Bhang, S. Y., Hong, Y. C., Pantelis, C., & Cho, S. C. (2014). Subthreshold attention-deficit/hyperactivity disorder is associated with functional impairments across domains: a comprehensive analysis in a large-scale community study. European Child & Adolescent Psychiatry, 23(8), 627–636. https://doi.org/10.1007/s00787-013-0501-z.
Ishwaran, H. (2007). Variable importance in binary regression trees and forests. Electronic Journal of Statistics, 1, 519–537. doi:https://doi.org/10.1214/07-EJS039.
Karpenko, V., Owens, J. S., Evangelista, N. M., & Dodds, C. (2009). Clinically significant symptom change in children with attention-deficit/hyperactivity disorder: does it correspond with reliable improvement in functioning? Journal of Clinical Psychology, 65, 76–93. https://doi.org/10.1002/jclp.20549.
Karalunas, S. L., Gustafsson, H. C., Dieckmann, N. F., Tipsord, J., Mitchell, S. H., & Nigg, J. T. (2017). Heterogeneity in development of aspects of working memory predicts longitudinal attention deficit hyperactivity disorder symptom change. Journal of Abnormal Psychology, 126(6), 774. https://doi.org/10.1037/abn0000292.
Kazak, A. E. (2018). Editorial: Journal article reporting standards. American Psychologist, 73(1), 1–2. https://doi.org/10.1037/amp0000263.
Kirasich, K., Smith, T., & Sadler, B. (2018). Random forest vs logistic regression: Binary classification for heterogeneous datasets. SMU Data Science Review, 1(3), 9. Available at: https://scholar.smu.edu/datasciencereview/vol1/iss3/9
Kuhn, M. (2008). Caret package. Journal of Statistical Software, 28, 1–26.
Leopold, D. R., Christopher, M. E., Burns, G. L., Becker, S. P., Olson, R. K., & Willcutt, E. G. (2016). Attention-deficit/hyperactivity disorder and sluggish cognitive tempo throughout childhood: temporal invariance and stability from preschool through ninth grade. Journal of Child Psychology and Psychiatry, 57(9), 1066–1074. https://doi.org/10.1111/jcpp.12505.
Li, J. J., Reise, S. P., Chronis-Tuscano, A., Mikami, A. Y., & Lee, S. S. (2016). Item response theory analysis of ADHD symptoms in children with and without ADHD. Assessment, 23(6), 655–671. https://doi.org/10.1177/1073191115591595.
Marcus, D. K., & Barry, T. D. (2011). Does attention-deficit/hyperactivity disorder have a dimensional latent structure? A taxometric analysis. Journal of Abnormal Psychology, 120(2), 427–442. https://doi.org/10.1037/a0021405.
Martel, M. M., Goh, P. K., Lee, C. A., Karalunas, S. L., & Nigg, J. T. (2021). Longitudinal ADHD symptom networks in childhood and adolescence: key symptoms, stability, and predictive validity. Journal of Abnormal Psychology, 130(5), 562–574. https://doi.org/10.1037/abn0000661.
Mota, V. L., & Schachar, R. J. (2000). Reformulating attention-deficit/hyperactivity disorder according to signal detection theory. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 1144–1151. https://doi.org/10.1097/00004583-200009000-00014.
O’Connor, B. C., Garner, A. A., Peugh, J. L., Simon, J., & Epstein, J. N. (2015). Improved but still impaired: symptom-impairment correspondence among youth with attention-deficit hyperactivity disorder receiving community-based care. Journal of Developmental & Behavioral Pediatrics, 36, 106–114. https://doi.org/10.1097/DBP.0000000000000124.
Owens, J. S., Johannes, L. M., & Karpenko, V. (2009). The relation between change in symptoms and functioning in children with ADHD receiving school-based mental health services. School Mental Health, 1, 183–195. https://doi.org/10.1007/s12310-009-9020-y.
Puig-Antich, J., & Ryan, N. (1986). Kiddie schedule for affective disorders and schizophrenia. Pittsburgh, PA: Western Psychiatric Institute.
Scornet, E., Biau, G., & Vert, J. P. (2015). Consistency of random forests. Ann Statist, 43(4), 1716–1741. doi:https://doi.org/10.1214/15-AOS1321.
Teicher, M. H., Polcari, A., Fourligas, N., Vitaliano, G., & Navalta, C. P. (2012). Hyperactivity persists in male and female adults with ADHD and remains a highly discriminative feature of the disorder: a case-control study. BMC psychiatry, 12, 190–204. https://doi.org/10.1186/1471-244X-12-190.
Ustun, B., Adler, L. A., Rudin, C., Faraone, S. V., Spencer, T. J., Berglund, P., Gruber, M. J., & Kessler, R. C. (2017). The world health organization adult attention-deficit/hyperactivity disorder self-report screening scale for DSM-5. JAMA psychiatry, 74(5), 520–527. https://doi.org/10.1001/jamapsychiatry.2017.0298.
Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017). Predicting risk of suicide attempts over time through machine learning. Clinical Psychological Science, 5(3), 457–469. doi:https://doi.org/10.1177/2167702617691560.
Willcutt, E. G. (2012). The prevalence of DSM-IV attention-deficit/hyperactivity disorder: a meta-analytic review. Neurotherapeutics, 9(3), 490–499. https://doi.org/10.1007/s13311-012-0135-8.
Yarkoni, T., & Westfall, J. (2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 12(6), 1100–1122. https://doi.org/10.1177/1745691617693393.
Zoromski, A. K., Owens, J. S., Evans, S. W., & Brady, C. E. (2015). Identifying ADHD symptoms most associated with impairment in early childhood, middle childhood, and adolescence using teacher report. Journal of Abnormal Child Psychology, 43, 1243–1255. https://doi.org/10.1007/s10802-015-0017-8.
Zou, G. Y. (2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12, 399. https://doi.org/10.1037/1082-989X.12.4.399.
Melissa, Mulraney Gonzalo, Arrondo Hande, Musullulu Iciar, Iturmendi-Sabater Samuele, Cortese Samuel J., Westwood Federica, Donno Tobias, Banaschewski Emily, Simonoff Alessandro, Zuddas Manfred, Döpfner Stephen P., Hinshaw David, Coghill (2022) Systematic Review and Meta-analysis: Screening Tools for Attention-Deficit/Hyperactivity Disorder in Children and Adolescents. Journal of the American Academy of Child & Adolescent Psychiatry 61(8) 982-996 S0890856721020840 https://doi.org/10.1016/j.jaac.2021.11.031
Patrick K., Goh Michelle M., Martel Russell A., Barkley (2020) Clarifying ADHD and Sluggish Cognitive Tempo Item Relations with Impairment: A Network Analysis. Journal of Abnormal Child Psychology 48(8) 1047-1061 10.1007/s10802-020-00655-2
Michelle M., Martel Cheri A., Levinson Julia K., Langer Joel T., Nigg (2016) A Network Analysis of Developmental Change in ADHD Symptom Structure From Preschool to Adulthood. Clinical Psychological Science 4(6) 988-1001 10.1177/2167702615618664
Acknowledgements
The authors thank all participants for making this work possible. The data that support the findings of this study are available from the corresponding author upon reasonable request. All authors contributed to the paper’s conception, drafting, data analysis, and approved the final product.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors have no conflicts of interest to disclose. Support was provided by NIH R37-MH-59105 and R01-MH-119119.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee (Research Integrity Office Institutional Review Board; Protocol #4817) and with the 1864 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Goh, P.K., Elkins, A.R., Bansal, P.S. et al. Data-Driven Methods for Predicting ADHD Diagnosis and Related Impairment: The Potential of a Machine Learning Approach. Res Child Adolesc Psychopathol 51, 679–691 (2023). https://doi.org/10.1007/s10802-023-01022-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-023-01022-7