Abstract
Adolescents with attention-deficit/hyperactivity disorder (ADHD) experience academic difficulties, but there are limitations to current methods of measuring these problems. The parent-rated Adolescent Academic Problems Checklist (AAPC) is a particularly promising measure, as the items were derived from concerns of parents and teachers of adolescents with ADHD and the scale demonstrates good concurrent validity and treatment sensitivity (Sibley et al. in School Psychology Quarterly, 29(4), 422, 2014; Sibley et al. Journal of Consulting and Clinical Psychology, 84(8), 699, 2016b). Because parents do not observe some academic behaviors queried on the AAPC, they may provide inaccurate responses to some items, leading to measurement error. In the current study, we sought to (1) determine the extent to which parents of adolescents with ADHD possess knowledge of the academic behaviors assessed on the AAPC, (2) determine if the scale maintains the two-factor structure (academic skills and disruptive behavior) and continues to relate to indicators of academic functioning after removing items associated with low parent knowledge, and (3) validate findings with the revised scale in a separate sample of adolescents with ADHD. Results identified five items for which the majority of parents reported little to no knowledge. When removing items with low parental knowledge, the AAPC’s model fit was maintained and the two-factor model remained a better fit than the one-factor model. The relationships between the revised subscales and measures of academic functioning remained significant and largely equivalent to the original version. The revised model demonstrated similar fit in the second sample and was also related to indicators of academic functioning. Implications for clinical practice are discussed.
Similar content being viewed by others
Data and/or Code Availability
The datasets generated during and/or analyzed during the current study may be available from the corresponding author on reasonable request.
References
Asparouhov, T., & Muthén, B. (2010). Weighted Least Squares Estimation with Missing Data. Mplus Technical Appendix.
Brady, C. E., Evans, S. W., Berlin, K. S., Bunford, N., & Kern, L. (2012). Evaluating school impairment with adolescents using the classroom performance survey. School Psychology Review, 41(4), 429.
De Los Reyes, A., Cook, C. R., Gresham, F. M., Makol, B. A., & Wang, M. (2019). Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research. Journal of School Psychology, 74, 74–89.
DiPerna, J. C., & Elliott, S. N. (1999). Development and validation of the academic competence evaluation scales. Journal of Psychoeducational Assessment, 17(3), 207–225.
DuPaul, G. J., Evans, S. W., Allan, D., Puzino, K., Xiang, J., Cooper, J., & Owens, J. S. (2019). High school teacher ratings of academic, social, and behavioral difficulties: Factor structure and normative data. School Psychology, 34, 479–491.
DuPaul, G. J., Power, T. J., Anastopoulos, A. D., & Reid, R. (2016). ADHD Rating Scale-5 for Children and Adolescents: Checklists, Norms, and Clinical Interpretation. Guilford Publications.
DuPaul, G. J., Evans, S. W., Owens, J. S., Cleminshaw, C. L., Kipperman, K., Fu, Q., & Benson, K. (2021). School-based intervention for adolescents with attention-deficit/hyperactivity disorder: Effects on academic functioning. Journal of School Psychology, 87, 48–63.
Elliott, S. N., DePerna, J. C., & Shapiro, E. S. (2001). AIMS: Academic Intervention Monitoring System: Guidebook. Psychological Corporation.
Evans, S. W., Brady, C. E., Harrison, J. R., Bunford, N., Kern, L., State, T., & Andrews, C. (2013). Measuring ADHD and ODD symptoms and impairment using high school teachers’ ratings. Journal of Clinical Child and Adolescent Psychology, 42(2), 197–207.
Evans, S. W., Serpell, Z., & White, C. (2005a). The transition to middle school: Preparing for challenge and success. Attention! Magazine (CHADD).
Evans, S. W., Allen, J., Moore, S., & Strauss, V. (2005b). Measuring symptoms and functioning of youth with ADHD in middle schools. Journal of Abnormal Child Psychology, 33(6), 695–706.
Fabiano, G. A., Pelham, W. E., Waschbusch, D. A., Gnagy, E. M., Lahey, B. B., Chronis, A. M., & Burrows-MacLean, L. (2006). A practical measure of impairment: Psychometric properties of the Impairment Rating Scale in samples of children with attention deficit hyperactivity disorder and two school-based samples. Journal of Clinical Child and Adolescent Psychology, 35(3), 369–385.
Kline, R. B. (2016). Principles and practices of structural equation modeling (4th ed.). Guilford.
Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.). Muthén & Muthén.
Miller, F. G., & Lazowski, L. E. (2001). The adolescent SASSI-A2 manual: Identifying substance use disorders. Springville, IN: The SASSI Institute.
Owens, J. S., Evans, S. W., & Margherio, S. M. (2020). Assessment of attention deficit hyperactivity disorder. In E. A. Youngstrom, M. J. Prinstein, E. J. Mash, & R. A. Barkley (Eds.), Assessment of childhood disorders, fifth edition. New York City, NY: Guilford Press.
Pelham, W. E., Jr., Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34(3), 449–476.
Pelham, W. E., Evans, S. W., Gnagy, E. M., & Greenslade, K. E. (1992). Teacher ratings of DSM-III—R symptoms for the disruptive behavior disorders: Prevalence, factor analyses, and conditional probabilities in a special education sample. School Psychology Review.
Pliszka, S. R., Lopez, M., Crismon, M. L., Toprac, M. G., Hughes, C. W., Emslie, G., & Boemer, C. (2003). A feasibility study of the Children’s Medication Algorithm Project (CMAP) algorithm for the treatment of ADHD. Journal of the American Academy of Child and Adolescent Psychiatry, 42(3), 279–287.
Preacher, K. J., & Coffman, D. L. (2006, May). Computing power and minimum sample size for RMSEA [Computer software]. Available from http://quantpsy.org/
Shaffer, D., Fisher, P., Lucas, C. P., Dulcan, M. K., & Schwab-Stone, M. E. (2000). NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 28–38.
Sibley, M. H., Altszuler, A. R., Morrow, A. S., & Merrill, B. M. (2014). Mapping the academic problem behaviors of adolescents with ADHD. School Psychology Quarterly, 29(4), 422.
Sibley, M. H., Campez, M., Perez, A., Morrow, A. S., Merrill, B. M., Altszuler, A. R., & Yeguez, C. E. (2016a). Parent management of organization, time management, and planning deficits among adolescents with ADHD. Journal of Psychopathology and Behavioral Assessment, 38(2), 216–228.
Sibley, M. H., & Coxe, S. J. (2020). The ADHD teen integrative data analysis longitudinal (TIDAL) dataset: background, methodology, and aims. BMC Psychiatry, 20(1), 1–12.
Sibley, M. H., Graziano, P. A., Kuriyan, A. B., Coxe, S., Pelham, W. E., Rodriguez, L., & Ward, A. (2016b). Parent–teen behavior therapy+ motivational interviewing for adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84(8), 699.
Sibley, M. H., Rohde, L. A., Swanson, J. M., Hechtman, L. T., Molina, B. S., Mitchell, J. T., & Stehli, A. (2017). Late-onset ADHD reconsidered with comprehensive repeated assessments between ages 10 and 25. American Journal of Psychiatry, 175(2), 140–149.
Sibley, M. H., & Kuriyan, A. B. (2016). DSM-5 changes enhance parent identification of symptoms in adolescents with ADHD. Psychiatry Research, 242, 180–185.
Smith, B. H., Pelham, W. E., Gnagy, E. M., Molina, B. S. G., & Evans, S. W. (2000). The reliability, validity, and unique contributions of self-report by adolescents receiving treatment for attention-deficit/hyperactivity disorder. Journal of Consulting and Clinical Psychology, 68(3), 489–499.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (Vol. 5). Pearson.
Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence–Second Edition (WASI-II). San Antonio, TX: NCS Pearson.
Weller, E. B., Weller, R. A., Fristad, M. A., Rooney, M. T., & Schecter, J. (2000). Children’s interview for psychiatric syndromes (ChIPS). Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 76–84.
Youngstrom, E. A. (2008). Evidence-based strategies for the assessment of developmental psychopathology: Measuring prediction, prescription, and process. In D. J. Miklowitz, W. E. Craighead, & L. Craighead (Eds.), Developmental Psychopathology (pp. 34–77). Wiley.
Zoromski, A., Owens, J. S., Evans, S. W., & Brady, C. (2015). Identifying ADHD symptoms most associated with impairment in early childhood, middle childhood, and adolescence using teacher report. Journal of Abnormal Child Psychology, 43, 1243–1255.
Funding
The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305A140356 to Ohio University. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education. National Institute of Mental Health. Title: Integrative Data Analysis of Psychosocial Treatment Studies for Adolescent ADHD. (Sibley/Coxe Co-PIs). R03 MH116397. Amount:$100,000 (Direct Costs); 2018–2020. National Institute of Mental Health. Title: Effectiveness of MI Enhanced Family Based Behavior Therapy for Adolescents with ADHD. (Sibley, PI). R01 MH106587. Amount:$1,750,000; 2015–2020. Klingenstein 3rdGeneration Foundation Fellowship in ADHD. Title: Optimizing Psychosocial Treatments for Adolescents with ADHD. (Sibley, PI). Amount: $60,000; 2014–2016. Institute of Education Sciences. Title: A Summer Preparatory Program for Middle and High School Students with ADHD. R324A120169. (Pelham, PI). Amount:$3,500,000; 2012–2016.
Author information
Authors and Affiliations
Contributions
Conceptualization: Kari Benson, Steven W. Evans; Margaret H. Sibley, Darcey M. Allan, Julie Sarno Owens, George J. DuPaul; Methodology: Kari Benson, Steven W. Evans; Margaret H. Sibley, Darcey M. Allan; Formal analysis and investigation: Kari Benson; Darcey M. Allan; Writing—original draft preparation: Kari Benson; Writing—review and editing: Kari Benson, Steven W. Evans; Margaret H. Sibley, Darcey M. Allan, Julie Sarno Owens, George J. DuPaul; Funding acquisition: Steven W. Evans; Margaret H. Sibley, Julie Sarno Owens, George J. DuPaul.
Corresponding author
Ethics declarations
Ethical Approval
The study was approved by the appropriate institutional and/or national research ethics committee and was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. Approval was obtained from the Institutional Review Boards at Ohio University, Lehigh University, and Florida International University. The procedures used in this study adhere to the tenets of the Declaration of Helsinki.
Consent to Participate
Informed consent was obtained from legal guardians and informed assent was obtained from their adolescents.
Consent for Publication
Not applicable.
Conflicts of Interest
Kari Benson, Steven W. Evans, Margaret H. Sibley, Darcey M. Allan, Julie Sarno Owens and George J. DuPaul declare they have no conflict of interest.
Experiment Participants
All procedures involving human participants performed in the study were in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Benson, K., Evans, S.W., Sibley, M.H. et al. An Examination of the Parent-Rated Adolescent Academic Problems Checklist: What Do Parents Really Know?. J Psychopathol Behav Assess 44, 151–164 (2022). https://doi.org/10.1007/s10862-021-09942-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-021-09942-8