Abstract
The present study examined the relationships between the standardized applied behavior analysis (ABA) direct assessment, the PEAK Comprehensive Assessment (PCA), and established assessments commonly used in educational and clinical settings, including the Childhood Autism Rating Scale – Third Edition (CARS-3), the PDD Behavior Inventory (PDDBI), the Vineland Adaptive Behavior Scale – Second Edition (VABS-2), and intelligence, including the Wechsler Preschool and Primary Scale of Intelligence (WPPSI-IV) and the Wechsler Intelligence Scale for Children (WISC-V). Utilizing a sample of 73 children with autism ranging from 3 to 21 years old, the present study found the PCA to be significantly correlated with the established measures. The result suggests evidence of convergent validity of the PCA, and internal consistency among its subtests. Implications of this behavior-analytic standardized assessment were discussed.
Similar content being viewed by others
References
Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavioral Education, 28(3), 362–388. https://doi.org/10.1007/s10864-019-09327-8
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub.
Arick, J. R., Loss, L., Falco, R., & Krug, D. A. (2015). STAR program: Strategies for Teaching Based on Autism Research (2 ed.). Pro-Ed.
Ayllon, T., & Kelly, K. (1972). Effects of reinforcement on standardized test performance. Journal of Applied Behavior Analysis, 5(4), 477–484. https://doi.org/10.1901/jaba.1972.5-477
Belisle, J., Dixon, M. R., & Stanley, C. R. (2018). The mediating effects of derived relational responding on the relationship between verbal operant development and IQ. Behavior Analysis in Practice, 11(4), 411–416. https://doi.org/10.1007/s40617-018-0215-2
Bijou, S. W., Peterson, R. F., & Ault, M. H. (1968). A method to integrate descriptive and experimental field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis, 1(2), 175–191. https://doi.org/10.1901/jaba.1968.1-175
Binet, A., & Simon, T. (1905/1916). The Development of Intelligence in Children (the Binet-Simon Scale) (E. S. Kite, Trans.). Williams & Wilkins.
Cassidy, S., Roche, B., Colbert, D., Stewart, I., & Grey, I. M. (2016). A relational frame skills training intervention to increase general intelligence and scholastic aptitude. Learning and Individual Differences, 47, 222–235. https://doi.org/10.1016/j.lindif.2016.03.001
Cassidy, S., Roche, B., & Hayes, S. C. (2011). A relational frame training intervention to raise intelligence quotients: A pilot study. The Psychological Record, 61(2), 173–198. https://doi.org/10.1007/BF03395755
Cohen, I. L., & Sudhalter, V. (2005). The PDD Behavior Inventory. Psychological Assessment Resources, Inc.
Culbertson, W., & Zillmer, E. (2001). The Tower of London - Drexel University. Multi-Health Systems.
Dixon, M. R. (2014a). PEAK relational training system: Direct training module. Shawnee Scientific Press.
Dixon, M. R. (2014b). PEAK relational training system: generalization module. Shawnee Scientific Press.
Dixon, M. R. (2015). PEAK relational training system: Equivalence module. Shawnee Scientific Press.
Dixon, M. R. (2016). PEAK relational training system: Transformation module. Shawnee Scientific Press.
Dixon, M. R. (2019). PEAK comprehensive assessment. Shawnee Scientific Press.
Dixon, M. R., Belisle, J., Stanley, C., Rowsey, K., Daar, J. H., & Szekely, S. (2015). Toward a behavior analysis of complex language for children with autism: Evaluating the relationship between PEAK and the VB-MAPP. Journal of Developmental and Physical Disabilities, 27(2), 223–233. https://doi.org/10.1007/s10882-014-9410-4
Dixon, M. R., Belisle, J., & Stanley, C. R. (2018a). Derived relational responding and intelligence: Assessing the relationship between the PEAK-E pre-assessment and IQ with individuals with autism and related disabilities. The Psychological Record, 68(4), 419–430. https://doi.org/10.1007/s40732-018-0284-1
Dixon, M. R., Belisle, J., Stanley, C. R., Daar, J. H., & Williams, L. A. (2016). Derived equivalence relations of geometry skills in students with autism: An application of the PEAK-E curriculum. The Analysis of Verbal Behavior, 32(1), 38–45. https://doi.org/10.1007/s40616-016-0051-9
Dixon, M. R., Paliliunas, D., Barron, B. F., Schmick, A. M., & Stanley, C. R. (2019). Randomized controlled trial evaluation of ABA content on IQ gains in children with autism. Journal of Behavioral Education. https://doi.org/10.1007/s10864-019-09344-7
Dixon, M. R., & Stanley, C. R. (2020). PEAK Relational Training System. In F. R. Volkmar (Ed.), Encyclopedia of Autism Spectrum Disorders. Springer. https://doi.org/10.1007/978-1-4614-6435-8_102280-1
Dixon, M. R., Whiting, S. W., Rowsey, K., & Belisly, J. (2014). Assessing the relationship between intelligence and the PEAK relational training system. Research in Autism Spectrum Disorders, 8(9), 1208–1213. https://doi.org/10.1016/j.rasd.2014.05.005
Dixon, M. R., Wiggins, S. H., & Belisle, J. (2018b). The effectiveness of the PEAK relational training system and corresponding changes on the VB-MAPP for young adults with autism. Journal of Applied Behavior Analysis, 51(2), 321–334. https://doi.org/10.1002/jaba.448
Fisher, W. W., Piazza, C. C., & Roane, H. S. (2011). Handbook of Applied Behavior Analysis. Guilford Press.
Hansel, K. (2013). Rethinking insurance coverage of “experimental” Applied Behavioral Analysis therapy and its usefulness in combating Autism Spectrum Disorder. Journal of Legal Medicine, 34(2), 215–233. https://doi.org/10.1080/01947648.2013.800798
Hintze, J. M., & Matthews, W. J. (2004). The generalizability of systematic direct observations across time and setting: A preliminary investigation of the psychometrics of behavioral observation. School Psychology Review, 33(2), 258–270. https://doi.org/10.1080/02796015.2004.12086247
Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896. https://doi.org/10.1080/15374416.2010.517169
Kaplan, R. M., & Saccuzzo, D. P. (2009). Psychological Testing: Principles, Applications, and Issues, Seventh Edition. Cengage Learning.
Keintz, K. S., Miguel, C. F., Kao, B., & Finn, H. E. (2011). Using conditional discrimination training to produce emergent relations between coins and their values in children with autism. Journal of Applied Behavior Analysis, 44(4), 909–913. https://doi.org/10.1901/jaba.2011.44-909
Koegel, L. K., Koegel, R. L., & Smith, A. (1997). Variables related to differences in standardized test outcomes for children with autism. Journal of Autism and Developmental Disorders, 27(3), 233–243. https://doi.org/10.1023/A:1025894213424
Malkin, A., Dixon, M. R., Speelman, R. C., & Luke, N. (2017). Evaluating the relationships between the PEAK relational training system–direct training module, Assessment of Basic Language and Learning Skills-Revised, and the Vineland Adaptive Behavior Scales–II. Journal of Developmental and Physical Disabilities, 29(2), 341–351. https://doi.org/10.1007/s10882-016-9527-8
May, B. K., & Flake, L. (2019). PEAK Pre-Assessments: Preliminary evidence establishing internal consistency and construct validity. Behavior Analysis in Practice, 12(3), 627–631. https://doi.org/10.1007/s40617-018-00318-1
McKeel, A., Dixon, M. R., Daar, J. H., Rowsey, K. E., & Szekely, S. (2015a). Evaluating the efficacy of the PEAK relational training system using a randomized controlled trial of children with autism. Journal of Behavioral Education, 24(2), 230–241. https://doi.org/10.1007/s10864-015-9219-y
McKeel, A., Rowsey, K., Dixon, M. R., & Daar, J. H. (2015b). Correlation between PEAK relational training system and one-word picture vocabulary tests. Research in Autism Spectrum Disorders, 12, 34–39. https://doi.org/10.1016/j.rasd.2014.12.007
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001). Psychological testing and psychological assessment: A review of evidence and issues. American Psychologist, 56(2), 128. https://doi.org/10.1037/0003-066X.56.2.128
Moore, J. L., Yi, Z., Hinman, J. M., Barron, B. F., & Dixon, M. R. (2020). Examining the convergent validity between the PEAK Relational Training System’s semi-standardized and standardized skill assessments. Journal of Developmental and Physical Disabilities. https://doi.org/10.1007/s10882-020-09771-9
Partington, J. (2006). The Assessment of Basic Language and Learning Skills Revised. Behavior Analysts. video.alexanderstreet.com/watch/the-assessment-of-basic-language-and-learning-skills-revised
Partington, J., & Sundberg, M. L. (1998). Assessment of basic language and learning skills (The ABLLS): An assessment for language delayed students. Behavior Analysts.
Powers, M. D., Palmieri, M. J., Egan, S. M., Rohrer, J. L., Nulty, E. C., & Forte, S. (2014). Behavioral assessment of individuals with autism: Current practice and future directions. In F. R. Volkmar, S. J. Rogers, R. Paul, & K. A. Pelphrey (Eds.), Handbook of Autism and Pervasive Developmental Disorders, Fourth Edition (pp. 695–736). Wiley. https://doi.org/10.1002/9781118911389.hautc28
Ruble, L. A., Heflinger, C. A., Renfrew, J. W., & Saunders, R. C. (2005). Access and service use by children with autism spectrum disorders in Medicaid managed care. Journal of Autism and Developmental Disorders, 35(1), 3–13. https://doi.org/10.1007/s10803-004-1026-6
Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood Autism Rating Scale Second Edition. Western Psychological Services.
Sparrow, S. S., Cicchetti, D. V., & Saulnier, C. A. (2016). Vineland Adaptive Behavior Scales Third Edition. The Psychological Corporation.
Stanley, C. R., Belisle, J., & Dixon, M. R. (2018). Equivalence-based instruction of academic skills: Application to adolescents with autism. Journal of Applied Behavior Analysis, 51(2), 352–359. https://doi.org/10.1002/jaba.446
Sundberg, M. L. (2008). VB-MAPP: Verbal behavior milestones assessment and placement program. AVB Press.
Terman, L. M. (1916). The Measurement of Intelligence. Houghton Mifflin.
Wechsler, D. (2012). Wechsler Preschool and Primary Scale of Intelligence Fourth Edition. The Psychological Corporation.
Wodka, E. L., Mathy, P., & Kalb, L. (2013). Predictors of phrase and fluent speech in children with autism and severe language delay. Pediatrics, 131(4), e1128–e1134. https://doi.org/10.1542/peds.2012-2221
Author information
Authors and Affiliations
Contributions
Both authors from the University of Illinois Chicago were blind to all subject assignment, experimental conditions, and were only given access to obtained outcomes after completion of the entire study.
Corresponding author
Ethics declarations
Ethical Approval
The procedure of the current study was reviewed and approved by the Hawaii Department of Education Data Governance Office and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Conflict of Interest
Mark R. Dixon receives small royalties from sales of the PCA. The remaining authors declare no conflicts of interest.
Consent to Participate
Parents or legal guardians were informed and consented for their child to be a participant in the study, and were given the opportunity to opt out before the study began and at any time thereafter.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sutton, A., Pikula, A., Yi, Z. et al. Evaluating the Convergent Validity of the PEAK Comprehensive Assessment (PCA): Intelligence, Behavior Challenges, and Autism Symptom Severity. J Dev Phys Disabil 34, 549–570 (2022). https://doi.org/10.1007/s10882-021-09814-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10882-021-09814-9