Skip to main content

Examining the Convergent Validity Between the PEAK Relational Training System’s Semi-Standardized and Standardized Skill Assessments

Abstract

The current study examined the convergent validity between the standardized PEAK Comprehensive Assessment (PCA) and the semi-standardized PEAK Pre-assessment (PEAK-PA). Twenty-two participants were administered each tool, and an item by item analysis was conducted to evaluate correlations between tests. The results suggested a strong positive correlation between the PEAK-PA and the PCA score (r = .967, p < .0001). Correlations between each subtest on the PCA and the PEAK-PA were all significant at .001 level. When looking at revised items on the PCA, individuals most often scored higher on the PEAK-PA than the PCA. The results suggested that although these two tests were highly correlated, the PCA may assess a boarder range of skills that were not previously captured by the PEAK-PA. Implications for practicing clinicians in the area of autism treatment are presented.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2

References

  1. Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavioral Education, 28(3), 362–388.

    Article  Google Scholar 

  2. American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Pub.

  3. Barron, B. F., Paliliunas, D., & Dixon, M. R. (2020). Evaluation of the PEAK-DT and PEAK-G Pre-assessments: Comparing directly implemented and indirect assessments of verbal abilities. Journal of Behavioral Education, 1–20.

  4. Beavers, G. A., Iwata, B. A., & Lerman, D. C. (2013). Thirty years of research on the functional analysis of problem behavior. Journal of Applied Behavior Analysis, 46(1), 1–21.

    Article  Google Scholar 

  5. Boyle, C. A., Boulet, S., Schieve, L. A., Cohen, R. A., Blumberg, S. J., Yeargin-Allsopp, M., … Kogan, M. D. (2011). Trends in the prevalence of developmental disabilities in US children, 1997–2008.Pediatrics, 127(6), 1034-1042.

  6. Centers for Disease Control and Prevention (2014).Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years - Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2010. Retrieved from https://stacks.cdc.gov/view/cdc/22182/cdc_22182_DS1.pdf

  7. Cohen, H., Amerine-Dickens, M., & Smith, T. (2006). Early intensive behavioral treatment: Replication of the UCLA model in a community setting. Journal of Developmental & Behavioral Pediatrics, 27(2), S145–S155.

    Article  Google Scholar 

  8. Cooper, J. O., Heron, T. E., & Heward, W. L. (2007).Applied behavior analysis: Pearson Education, Inc.

  9. Dixon, M. R. (2014a). PEAK relational training system: direct training module. Carbondale, IL: Shawnee Scientific Press.

    Google Scholar 

  10. Dixon, M. R. (2014b). PEAK relational training system: Generalization module. Carbondale, IL: Shawnee Scientific Press.

    Google Scholar 

  11. Dixon, M. R. (2015). PEAK relaitonal training system: Equivalence module. Carbondale, IL: Shawnee Scientific Press.

    Google Scholar 

  12. Dixon, M. R. (2016). PEAK relational training system: Transformation module. Carbondale, IL: Shawnee Scientific Press.

    Google Scholar 

  13. Dixon, M. R. (2019). PEAK Comprehensive Assessment. Carbondale, IL: Shawnee Scientific Press.

    Google Scholar 

  14. Dixon, M. R., Belisle, J., Stanley, C., Rowsey, K., Daar, J. H., & Szekely, S. (2015). Toward a behavior analysis of complex language for children with autism: Evaluating the relationship between PEAK and the VB-MAPP. Journal of Developmental and Physical Disabilities, 27(2), 223–233.

    Article  Google Scholar 

  15. Dixon, M. R., Belisle, J., & Stanley, C. R. (2018). Derived relational responding and intelligence: Assessing the relationship between the PEAK-E pre-assessment and IQ with individuals with autism and related disabilities. The Psychological Record, 68(4), 419–430.

    Article  Google Scholar 

  16. Dixon, M. R., Carman, J., Tyler, P. A., Whiting, S. W., Enoch, M. R., & Daar, J. H. (2014). PEAK relational training system for children with autism and developmental disabilities: Correlations with Peabody Picture Vocabulary Test and assessment reliability. Journal of Developmental and Physical Disabilities, 26(5), 603–614.

    Article  Google Scholar 

  17. Dixon, M. R., Paliliunas, D., Barron, B. F., Schmick, A. M., & Stanley, C. R. (2019). Randomized controlled trial evaluation of ABA content on IQ gains in children with autism. Journal of Behavioral Education, 1–23.

  18. Dracobly, J. D., Dozier, C. L., Briggs, A. M., & Juanico, J. F. (2018). Reliability and validity of indirect assessment outcomes: Experts versus caregivers. Learning and motivation, 62, 77–90.

    Article  Google Scholar 

  19. Hanley, G. P., Iwata, B. A., & McCord, B. E. (2003). Functional analysis of problem behavior: A review. Journal of Applied Behavior Analysis, 36(2), 147–185. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1284431/pdf/12858983.pdf

  20. Ingvarsson, E. T., Cammilleri, A. P., & Macias, H. (2012). Emergent listener responses following intraverbal training in children with autism. Research in Autism Spectrum Disorders, 6(2), 654–664.

    Article  Google Scholar 

  21. Koegel, L. K., Koegel, R. L., & Smith, A. (1997). Variables related to differences in standardized test outcomes for children with autism. Journal of Autism and Developmental Disorders, 27(3), 233–243.

    Article  Google Scholar 

  22. Lord, C., Risi, S., & Pickles, A. (2004). Trajectory of language development in autistic spectrum disorders. In M. Rice & S. Warren (Eds.), Developmental Language DisordersL From Phenotypes to Etiologies (pp. 7–29). Mahwah, NJ: Lawerence Erlbaum Associates.

    Google Scholar 

  23. Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of consulting and clinical psychology, 55(1), 3.

    Article  Google Scholar 

  24. Malkin, A., Dixon, M. R., Speelman, R. C., & Luke, N. (2017). Evaluating the relationships between the PEAK relational training system–direct training module, Assessment of Basic Language and Learning Skills-Revised, and the Vineland Adaptive Behavior Scales–II. Journal of Developmental and Physical Disabilities, 29(2), 341–351.

    Article  Google Scholar 

  25. Martin, N. T., Bibby, P., Mudford, O. C., & Eikeseth, S. (2003). Toward the use of a standardized assessment for young children with autism: Current assessment practices in the UK. Autism, 7(3), 321–330.

    Article  Google Scholar 

  26. May, B. K., & Flake, L. (2019). PEAK Pre-Assessments: Preliminary Evidence Establishing Internal Consistency and Construct Validity. Behavior Analysis in Practice, 12(3), 627–631.

    Article  Google Scholar 

  27. McEachin, J. J., Smith, T., & IvarLovaas, O. (1993). Long-term outcome for children with autism who received early intensive behavioral treatment. American journal of mental retardation, 97, 359–359.

    PubMed  Google Scholar 

  28. McKeel, A., Dixon, M. R., Daar, J. H., Rowsey, K. E., & Szekely, S. (2015). Evaluating the efficacy of the PEAK relational training system using a randomized controlled trial of children with autism. Journal of Behavioral Education, 24(2), 230–241.

    Article  Google Scholar 

  29. McKeel, A., Rowsey, K., Dixon, M. R., & Daar, J. H. (2015). Correlation between PEAK relational training system and one-word picture vocabulary tests. Research in Autism Spectrum Disorders, 12, 34–39. https://doi.org/10.1016/j.rasd.2014.12.007

    Article  Google Scholar 

  30. Moore, J. W., Rizer, H. B., Warren, L. K., Yeager, M. G., Brewer, R. R., Barker, L. K., … Potter, M. (2019). An Initial Evaluation of an Assessment Method for the PEAK Relational System Direct Training Module. Behavior Analysis in Practice, 1–11.

  31. National Autism Center (Producer) (2015). National Standards Project, Phase 2. Retrieved from https://www.nationalautismcenter.org/download/4773/

  32. Odom, S. L., Boyd, B. A., Hall, L. J., & Hume, K. (2010). Evaluation of comprehensive treatment models for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 40(4), 425–436.

    Article  Google Scholar 

  33. Ruble, L. A., Heflinger, C. A., Renfrew, J. W., & Saunders, R. C. (2005). Access and service use by children with autism spectrum disorders in Medicaid managed care. Journal of Autism and Developmental Disorders, 35(1), 3–13.

    Article  Google Scholar 

  34. Sallows, G. O., & Graupner, T. D. (2005). Intensive behavioral treatment for children with autism: Four-year outcome and predictors. American Journal on Mental Retardation, 110(6), 417–438.

    Article  Google Scholar 

  35. Sparrow, S. S., Cicchetti, D. V., & Saulnier, C. A. (2016). Vineland Adaptive Behavior Scales (3rd ed.). San Antonio, TX: The Psychological Corporation.

    Google Scholar 

  36. Sutton, A., Pikula, A., Yi, Z., & Dixon, M. R. (under review). Evaluating a standartized Language and Cognition Assessmenet: Correlation Between the PEAK Comprehensive Assessment and intelligent behavior, behavior challanges and autism symptom severity.

  37. Virués-Ortega, J. (2010). Applied behavior analytic intervention for autism in early childhood: Meta-analysis, meta-regression and dose–response meta-analysis of multiple outcomes. Clinical psychology review, 30(4), 387–399.

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mark R. Dixon.

Ethics declarations

Conflict of Interest

Mark R. Dixon receives small royalties from sales of the PEAK.

Ethics Approval

The content and procedure of this study was in accordance with the ethical standards as laid down in the 1964 Helsinki Declaration and was approved by the Human Subjects Committee at the Southern Illinois University Carbondale (Date: 08/13/19, Protocol: 15334).

Consent to Participate

Written informed consent was obtained from all participants’ parents or legal guardians.

Additional information

Research was conducted at Southern Illinois University.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Moore, J.L., Yi, Z., Hinman, J.M. et al. Examining the Convergent Validity Between the PEAK Relational Training System’s Semi-Standardized and Standardized Skill Assessments. J Dev Phys Disabil 33, 757–770 (2021). https://doi.org/10.1007/s10882-020-09771-9

Download citation

Keywords

  • PCA
  • PEAK pre-assessment
  • Standardized assessment
  • ABA