Inter-Rater Agreement for the Milestones and Barriers Assessments of the Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP)
- 50 Downloads
We determined inter-rater agreement for the VB-MAPP, an instrument sometimes used in planning educational goals and evaluating intervention effects for young people with autism. A pair of raters independently rated each of 32 children diagnosed with autism. Intraclass correlation coefficients for the total Milestones and Barrier scores were 0.876 and 0.629, respectively, indicating good and moderate reliability. There was variability in reliability in the different domains of the Milestones Assessment, with most indicating moderate reliability, and most of the individual Barriers Assessment domains indicating poor reliability. These are the first data relevant to the reliability of the VB-MAPP, they suggest that further evaluation of its reliability is merited and that a high reliability for individual domains should not be assumed.
KeywordsVerbal Behavior Milestones Assessment and Placement Program Language assessment Verbal behavior Autism spectrum disorder Inter-rater agreement Reliability
Special thanks to Alyssa Kavner for her assistance with data entry and IOA calculations.
All authors contributed equally to this study and to the preparation of this manuscript.
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This study was approved by a Human Subjects Institutional Review Board (HSIRB).
Informed consent was obtained from all individual participants included in the study prior to the start of services.
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
- Carlson, J. F., Geisinger, K. F., & Jonson, J. L. (Eds.). (2017). The twentieth mental measurements yearbook. Lincoln: Buros Center for Testing.Google Scholar
- Dixon, M. R. (2014). The PEAK relational training system: Direct training module. Carbondale: Shawnee Scientific.Google Scholar
- Dixon, M. R., Belisle, J., Stanley, C., Rowsey, K., Daar, J. H., & Szekely, S. (2015). Toward a behavior analysis of complex language for children with autism: Evaluating the relationship between PEAK and the VB-MAPP. Journal of Developmental and Physical Disabilities, 27, 223–233. https://doi.org/10.1007/s10882-014-9410-4.CrossRefGoogle Scholar
- Gould, E., Dixon, D. R., Najdowski, A. C., Smith, M. N., & Tarbox, J. (2011). A review of assessments for determining the content of early intensive behavioral intervention programs for autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 990–1002. https://doi.org/10.1016/j.rasd.2011.01.012.CrossRefGoogle Scholar
- Stolte, M., Hodgetts, S., & Smith, V. (2016). A critical review of outcome measures used to evaluate the effectiveness of comprehensive, community based treatment for young children with ASD. Research in Autism Spectrum Disorders, 23, 221–234. https://doi.org/10.1016/j.rasd.2015.12.009.CrossRefGoogle Scholar
- Sundberg, M. L. (2008). Verbal behavior milestones assessment and placement program: The VB-MAPP. Concord: AVB Press.Google Scholar
- Sundberg, M. L. (2014). The verbal behavior milestones assessment and placement program: The VB-MAPP (2nd edn.). Concord: AVB Press.Google Scholar
- Walter, S. D., Eliasziw, M., & Donner, A. (1998). Sample size and optimal designs for reliability studies. Statistics in Medicine, 17(1), 101–110. https://doi.org/10.1002/(SICI)1097-0258(19980115)17:1%3C101::AID-SIM727%3E3.0.CO;2-E.CrossRefPubMedGoogle Scholar