Advertisement

Journal of Autism and Developmental Disorders

, Volume 49, Issue 11, pp 4585–4594 | Cite as

Social Validity and Teachers’ Use of Evidence-Based Practices for Autism

  • Jordan McNeillEmail author
Original Paper

Abstract

The autism intervention literature focuses heavily on the concept of evidence-based practice, with less consideration of the acceptability, feasibility, and contextual alignment of interventions in practice. A survey of 130 special educators was conducted to quantify this “social validity” of evidence-based practices and analyze its relationship with knowledge level and frequency of use. Results indicate that knowledge, use, and social validity are tightly-connected and rank the highest for modeling, reinforcement, prompting, and visual supports. Regression analysis suggests that greater knowledge, higher perceived social validity, and a caseload including more students with autism predicts more frequent use of a practice. The results support the vital role that social validity plays in teachers’ implementation, with implications for both research and practice.

Keywords

Autism Social validity Evidence-based practice Special education Intervention 

Notes

Acknowledgments

The author thanks Dr. Daniel Riffe, Professor of Media and Journalism at UNC Chapel Hill, for assistance with methodological design, implementation, and participant incentives. Additional acknowledgments provided to Dr. Cathy Zimmer and the consultants at the Odum Institute at UNC Chapel Hill for their statistical consulting services.

Author Contributions

JM was the lead researcher and designed the study, collected data, conducted statistical analyses, and drafted and revised the manuscript.

Compliance with Ethical Standards

Conflict of interest

The author declares that they have no conflict of interest.

Ethical Approval

All procedures performed in this study involving human participants were in accordance with the ethical standards of the institutional research committee. IRB #18-2576 was reviewed by the Office of Human Research Ethics and was determined to be exempt from further review according to regulatory category 2, survey, interview, or public observation, under 45 CFR 46.101(b).

Supplementary material

10803_2019_4190_MOESM1_ESM.txt (79 kb)
Supplementary material 1 (TXT 78 kb)

References

  1. Aarons, G. A., Glisson, C., Hoagwood, K., Kelleher, K., Landsverk, J., & Cafri, G. (2010). Psychometric properties and US national norms of the evidence-based practice attitude scale (EBPAS). Psychological Assessment, 22(2), 356–365.CrossRefGoogle Scholar
  2. Briesch, A. M., Chafouleas, S. M., Neugebauer, S. R., & Riley-Tillman, T. C. (2013). Assessing influences on intervention implementation: Revision of the usage rating profile-intervention. Journal of School Psychology, 51, 81–96.CrossRefGoogle Scholar
  3. Brock, M. E., & Carter, E. W. (2017). A meta-analysis of educator training to improve implementation of interventions for students with disabilities. Remedial and Special Education, 38(3), 131–144.CrossRefGoogle Scholar
  4. Brock, M. E., Huber, H. B., Carter, E. W., Juarez, A. P., & Warren, Z. E. (2014). Statewide assessment of professional development needs related to educating students with autism spectrum disorder. Focus on Autism and Other Developmental Disabilities, 29(2), 67–79.CrossRefGoogle Scholar
  5. Callahan, K., Hughes, H. L., Mehta, S., Toussaint, K. A., Nichols, S. M., Ma, P. S., et al. (2017). Social validity of evidence-based practices and emerging interventions in autism. Focus on Autism and Other Developmental Disabilities, 32(3), 188–197.CrossRefGoogle Scholar
  6. Carter, S. L. (2010). The social validity manual: A guide to subjective evaluation of behavior interventions. London: Academic Press.Google Scholar
  7. Chafouleas, S. M., Briesch, A. M., Neugebauer, S. R., & Riley-Tillman, T. C. (2011). Usage rating profile—intervention (Revised). Storrs, CT: University of Connecticut.Google Scholar
  8. Combes, B. H., Chang, M., Austin, J. E., & Hayes, D. (2016). The use of evidenced-based practices in the provision of social skills training for students with autism spectrum disorder among school psychologists. Psychology in the Schools, 53(5), 548–563.CrossRefGoogle Scholar
  9. Cook, B. G., & Odom, S. L. (2013). Evidence-based practices and implementation science in special education. Exceptional Children, 79(2), 135–144.Google Scholar
  10. Desimone, L. M., & Garet, M. S. (2015). Best practices in teachers’ professional development in the United States. Psychology, Society, & Education, 7(3), 252–263.CrossRefGoogle Scholar
  11. Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Hoboken, NJ: Wiley.Google Scholar
  12. Dingfelder, H. E., & Mandell, D. S. (2011). Bridging the research-to-practice gap in autism intervention: An application of diffusion of innovation theory. Journal of Autism and Developmental Disorders, 41(5), 597–609.CrossRefGoogle Scholar
  13. Guskey, T. R., & Yoon, K. S. (2009). What works in professional development? Phi Delta Kappan, 90(7), 495–500.CrossRefGoogle Scholar
  14. Hardin, B. L., & Koppenhaver, D. A. (2016). Flipped professional development: An innovation in response to teacher insights. Journal of Adolescent & Adult Literacy, 60(1), 45–54.CrossRefGoogle Scholar
  15. Hess, K. L., Michael, A. E., Morrier, J., Juane, A. L., Ae, H., & Ivey, M. L. (2008). Autism treatment survey: Services received by children with autism spectrum disorders in public school classrooms. Journal of Autism and Developmental Disorders, 38, 961–971.CrossRefGoogle Scholar
  16. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179.Google Scholar
  17. Individuals with Disabilities Education Act, (2004) 20 U.S.C. § 1400.Google Scholar
  18. Joyce, B. R., & Showers, B. (2002). Student achievement through staff development. Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  19. Leblanc, L., Richardson, W., & Burns, K. A. (2009). Autism spectrum disorder and the inclusive classroom: Effective training to enhance knowledge of ASD and evidence-based practices. Teacher Education and Special Education, 32(2), 166–179.CrossRefGoogle Scholar
  20. Nakagawa, S., & Schielzeth, H. (2013). A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, 4(2), 133–142.CrossRefGoogle Scholar
  21. National Autism Center. (2015). Findings and conclusions: National standards project, phase 2. Randolph, MA: AuthorGoogle Scholar
  22. No Child Left Behind Act [NCLB], Pub. L. No. 1425 (2002). 115.Google Scholar
  23. North Carolina Department of Public Instruction. (2019). State summary of public school full-time personnel. http://apps.schools.nc.gov/ords/f?p=145:21:::NO:::.
  24. Parsons, S., Charman, T., Faulkner, R., Ragan, J., Wallace, S., & Wittemeyer, K. (2013). Commentary-bridging the research and practice gap in autism: The importance of creating research partnerships with schools. Autism, 17(3), 268–280.CrossRefGoogle Scholar
  25. Paynter, J., & Keen, D. (2014). Knowledge and use of intervention practices by community-based early intervention service providers. Journal of Autism and Developmental Disorders, 45, 1614–1623.CrossRefGoogle Scholar
  26. Paynter, J., Sulek, R., Luskin-Saxby, S., Trembath, D., & Keen, D. (2018). Allied health professionals’ knowledge and use of ASD intervention practices. Journal of Autism and Developmental Disorders, 48, 2335–2349.CrossRefGoogle Scholar
  27. Robinson, L., Bond, C., & Oldfield, J. (2018). A UK and Ireland survey of educational psychologists’ intervention practices for students with autism spectrum disorder. Educational Psychology in Practice, 34(1), 58–72.CrossRefGoogle Scholar
  28. Sam, A. M., Cox, A. W., Savage, M. N., Waters, V., & Odom, S. L. (2019). Disseminating information on evidence-based practices for children and youth with autism spectrum disorder: AFIRM. Journal of Autism and Developmental Disorders.  https://doi.org/10.1007/s10803-019-03945-x.CrossRefPubMedGoogle Scholar
  29. Sansosti, F. J., & Sansosti, J. M. (2013). Effective school-based service delivery for students with autism spectrum disorders: Where we are and where we need to go. Psychology in the Schools, 50(3), 229–244.CrossRefGoogle Scholar
  30. U.S. Department of Health & Human Services. (2016). IACC/OARC autism research database. https://iacc.hhs.gov/funding/data/. Accessed 20 June 2019.
  31. Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11(2), 203–214.CrossRefGoogle Scholar
  32. Wong, C., Odom, S. L., Hume, K. A., Cox, A. W., Fettig, A., Kucharczyk, S., et al. (2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: A comprehensive review. Journal of Autism and Developmental Disorders, 45(7), 1951–1966.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.The University of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations