Skip to main content
Springer Nature Link
Log in

An Evaluation of Fidelity of Implementation of a Manualized Social-Play Intervention

  • ORIGINAL ARTICLE
  • Published:
Journal of Developmental and Physical Disabilities Aims and scope Submit manuscript

Abstract

In this study, we evaluated three lessons from a manualized social play skills intervention, Play20. Play20 is a focused intervention that is designed to improve early social skill development in children with autism spectrum disorder through naturalistic play. First, we evaluated the procedural fidelity of instructor implementation of Play20, and we also evaluated the effects of an added instructor self-monitoring checklist in further improving instructor behavior. Finally, we evaluated the effects of Play20 on child play outcomes. Instructor procedural fidelity increased in the presence of the Play20 lessons, and further improved in the presence of the instructor self-monitoring checklist. Child outcomes moderately improved as well. Implications and future directions are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Finland)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Allen, K. D., & Warzak, W. J. (2000). The problem of parental nonadherence in clinical behavior analysis: Effective treatment is not enough. Journal of Applied Behavior Analysis, 33, 373–391. https://doi.org/10.1901/jaba.2000.33-373.

    Article  PubMed  PubMed Central  Google Scholar 

  • Baker-Ericzen, M. J., Fitch, M. A., Kinnear, M., Jenkins, M. M., Twamley, E. W., Smith, L., et al. (2018). Development of the supported employment, comprehensive cognitive enhancement, and social skills program for adults on the autism spectrum: Results of initial study. Autism, 22, 6–19. https://doi.org/10.1177/136236131772494.

    Article  PubMed  Google Scholar 

  • Barton, E. E., & Pavilanis, R. (2012). Teaching pretend play to young children with autism. Young Exceptional Children, 15(1), 5–17. https://doi.org/10.1177/1096250611424106.

    Article  Google Scholar 

  • Bauminger, N., Shulman, C., & Agam, G. (2003). Peer interaction and loneliness in high- functioning children with autism. Journal of Autism and Developmental Disorders, 33, 489–507. https://doi.org/10.1023/A:1025827427901.

    Article  PubMed  Google Scholar 

  • Behavior Analyst Certification Board (2014). Applied behavior analysis treatment of autism spectrum disorder: Practice guidelines for healthcare funders and managers (2nd ed.). Littleton, CO: Behavior Analyst Certification Board, Inc.

  • Boyd, B. A., Watson, L. R., Reszka, S. S., Sideris, J., Alessandri, M., Baranek, G. T., Crais, E. R., Donaldson, A., Gutierrez, A., Johnson, L. A., & Belardi, K. (2018). Efficacy of the ASAP intervention for preschoolers with ASD: A cluster randomized controlled trial. Journal of Autism and Developmental Disorders, 48, 3144–3162. https://doi.org/10.1007/s10803-018-3584-z.

    Article  PubMed  Google Scholar 

  • Brookman-Frazee, L. I., Taylor, R., & Garland, A. F. (2010). Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. Journal of Autism and Developmental Disorders, 40, 1188–1201. https://doi.org/10.1007/s10803-010-0976-0.

    Article  PubMed  PubMed Central  Google Scholar 

  • Carr, J. E., Nicoloson, A. C., & Higbee, T. S. (2000). Evaluation of a brief multiple-stimulus preference assessment in a naturalistic context. Journal of Applied Behavior Analysis, 33, 353–357. https://doi.org/10.1901/jaba.2000.33-353.

    Article  PubMed  PubMed Central  Google Scholar 

  • Constantino, J. H., & Gruber, C. P. (2012). Social responsiveness scale (2nd ed.). Los Angeles, CA: Western Psychological Services.

  • Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson Education.

  • Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., …Varley, J. (2010). Randomized, controlled trial of an intervention for toddlers with autism: The early start Denver model. Pediatrics, 125, 18–25. doi:https://doi.org/10.1542/peds.2009-0958.

    Article  Google Scholar 

  • DiGennaro Reed, F. D., & Codding, R. S. (2014). Advancements in procedural fidelity assessment and intervention: Introduction to the special issue. Journal of Behavior Education, 23, 1–18. https://doi.org/10.1007/s10864-013-9191-3.

    Article  Google Scholar 

  • Dueñas, A. D., Plavnick J.B., & Bak, M.Y. (2018). Effects of joint video modeling on unscripted play behavior of children with autism spectrum disorder, Journal of Autism and Developmental Disorders. Advance online publication. doi:https://doi.org/10.1007/s10803-018-3719-2, 49, 236, 247.

  • Eapen, V., Crncec, R., & Walter, A. (2013). Clinical outcomes of an early intervention program for preschool children with autism spectrum disorder in a community group setting. BMC Pediatrics, 13(3), 1–9. Retrieved from http://www.biomedcentral.com/1471-2431/13/3.

  • Frankel, F., & Whitham, C. (2011). Parent-assisted group treatment for friendship problems of children with autism spectrum disorders. Brain Research, 1380, 240–245. https://doi.org/10.1016/j.brainres.2010.09.047.

    Article  PubMed  Google Scholar 

  • Freeman, S., & Kasari, C. (2013). Parent-child interactions in autism: Characteristics of play. Autism, 17, 147–161. https://doi.org/10.1177/1362361312469269.

    Article  PubMed  Google Scholar 

  • Ganz, J. B., Davis, J. L., Lund, E. M., Goodwyn, F. D., & Simpson, R. L. (2012). Meta-analysis of PECS with individuals with ASD: Investigation of targeted versus non-targeted outcomes, participant characteristics, and implementation phase. Research in Developmental Disabilities, 33, 406–418. https://doi.org/10.1016/j.ridd.2011.09.023.

    Article  PubMed  Google Scholar 

  • Gast, D. L., & Ledford, J. R., (2014). Single case research methodology: Applications in special education and behavioral sciences (2nd ed.). New York, NY: Routledge.

  • Goldstein, N. E. S., Kemp, K. A., Leff, S. S., & Lochman, J. E. (2012). Guidelines for adapting manualized interventions for new target populations: A step-wise approach using anger management as a model. Clinical Psychology: Science and Practice, 19, 385–401. https://doi.org/10.1111/cpsp.12011.

    Article  Google Scholar 

  • Goods, K. S., Ishijima, E., Chang, Y. C., & Kasari, C. (2013). Preschool based JASPER intervention in minimally verbal children with autism: Pilot RCT. Journal of Autism and Developmental Disorders, 43, 1050–1056. https://doi.org/10.1007/s10803-012-1644-3.

    Article  PubMed  PubMed Central  Google Scholar 

  • Groskreutz, N. C., Groskreutz, M. P., & Higbee, T. S. (2011). Effects of varied levels of treatment integrity on appropriate toy manipulation in children with autism. Research in Autism Spectrum Disorders, 5, 1358–1369. https://doi.org/10.1016/j.rasd.2011.01.018.

    Article  Google Scholar 

  • Gutierrez, J., Reeve, S. A., Vladescu, J. C., DeBar, R. M., & Giannakakos, A. R. (2019). Evaluation of manualized instruction to train staff to implement a token economy. Behavior Analysis in Practice. Advance online publication. doi:https://doi.org/10.1007/s40617-019-00386-x.

  • Hall, L. (2009). Autism spectrum disorders: From theory to practice. Upper Saddle River: Pearson Merrill Prentice Hall.

    Google Scholar 

  • Hendricks, D. (2010). Employment and adults with autism spectrum disorders: Challenges and strategies for success. Journal of Vocational Rehabilitation, 32, 125–134. https://doi.org/10.3233/JVR-2010-0502.

    Article  Google Scholar 

  • Iadarola, S., Shih, W., Dean, M., Blanch, E. Harwood, R., Hetherington, S., …Smith, T. (2018). Implementing a manualized, classroom transition intervention for students with ASD in under resourced schools. Behavior Modification, 42, 126–147. doi:https://doi.org/10.1177/0145445517711437.

    Article  PubMed  Google Scholar 

  • Ingersoll, B., & Schreibman, L. (2006). Teaching reciprocal imitations skills to young children with autism using a naturalistic behavioral approach: Effects on language, pretend play, and joint attention. Journal of Autism and Developmental Disorders, 36, 487–505. https://doi.org/10.1007/s10803-006-0089-y.

    Article  PubMed  Google Scholar 

  • Ingersoll, B., & Wainer, A. (2013). Initial efficacy of project impact: A parent-mediated social communication intervention for young children with ASD. Journal of Autism and Developmental Disabilities, 43, 2943–2952. https://doi.org/10.1007/s10803-013-1840-9.

    Article  Google Scholar 

  • Jung, S., & Sainato, D. M. (2013). Teaching play skills to young children with autism. Journal of Intellectual and Developmental Disability, 38(1), 74–90. https://doi.org/10.3109/13668250.2012.732220.

    Article  PubMed  Google Scholar 

  • Kasari, C., & Smith, T. (2013). Interventions in schools for children with autism spectrum disorder: Methods and recommendations. Autism, 17, 254–267. https://doi.org/10.1177/1362361312470496.

    Article  PubMed  Google Scholar 

  • Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York: Oxford University Press.

    Google Scholar 

  • Kossyvaki, L., & Papoudi, D. (2016). A review of play interventions for children with autism at school. International Journal of Disability, Development, and Education, 63, 45–63. https://doi.org/10.1080/1034912X.2015.1111303.

    Article  Google Scholar 

  • Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34, 26–38. https://doi.org/10.1177/0741932512452794.

    Article  Google Scholar 

  • LaFrance, D. L., & Tarbox, J. (2019). The importance of multiple exemplar instruction in the establishment of novel verbal behavior. Journal of Applied Behavior Analysis. Advanced online publication. doi:https://doi.org/10.1002/jaba.611.

  • Ledford, J. R., & Gast, D. L. (2014a). Measuring procedural fidelity in behavioral research. Neuropsychological Rehabilitation, 24(3–4), 332–348. https://doi.org/10.1080/0902011.2013.861352.

  • Ledford, J. R., & Gast, D. L. (2014b). Multiple baseline and multiple probe designs. In D. L. Gast & J. R. Ledford (Eds.), Single subject research methodology: Applications in special education and behavioral sciences (pp. 252–296). New York: Routledge.

  • Levy, A., & Perry, A. (2011). Outcomes in adolescents and adults with autism: A review of the literature. Research in Autism Spectrum Disorders, 5, 1271–1282. https://doi.org/10.1016/j.rasd.2011.01.023.

    Article  Google Scholar 

  • Lifter, K. (2000). Linking assessment to intervention for children with developmental disabilities or at-risk for developmental delay: The developmental play assessment (DPA) instrument. In Gitlin Wiener, K., Sandgrund, A., & Scaefer, C. (Eds.), Play diagnosis and assessment – Second Edition (pp. 228–261). New York, NY: John Wiley & Sons.

  • Lory, C., Rispoli, M., & Gregori, E. (2018). Play interventions involving children with autism spectrum disorder and typically developing peers: A review of research quality. Journal of Autism and Developmental Disorders, 5, 78–89. https://doi.org/10.1007/s40489-017-0124-2.

    Article  Google Scholar 

  • Mullen, E. M. (1995). Mullen scales of early learning. Circle Pines: American Guidance Service.

    Google Scholar 

  • Nahmias, A. S., Pellecchia, M., Stahmer, A. C., Mandell, D. S. (2019). Effectiveness of community-based early intervention for children with autism spectrum disorder: A meta-analysis. Journal of Child Psychology and Psychiatry. Advanced online publication. doi:https://doi.org/10.1111/jcpp.13073, 60, 1200, 1209.

  • National Autism Center (2009). National standards report: The national standards project- addressing the need for evidence-based practice guidelines for autism spectrum disorders. Retrieved from https://mn.gov/mnddc/asd-employment/pdf/09-NSR-NAC.pdf

  • Odom, S. L., Boyd, B. A., Hall, L. J., & Hume, K. (2010). Evaluation of comprehensive treatment models for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 40(4), 425–436. https://doi.org/10.1007/s10803-009-0825-1.

    Article  PubMed  Google Scholar 

  • Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284–299. https://doi.org/10.1016/j.beth.2010.08.006.

    Article  PubMed  Google Scholar 

  • Pellegrini, A. D. (2009). Research and policy on children’s play. Child Development Perspectives, 3, 131–136.

    Article  Google Scholar 

  • Peters-Scheffer, N., Didden, R., Korzilius, H., & Sturmey, P. (2013). Therapist characteristics predict discrete trial teaching procedural fidelity. Intellectual and Developmental Disabilities, 51, 262–272. https://doi.org/10.1352/1934-9556.51.4.263.

    Article  Google Scholar 

  • Piaget, J. (1962). Play, dreams, and imitation in childhood. New York: W.W. Norton.

    Google Scholar 

  • Rispoli, M., Zaini, S., Mason, R., Brodhead, M. T., Burke, M. D., & Gregori, E. (2017). A systematic review of teacher self-monitoring on implementation of behavioral practices. Teaching and Teacher Education, 63, 58–72. https://doi.org/10.1016/j.tate.2016.12.007.

    Article  Google Scholar 

  • Rogers, S., & Vismara, L. (2008). Evidence-based comprehensive treatments for early autism. Journal of Clinical Child and Adolescent Psychology, 37, 8–38. https://doi.org/10.1080/15374410701817808.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rodgers, J., Hodgson, A., Shields, K., Wright, C., Honey, E., & Freeston, M. (2017). Towards a treatment for intolerance of uncertainty in young people with autism spectrum disorder: Development of the coping with uncertainties in everyday situations (CUES) programme. Journal of Autism and Developmental Disorders, 47, 3959–3966. https://doi.org/10.1007/s10803-016-2924-0.

    Article  PubMed  Google Scholar 

  • Rogge, N., & Janssen, J. (2019). The economic cost of autism spectrum disorder: A literature review. Journal of Autism and Developmental Disorders. Advanced online publication. Doi:10.1007%2Fs10803-019-04014-z.

  • Schreibman, L., Dawson, G., Stahmer, A. C., Landa, R., Rogers, S. J., McGee, G. G., et al. (2015). Naturalistic developmental behavioral interventions: Empirically validated treatments for autism Spectrum disorder. Journal of Autism and Developmental Disorders, 1–18. https://doi.org/10.1007/s10803-015-2407-8.

  • Shattuck, P. T., Seltzer, M. M., Greenberg, J. S., Orsmond, G. I., Bolt, D., Kring, S., …Lord, C. (2007). Change in autism symptoms and maladaptive behaviors in adolescents and adults with an autism spectrum disorder. Journal of Autism and Developmental Disorders, 37, 1735–1747. doi:https://doi.org/10.1007/s10803-006-0307-7.

    Article  PubMed  Google Scholar 

  • Slocum, T. A., Detrich, R., Wilczynski, S. M., Spencer, T. D., Lewis, T., & Wolfe, K. (2014). The evidence-based practice of applied behavior analysis. The Behavior Analyst, 39, 75–87. https://doi.org/10.1007/s40614-014-0005-2.

    Article  Google Scholar 

  • Smith, T. (2013). What is evidence-based behavior analysis. The Behavior Analyst, 36, 7–33. https://doi.org/10.1007/bf03392290.

    Article  PubMed  PubMed Central  Google Scholar 

  • Spring, B. (2007). Evidence-based practice in clinical psychology: What it is, why it matters; what you need to know. Journal of Clinical Psychology, 63, 611–631. https://doi.org/10.1002/jclp.20373.

    Article  PubMed  Google Scholar 

  • Stahmer, A. C., Rieth, S., Lee, E., Reisinger, E. M., Mandelll, D. S., & Connell, J. E. (2015). Training teachers to use evidence-based practices for autism: Examining procedural implementation fidelity. Psychology in the Schools, 52, 181–195. https://doi.org/10.1002/pits.21815.

    Article  PubMed  Google Scholar 

  • Stokes, T. F., & Baer, D. M. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10, 349–367. https://doi.org/10.1901/jaba.1977.10-349.

    Article  PubMed  PubMed Central  Google Scholar 

  • Suess, A. N., Romani, P. W., Wacker, D. P., Dyson, S. M., Kuhle, J. L., Lee, J. F., Lindgren, S. D., Kopelman, T. G., Pelzel, K. E., & Waldron, D. B. (2014). Evaluating the treatment fidelity of parents who conduct in-home functional communication training with coaching via telehealth. Journal of Behavioral Education, 23, 34–59. https://doi.org/10.1007/s10864-013-9183-3.

    Article  Google Scholar 

  • Symes, M. D., Remington, B., Brown, T., & Hastings, R. P. (2006). Early intensive behavioral intervention for children with autism: Therapists’ perspectives on achieving procedural fidelity. Research in Developmental Disabilities, 27, 30-42. Doi:10.106/j.ridd.2004.07.007.

  • Tzanakaki, P., Grindle, C. F., Saville, M., Hastings, R. P., Hughes, J. C., & Huxley, K. (2015). An individualized curriculum to teach numeracy skills to children with autism: Programme description and pilot data. Support for Learning, 29, 319–338. doi:10.111/1467–9604.12069.

  • Young, K. L., Boris, A. L., Thomson, K. M., Martin, G. L., & Yu, C. T. (2012). Evaluation of a self-instructional package on discrete-trials teaching to parents of children with autism. Research in Autism Spectrum Disorders, 6, 1321–1330. https://doi.org/10.1016/j.rasd.2012.05.001.

    Article  Google Scholar 

Download references

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

  1. Department of Counseling, Educational Psychology, and Special Education, Michigan State University, East Lansing, MI, 48824, USA

    Emma S. Sipila-Thomas, Matthew T. Brodhead, Joshua B. Plavnick & Allison N. White

Authors
  1. Emma S. Sipila-Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthew T. Brodhead
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joshua B. Plavnick
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Allison N. White
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthew T. Brodhead.

Ethics declarations

Conflict of Interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent were obtained from all the individual participants, including the instructors in this study and the parents/guardians from those child participants.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sipila-Thomas, E.S., Brodhead, M.T., Plavnick, J.B. et al. An Evaluation of Fidelity of Implementation of a Manualized Social-Play Intervention. J Dev Phys Disabil 33, 391–412 (2021). https://doi.org/10.1007/s10882-020-09754-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10882-020-09754-w

Keywords

Search

Navigation