Skip to main content

Advertisement

SpringerLink
Log in

Developing an Evaluation Framework for Parent Education and Training in Autism Spectrum Disorder: Results of a Multi-stakeholder Process

  • Original Paper
  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

Despite the need for parent education and training programmes in autism spectrum disorder (ASD), there is no generally-accepted evaluation framework to select programmes for different settings. Here we generated an evaluation framework using a multi-stakeholder, implementation science approach. Purposive sampling identified ASD experts, implementation/health systems experts, and parents/carers of individuals with ASD. A consensus-building stakeholder workshop with 14 stakeholders and thematic analysis was used to generate themes and components of the framework. Main themes included ‘Outcomes’ (parent, child, family and community), ‘Processes and Procedures’ (accessibility, acceptability, psychological process, and referral pathways) and ‘Implementation Landscape’ (sustainability, scalability, integration and coordination, and monitoring and evaluation). We propose that the evaluation framework and Evaluation Framework Checklist generated could guide clinicians, researchers and policy-makers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017). ‘Scaling-out’ evidence-based intervention to new population or new health care delivery systems. Implementation Science, 12(1), 111.

    Article  PubMed  PubMed Central  Google Scholar 

  • Aman, M. G., McDougle, C. J., Scahill, L., Handen, B., Arnold, L. E., Johnson, C., et al. (2009). Medication and parent training in children with pervasive developmental disorders and serious behavior problems: Results from a randomized clinical trial. Research Units on Paediatric Psychopharmacology Autism Network. Journal of the American Academy of Child and Adolescent Psychiatry, 48(12), 1143–1154.

    Article  PubMed  Google Scholar 

  • Bammer, G. (2005). Integration and implementation sciences: Building a new specialization. Ecology and Society, 10(2), 6.

    Article  Google Scholar 

  • Bearss, K., Johnson, C., Smith, T., Lecavalier, L., Swiezy, N., Aman, M., et al. (2015). Effect of parent training vs parent education on behavioural problems in children with autism spectrum disorder: A randomized trial. Journal of American Medical Association, 313(5), 1524–1533.

    Article  Google Scholar 

  • Beaudoin, A. J., Sébire, G., & Couture, M. (2014). Parent training interventions for toddlers with autism spectrum disorder. Autism Research and Treatment, 2014, 839890. https://doi.org/10.1155/2014/839890.

    Article  PubMed  PubMed Central  Google Scholar 

  • Blase, K., Van Dyke, M., Fixsen, D., & Wallace Bailey, F. (2012). Implementation science: Key concepts, themes and evidence for practitioners in education psychology. In B. Kelly & D. Perkins (Eds.), Handbook of implementation science for psychology in education: How to promote evidence based practice (pp. 13–14). London: Cambridge University Press.

    Chapter  Google Scholar 

  • Borrego, J., & Pemberton, J. (2007). Increasing acceptance of behavioural child management techniques: What do parents say? Child and Family Behaviour Therapy, 29, 27–45.

    Article  Google Scholar 

  • Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research Psychology, 3(2), 77–101.

    Article  Google Scholar 

  • Breuer, E., Lee, L., De Silva, M., & Lund, C. (2016). Using theory of change to design and evaluate public health interventions: A systematic review. Implementation Science, 11(63), 1–17.

    Google Scholar 

  • Brookman-Frazee, L., Vismara, L., Drahota, A., Stahmer, A. C., & Openden, D. (2009). Parent training interventions for children with autism spectrum disorders. In Applied behaviour analysis for children with autism spectrum disorders (pp. 237–257). New York: Springer.

  • Cabassa, L. J., & Baumann, A. A. (2013). A two-way street: Bridging implementation science and cultural adaptations of mental health treatments. Implementation Science, 8, 1–14.

    Article  Google Scholar 

  • Centers for Disease Control and Prevention. (2012). Improving the use of program evaluation for maximum health impact: Guidelines and recommendations. Cited November 4, from https://www.cdc.gov/eval/materials/finalcdcevaluationrecommendations_formatted_120412.pdf.

  • Chambers, D. A. (2014). Guiding theory for dissemination and implementation research: A reflection on models used in research and practice. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health. New York: Oxford University Press.

    Google Scholar 

  • Charlop-Christy, M., & Carpenter, M. (2000). Modified incidental teaching sessions: A procedure for parent to increase spontaneous speech in their children with autism. Journal of Positive Behavioural Interventions, 2, 98–112.

    Article  Google Scholar 

  • Christensen, D. L., Baio, J., Braun, K., Bilder, D., Charles, J., Constantino, J. N., et al. (2016). Prevalence and characteristics of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, United States, 2012. MMWR Surveillance Summaries, 65(3), 1–23.

    Article  PubMed Central  Google Scholar 

  • Cutress, A. L., & Muncer, S. J. (2014). Parents’ views of the National Autistic Society’s EarlyBird Plus Programme. Autism, 18(6), 651–657.

    Article  PubMed  Google Scholar 

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(50), 1–15.

    Google Scholar 

  • Dawson-Squibb, J. J., Davids, E. L., & de Vries, P. J. (2019a). Scoping the evidence for Earlybird and Earlybird Plus, two UK-developed parent education and training programmes for autism spectrum disorder. Autism, 23(3), 542–555.

    Article  PubMed  Google Scholar 

  • Dawson-Squibb, J. J., Davids, E. L., Harrison, A. J., Molony, M. A., & de Vries, P. J. (2019b). Parent education and training for autism spectrum disorders: Scoping the evidence. Autism. https://doi.org/10.1177/1362361319841739.

    Article  PubMed  Google Scholar 

  • De Silva, M. J., Breuer, E., Lee, L., Asher, L., Chowdhary, N., Lund, C., et al. (2014). Theory of change: A theory-driven approach to enhance the Medical Research Council’s framework for complex intervention. Trials, 15, 267.

    Article  PubMed  PubMed Central  Google Scholar 

  • Denzin, N. K. (1978). Sociological methods. New York: McGraw-Hill.

    Google Scholar 

  • Dingfelder, H., & Mandell, D. (2011). Bridging the research to practice gap in autism intervention: An application of diffusion to innovation theory. Journal of Autism and Developmental Disorders, 41(5), 597–609.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dunn, M., Glasgow, R., Handley, K., Kayondo, J. K., Kupfer, L., Krishna, A., et al. (2012). Fundamentals of implementation research. Chapel Hill: University of North Carolina Press.

    Google Scholar 

  • Durkin, M. S., Maenner, M. J., Meaney, F. J., Levy, S. I., DiGuiseppi, C., Nicholas, J. S., et al. (2010). Socioeconomic inequality in the prevalence of autism spectrum disorder: Evidence from a U.S. cross-sectional study. PLoS ONE, 5(7), e11551.

    Article  PubMed  PubMed Central  Google Scholar 

  • Eckert, T. L., & Hintze, J. M. (2000). Behavioural conceptions and applications of acceptability: Issues related to service delivery and research methodology. School Psychology Quarterly, 15(2), 123–148.

    Article  Google Scholar 

  • Elsabbagh, M., Divan, G., Koh, Y. J., Kim, Y. S., Kauchali, S., Marcin, C., et al. (2012). Global prevalence of autism and other pervasive developmental disorders. Autism Research, 5(3), 160–179.

    Article  PubMed  PubMed Central  Google Scholar 

  • Farmer, J., & Reupert, A. (2013). Understanding autism and understanding my child with autism: An evaluation of a group parent education program in rural Australia. Australian Journal of Rural Health, 21(1), 20–27.

    Article  PubMed  Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation Research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Research Network (FMHI Publication #231).

  • Gillespie-Lynch, K., & Brezis, R. (2017). Parent-implemented interventions around the globe. In M. Siller & L. Morgan (Eds.), Handbook of family-centered practice for very young children with autism. Cham: Springer.

    Google Scholar 

  • Green, J., Pickles, A., Pasco, G., Bedford, R., Wan, M., Elsabbagh, M., et al. (2017). Randomised trial of a parent mediated intervention for infants at high risk of autism: Longitudinal outcomes to age 3 years. Journal of Child Psychology and Psychiatry, 58(12), 1330–1340.

    Article  PubMed  Google Scholar 

  • Hansen, S. N., Schendel, D. E., & Parner, E. T. (2015). Explaining the increase in the prevalence of autism spectrum disorder: The proportion attributable to changes in reporting practices. JAMA Paediatrics, 169(1), 56–62.

    Article  Google Scholar 

  • Kaholokula, J. K. (2013). Community-Based Participatory Research (CBPR) with native and pacific populations: Addressing cultural competency issues. Hawaii Journal of Public Health, 72(8 Suppl 3), 6.

    Google Scholar 

  • Kim, S. Y. (2013). Efficacy versus effectiveness. Korean Journal of Family Medicine, 34(4), 227.

    Article  PubMed  PubMed Central  Google Scholar 

  • Koegel, R. L., Bimbela, A., & Schreibman, L. (1996). Collateral effects of parent training on family interactions. Journal of Autism and Developmental Disorders, 26(3), 347–359.

    Article  PubMed  Google Scholar 

  • Kuravackel, G. M., Ruble, L. A., Reese, R. J., Ables, A. P., Rodgers, A. D., & Toland, M. D. (2018). COMPASS for hope: Evaluating the effectiveness of a parent training and support program for children with ASD. Journal of Autism and Developmental Disorder, 48(2), 404–416.

    Article  Google Scholar 

  • Lang, R., Machalicek, W., Rispoli, M., & Regester, A. (2009). Training parents to implement communication interventions for children with autism spectrum disorders (ASD): A systematic review. Evidence-Based Communication Assessment and Intervention, 3(3), 174–190.

    Article  Google Scholar 

  • Medan, H., Ostrosky, M. M., Zaghlawan, H. Y., & Yu, S. (2009). Promoting the social and communicative behaviour of young children with autism spectrum disorders: A review of parent implemented intervention studies. Topics in Early Childhood Special Education, 29(2), 90–140.

    Article  Google Scholar 

  • Metz, A., Halle, T., Bartley, L., & Blasberg, A. (2013). The key components of successful implementation. In T. Halle, A. Metz, & I. Martinez-Beck (Eds.), Applying implementation science in early childhood programs and systems (pp. 21–42). Baltimore, MD: Brookes.

    Google Scholar 

  • Milat, A. J., King, L., Bauman, A. E., & Redman, S. (2012). The concept of scalability: Increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promotion International, 28(3), 285–298.

    Article  PubMed  Google Scholar 

  • Moore, G., Audrey, S., Barker, M., Bond, L., Bonell, C., Cooper, C., et al. (2014). Process evaluation in complex public health interventions studies: The need for guidance. Journal of Epidemiology & Community Mental Health, 68(2), 101–102.

    Article  Google Scholar 

  • Nevill, R. E., Lecavalier, L., & Stratis, E. A. (2018). Meta-analysis of parent mediated interventions for young children with autism spectrum disorder. Autism, 22(2), 84–98.

    Article  PubMed  Google Scholar 

  • Oono, I. P., Honey, E. J., & McConachie, H. (2013). Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Evidence-Based Child Health: A Cochrane Review Journal, 8(6), 2380–2479.

    Article  Google Scholar 

  • Oosterling, I., Visser, J., Swinkels, S., Rommelse, N., Donders, R., Woudenberg, T., et al. (2010). Randomized controlled trial of the focus parent training for toddlers with autism: 1-year outcome. Journal of Autism and Developmental Disorders, 40(12), 1447–1458.

    Article  PubMed  PubMed Central  Google Scholar 

  • Panchal, P. (2017). The impact of a two-week in-patient parent training for autism spectrum disorder in India. In Proceedings of the annual meeting for autism research, 10–13 May 2017 (pp. 1–219). San Francisco. International Meeting For Autism Research.

  • Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38(2), 65–76.

    Article  PubMed  Google Scholar 

  • Sackett, D. L., Rosenberg, M. W., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence-based medicine: What it is and what it isn’t. The British Medical Journal, 312(7023), 71–72.

    Article  PubMed  Google Scholar 

  • Schultz, T. R., Schmidt, C. T., & Stitcher, J. P. (2011). A review of parent education programs for parents of children with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 26(2), 96–104.

    Article  Google Scholar 

  • Shields, J., & Simpson, A. (2004). The NAS EarlyBird programme: Preschool support for parents of children with autistic spectrum disorder. Good Autism Practice, 5(2), 49–60.

    Google Scholar 

  • Solomon, R., Necheles, J., Ferch, C., & Bruckman, D. (2007). Pilot study of a parent training program for young children with autism: The PLAY Project Home Consultation program. Autism, 11(3), 205–224.

    Article  PubMed  Google Scholar 

  • Steiner, A. M., Koegel, L. K., Koegel, R. L., & Ence, W. A. (2012). Issues and theoretical constructs regarding parent education for autism spectrum disorders. Journal of Autism and Developmental Disorders, 42(6), 1218–1227.

    Article  PubMed  Google Scholar 

  • Titler, M. (2008). The evidence for evidence-based practice implementation. In R. G. Hughes (Ed.), Patient safety and quality: An evidence-based handbook for nurses. Rockville: Agency for Healthcare Research and Quality.

    Google Scholar 

  • Tonge, B., Brereton, A., Kiomall, M., Mackinnon, A., King, N., & Rinehart, N. (2006). Effects on parental mental health of an education and skills training program for parents of young children with autism: A randomized controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 45(6), 561–569.

    Article  PubMed  Google Scholar 

  • Watson, L., Crais, E., Baranek, G., Turner-Brown, L., Sideris, J., Wakeford, L., et al. (2017). Parent-mediated interventions for one-year-olds screened as at-risk for autism spectrum disorder: A randomized controlled trial. Journal of Autism and Developmental Disorders, 47(11), 3520–3540.

    Article  PubMed  Google Scholar 

  • Wolfensberg, W., & Thomas, S. (2007). PASSING: A tool for analysing service quality according to social role valorization criteria: Rating manual (3rd rev. ed.). New York: Training Institute for Human Service Planning, Leadership & Change Agency, Syracuse University.

  • World Health Organization. (2014). Sixty-seventh World Health Assembly, WHA67.8 Agenda item 13.4, 24. Cited February 13, 2018, from http://apps.who.int/iris/bitstream/10665/164399/1/Autism(combined).pdf.

Download references

Acknowledgments

Petrus de Vries is supported by the National Research Foundation, Struengmann Fund and the University of Cape Town. The authors would also like to acknowledge the contributions of the stakeholder group who were instrumental in the creation of this paper. Dr Rosa Hoekstra and Professors Helen McConachie and Maretha de Jonge gave valuable input on the draft manuscript.

Author information

Authors and Affiliations

  1. Division of Child and Adolescent Psychiatry, Department of Psychiatry and Mental Health, Centre for Autism Research in Africa, University of Cape Town, Rondebosch, Cape Town, 7700, South Africa

    John-Joe Dawson-Squibb & Petrus J. de Vries

Authors
  1. John-Joe Dawson-Squibb
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Petrus J. de Vries
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JJDS and PDV were the lead researchers of the project. They conceptualized and designed the study, collected and analyzed data, and drafted and revised the manuscript. Both authors read and approved the final manuscript.

Corresponding author

Correspondence to John-Joe Dawson-Squibb.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dawson-Squibb, JJ., de Vries, P.J. Developing an Evaluation Framework for Parent Education and Training in Autism Spectrum Disorder: Results of a Multi-stakeholder Process. J Autism Dev Disord 49, 4468–4481 (2019). https://doi.org/10.1007/s10803-019-04176-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-019-04176-w

Keywords

Search

Navigation