Abstract
Place-based initiatives are frequently subject to “top-down” changes, despite having a “bottom-up” service delivery model. One example is the Australian Government’s “Communities for Children” Facilitating Partner initiative (CfC), aimed at improving child, family and community outcomes in geographically disadvantaged areas. CfC introduced a policy requiring initially 30% then 50% of service delivery funding to be spent on evidence-based programs. This qualitative study explores the rarely examined views and experiences of government personnel tasked with implementing the policy. Seventeen government personnel across Australia were interviewed and asked about knowledge and attitudes toward evidence-based practice and the policy change, and perceptions of the factors that influenced policy implementation. Data were analyzed thematically and findings compared to existing frameworks and theoretical models. Six themes were identified. Participants cited workforce, contextual and cultural factors as influences on implementation. Most viewed the implementation as worthwhile, although some lingering skepticism remained. Findings were consistent with a theory of organizational readiness for change. Organizations that were “enthusiastic and confident” were more effective at implementation; those that were “pragmatic and confident” focussed on compliance rather than benefits to families; while those that were “resistant and unconfident” struggled with implementation. Findings were also consistent with a framework of factors that support sustained implementation in disadvantaged populations, with three additional factors identified. These findings highlight the importance for governing bodies to build supporting factors broadly, and to plan for the provision of additional supports to organizations with a low level of change readiness.
Highlights
-
Place-based initiatives are increasingly required to use evidence-based programs to maximize benefits for families.
-
Government personnel cite contextual, workforce, and cultural factors as influences on implementation.
-
Considerable financial, logistical, and technical support is required to implement evidence-based programs.
-
Enabling services to build evidence for home-grown programs ensures the right mix of programs for families.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
ACIL Allen Consulting. (2016). Part I: Communities for children facilitating partners program: post implementation review. Report to Department of Social Services. www.dss.gov.au/sites/default/files/documents/09_2017/ccfp-pir.pdf.
Allen, G. (2011). Early intervention: the next steps. An independent report to her Majesty’s government. London, HM Government.
Australian Government. (2014). Communities for children facilitating partner—Operational guidelines. Retrieved 29 May 2019, from www.dss.gov.au/sites/default/files/documents/09_2014/cfc_fp_operational_guidelines_-_v_1_1_5_september_2014.pdf.
Australian Government. (2019). Communities for children requirements. Retrieved 29 May 2019, from https://aifs.gov.au/cfca/expert-panel-project/communities-children-requirements.
Bates, M. P., Mastrianni, A., Mintzer, C., Nicholas, W., Furlong, M. J., Simental, J. & Green, J. G. (2006). Bridging the transition to kindergarten: school readiness case studies from california’s first 5 initiative. The California School Psychologist, 11(1), 41–56. https://doi.org/10.1007/BF03341114.
Boaz, A., Grayson, L., Levitt, R., & Solesbury, W. (2008). Does evidence-based policy work? Learning from the UK experience. Evidence & Policy: A Journal of Research, Debate and Practice, 4(2), 233–253. https://doi.org/10.1332/174426408784614680.
Branch, S., Freiberg, K., & Homel, R. (2019). Strengthening the prevention delivery system for children in disadvantaged communities through infrastructure development. Developing Practice: The Child, Youth and Family Work Journal, 53, 54–73.
Bryant, D., Maxwell, K., Taylor, K., Poe, M., Peisner-Feinberg, E., & Bernier, K. (2003). Smart start and preschool child care quality in NC: change over time and relation to children’s readiness. Chapel Hill, NC: FPG Child Development Institute.
Burgemeister, F.C., Crawford, S.B., Hackworth, N.J., Hokke, S. & Nicholson, J.N. (2021, in press) Place-based approaches to improve health and development outcomes in young children: a scoping review, PLOS ONE.
Bumbarger, B., & Perkins, D. F. (2008). After randomised trials: issues related to dissemination of evidence-based interventions. Journal of Children’s Services, 3(2), 55–64.
Chamberlain, P. (2017). Toward creating synergy among policy, procedures, and implementation of evidence-based models in child welfare systems: two case examples. Clinical Child and Family Psychology Review, 20(1), 78–86. https://doi.org/10.1007/s10567-017-0226-5.
Compass Evaluation and Research. (2015). Report on the evaluation of South Carolina First Steps: Continuing steps to school readiness. Fiscal years 2011–2014. Durham, NC. Retrieved 30 June 2018, from http://scfirststeps.org/wp-content/uploads/2015/03/Report-on-the-Evaluation-of-South-Carolina-First-Steps-to-School-Readiness-Compass-Evaluation-and-Research1.pdf.
Edwards, B., Gray, M., Wise, S., Hayes, A., Katz, I., Muir, K., & Patulny, R. (2011). Early impacts of communities for children on children and families: findings from a quasi-experimental cohort study. Journal of Epidemiology & Community Health, 65(10), 909–914. https://doi.org/10.1136/jech.2010.118133. 906p.
Edwards, B., Mullan, K., Katz, I., & Higgins, D. (2014). The stronger families in Australia (SFIA) study: Phase 2. (Research Report No. 29). Melbourne: Australian Institute of Family Studies. Retrieved 12 June 2018, from https://aifs.gov.au/publications/stronger-families-australia-sfia-study-phase-2.
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci, 9. https://doi.org/10.1186/s13012-014-0157-1.
Fagan, A. A., Bumbarger, B. K., Barth, R. P., Bradshaw, C. P., Cooper, B. R., Supplee, L. H., & Walker, D. K. (2019). Scaling up evidence-based interventions in US public systems to prevent behavioral health problems: challenges and opportunities. Prevention Science, 20(8), 1147–1168. https://doi.org/10.1007/s11121-019-01048-8.
Fixsen, D., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79(3), 213–230. https://doi.org/10.1177/001440291307900206.
Fixsen, D., Blase, K., Naoom, S., & Duda, M. (2016). Implementation drivers: assessing best practices. https://doi.org/10.13140/RG.2.2.20415.30885.
Fixsen, D., Louis de la Parte Florida Mental Health, I., & University of South, F. (2005). Implementation research: a synthesis of the literature. Tampa, Florida: National Implementation Research Network.
Fox, S., Southwell, A., Stafford, N., Goodhue, R., Jackson, D. and Smith, C. (2015). Better Systems, Better Chances: A Review of Research and Practice for Prevention and Early Intervention. Canberra, ARACY.
Furlong, M., & McGilloway, S. (2015). Barriers and facilitators to implementing evidence-based parenting programs in disadvantaged settings: a qualitative study. Journal of Child and Family Studies, 24(6), 1809–1818. https://doi.org/10.1007/s10826-014-9984-6.
Ghate, D. (2018). Developing theories of change for social programmes: co-producing evidence-supported quality improvement. Palgrave Communications, 4(1), 1–13. https://doi.org/10.1057/s41599-018-0139-z.
Goff, J., Hall, J., Sylva, K., Smith, T., Smith, G., Eisenstadt, N., Sammons, P., Evangelou, M., Smees, R., & Chu, K. (2013). Evaluation of children’s centres in England (ECCE). Strand 3: Delivery of family services by Children’s Centres. Research report RR297. Oxford, University of Oxford. Retrieved 4 October 2019.
Green, J., Willis, K., Hughes, E., Small, R., Welch, N., Gibbs, L., & Daly, J. (2007). Generating best evidence from qualitative research: the role of data analysis. Australian and New Zealand Journal of Public Health, 31(6), 545–550. https://doi.org/10.1111/j.1753-6405.2007.00141.x.
Hand, K. (2017). “Working out what works for families”: evidence and the Australian child and family service system. Family Matters, 99, 4–7. https://aifs.gov.au/publications/family-matters/issue-99/working-out-what-works-families.
Hodge, L. M., & Turner, K. M. T. (2016). Sustained implementation of evidence-based programs in disadvantaged communities: a conceptual framework of supporting factors. American Journal of Community Psychology, 58(1-2), 192–210. https://doi.org/10.1002/ajcp.12082.
Kelaher, M., Dunt, D., Feldman, P., Nolan, A., & Raban, B. (2009). The effect of an area-based intervention on breastfeeding rates in Victoria, Australia. Health Policy, 90(1), 89–93. https://doi.org/10.1016/j.healthpol.2008.08.004. 85p.
Kelly, S. E. (2010). Qualitative interviewing techniques and styles. In I. Bourgeault, R. Dingwall, & R. De Bries (Eds.), The SAGE handbook of qualitative methods in health research. SAGE Publications Ltd. https://doi.org/10.4135/9781446268247.
Knibbs, S., Pope, S., Dobie, S., & D’Souza, J. (2013). National evaluation of Flying Start: Impact report. SRN: 74/2013. W. Government. http://gov.wales/statistics-and-research/national-evaluation-flying-start.
Ladd, H. F., Muschkin, C. G., & Dodge, K. A. (2014). From birth to school: early childhood initiatives and third-grade outcomes in North Carolina. Journal of Policy Analysis and Management, 33(1), 162–187. https://doi.org/10.1002/pam.21734.
Leijten, P. P., Melendez-Torres, G. J. D. R. N., Knerr, W. M., & Gardner, F. D. (2016). Transported versus homegrown parenting interventions for reducing disruptive child behavior: a multilevel meta-regression study. Journal of the American Academy of Child & Adolescent Psychiatry, 55(7), 610–617. https://doi.org/10.1016/j.jaac.2016.05.003.
Melhuish, E., Belsky, J., & Barnes, J. (2010). Evaluation and value of Sure Start. Archives of Disease in Childhood, 95(3), 159–161. https://doi.org/10.1136/adc.2009.161018.
Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013). Examining adaptations of evidence-based programs in natural contexts. The Journal of Primary Prevention, 34(3), 147–161. https://doi.org/10.1007/s10935-013-0303-6.
Moore, T. G., McHugh-Dillon, H., Bull, K., Fry, R., Laidlaw, B., & West, S. (2014). The evidence: what we know about place-based approaches to support children’s wellbeing. Parkville, Victoria: Murdoch Childrens Research Institute and The Royal Children’s Hospital Centre for Community Child Health. Retrieved 10 January 2019, from https://doi.org/10.4225/50/5578DB1E31BE3.
Morse, J. (2020). The changing face of qualitative inquiry. International Journal of Qualitative Methods, 19, 1609406920909938 https://doi.org/10.1177/1609406920909938.
Muir, K., Katz, I., Edwards, B., Gray, M., Wise, S., & Hayes, A., Stronger Families Communities Strategy Evaluation Team. (2010). The national evaluation of the communities for children initiative. Family Matters, 84, 35–42. https://aifs.gov.au/publications/family-matters/issue-84.
National Evaluation of Sure Start Team. (2012). The impact of Sure Start Local Programmes on seven year olds and their families. London, University of London. Retrieved 10 May 2018, from www.ness.bbk.ac.uk/.
Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2009). Population-based prevention of child maltreatment: the U.S. triple P system population trial. Prevention Science, 10(1), 1–12. https://doi.org/10.1007/s11121-009-0123-3.
Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2016). Addendum to “population-based prevention of child maltreatment: the U.S. triple P system population trial”. Prevention Science, 17(3), 410–416. https://doi.org/10.1007/s11121-016-0631-x.
Ramanadhan, S., Crisostomo, J., Alexander-Molloy, J., Gandelman, E., Grullon, M., Lora, V., Reeves, C., Savage, C., & Viswanath, K., Planet MassCONECT C-PAC. (2012). Perceptions of evidence-based programs among community-based organizations tackling health disparities: a qualitative study. Health Education Research, 27(4), 717–728. https://doi.org/10.1093/her/cyr088.
Raphael, J. L. (2018). Pediatric health disparities and place-based strategies. Disparities in child health, (pp. 39-46): Springer International Publishing.
Robinson, E. (2017). The expert panel project. Family Matters, 99, 36-40. https://aifs.gov.au/publications/family-matters/issue-99/expert-panel-project.
Rodriguez, A., Lau, A. S., Wright, B., Regan, J., & Brookman-Frazee, L. (2018). Mixed-method analysis of program leader perspectives on the sustainment of multiple child evidence-based practices in a system-driven implementation. Implementation Science, 13(1), 44 https://doi.org/10.1186/s13012-018-0737-6.
Saldaña, J. (2016). The coding manual for qualitative researchers (3rd Edition ed.). London: SAGE.
Sandelowski, M. (2000). Focus on research methods: Whatever happened to qualitative description? Research in Nursing and Health, 23(4), 334–340. https://doi.org/10.1002/1098-240X(200008)23:43.0.CO2-G.
Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). MAPping Los Angeles County: taking an evidence-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43(2), 190–200. https://doi.org/10.1080/15374416.2013.833098.
U.S. Department of Health and Human Services. (2018). Information memorandum: new legislation—public law 115–123, the Family First Prevention Services Act within Division E, Title VII of the Bipartisan Budget Act of 2018.
U.S. Department of Health and Human Services. (2021). Title IV-E prevention services clearinghouse. Retrieved 20 August 2021 from https://preventionservices.abtsites.com/.
Van Dyke, M. K., & Naoom, S. F. (2016). The critical role of state agencies in the age of evidence-based approaches: the challenge of new expectations. Journal of Evidence-Informed Social Work, 13(1), 45–58. https://doi.org/10.1080/15433714.2014.942021.
Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 67 https://doi.org/10.1186/1748-5908-4-67.
Weiss, C. H., Murphy-Graham, E., Petrosino, A., & Gandhi, A. G. (2008). The fairy godmother—and her warts. American Journal of Evaluation, 29(1), 29–47. https://doi.org/10.1177/1098214007313742.
Wilks, S., Lahausse, J., & Edwards, B. (2015). Commonwealth place-based service delivery initiatives: key learnings project. https://aifs.gov.au/publications/commonwealth-place-based-service-delivery-initiatives.
Acknowledgements
Fiona Burgemeister has an Australian Government Research Training Program PhD scholarship. The authors received no funding for this research. The authors are appreciative of the assistance and support of this study by the Australian Government Department of Social Services and the Australian Institute of Family Studies. The authors thank those who participated in this study for their time and insights.
Author Contributions
All authors contributed to the study conception and design. Material preparation and data collection were conducted by Fiona Burgemeister. Data analysis was performed by Fiona Burgemeister, with support and validation provided by all authors, but primarily Sharinne Crawford. The draft manuscript was written by Fiona Burgemeister, edited by Jan Nicholson, and all authors commented on previous versions. All authors read and approved the final manuscript. Supervision for all aspects of this study was provided by Sharinne Crawford, Naomi Hackworth, Stacey Hokke, and Jan Nicholson.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no competing interests.
Ethical Approval
Ethical approval for this study was granted by the La Trobe University Human Research Ethics Committee (S17-159). Study approval was also obtained from DSS and AIFS.
Consent to Participate and Publish
Informed consent was obtained from all individual participants to publish their data. Where participants did not consent to having direct quotations published, these have not been used.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
About this article
Cite this article
Burgemeister, F.C., Crawford, S.B., Hackworth, N.J. et al. Implementation of Evidence-Based Programs within an Australian Place-Based Initiative for Children: a Qualitative Study. J Child Fam Stud 32, 357–372 (2023). https://doi.org/10.1007/s10826-021-02191-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-021-02191-z