Skip to main content
Log in

Foundations for Success: A Mixed-Methods Evaluation of a Statewide, Cross-Sector Early Childhood Collaborative

  • Original Paper
  • Published:
Child & Youth Care Forum Aims and scope Submit manuscript

Abstract

Background

The need for cross-sector collaborations to implement system-level improvements in early childhood care and education brings increased demand for comprehensive and practicable means of evaluating such collaborations.

Objective

This mixed-methods study evaluates a statewide collaboration formed to develop a strategic plan for a comprehensive mixed-delivery system serving children birth to age 5 using instruments appropriate to an early-stage collaboration and adding a focus on diversity, equity, and inclusion (DEI).

Method

All collaboration members were asked to complete the Collaborative Vitality Survey and a random subsample of members with high rates of participation completed phone interviews. Survey data were summarized across six dimensions: participation, community, productivity, communication, accountability, and synergy. Using thematic analysis and frequencies, qualitative interviews were coded along these dimensions and DEI, incorporating an appreciative inquiry approach identifying barriers, supports, and hopes for the future.

Results

Overall, collaborative participation was high. Across methods, respondents reported they, overall, were pleased with collaborative functioning. Qualitative interviews suggest the collaboration domains of community and participation were most salient. Concrete recommendations from participants can be put into practice and inform the collaboration as state-level work continues.

Conclusion

The early stage of collaboration is fundamental to success and defined by building cohesion, norms, and roles. This study highlights key weaknesses and strengths that influence collaborative functioning at this stage and illustrates the significance of defining and manifesting DEI in collaboration efficacy. This study demonstrates the importance of evaluating collaboration in an ongoing manner to ensure effectiveness and inform improvements in functioning over time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Source Oklahoma Partnership for School Readiness

Similar content being viewed by others

References

  • Amherst H. Wilder Foundation. (2018). Collaboration factors inventory 3rd ed. Retrieved from https://www.wilder.org/wilder-research/research-library/collaboration-factors-inventory-3rd-edition.

  • Austin, J. (2000). The collaboration challenge: How non-profits and businesses succeed through strategic alliances. Dorchester, MA: Jossey-Bass.

    Google Scholar 

  • Barile, J. P., Darnell, A. J., Erickson, S. W., & Weaver, S. R. (2012). Multilevel measurement of dimensions of collaborative functioning in a network of collaboratives that promote child and family well-being. American Journal of Community Psychology, 49, 270–282

    Article  Google Scholar 

  • Boulu-Reshef, B. (2013). Economics of identity and economics of the firm: Why and how their three central questions overlap. Journal of Institutional Economics, 9, 363–379

    Article  Google Scholar 

  • Bryson, J. M., Crosby, B. C., & Stone, M.M. (2006). The design and implementation of cross-sector collaborations: Propositions from the literature. Public Administration Review, December, 44–55.

  • Butterfoss, F. D. (2007). Coalitions and partnerships in community health. 1st ed. Jossey-Bass.

  • Center for the Study of Social Policy. (2019). Early childhood system performance assessment toolkit. Retrieved from https://cssp.org/resource/early-childhood-system-performance-assessment-toolkit/

  • Coghlan, A. T., Preskill, H., & Tzavaras Catsambas, T. (2003). An overview of appreciative inquiry in evaluation. New Directions for Evaluation, 2003(100), 5–22

    Article  Google Scholar 

  • Cross, J. E., Dickmann, E., Newman-Gonchar, R., & Fagen, J. M. (2009). Using mixed-methods design and network analysis to measure development of interagency collaboration. American Journal of Evaluation, 30(3), 310–329

    Article  Google Scholar 

  • Darling-Hammond, L. (1998). Unequal opportunity: Race and education. Brookings Institute. Retrieved from https://www.brookings.edu/articles/unequal-opportunity-race-and-education/

  • Darnell, A. J., Barile, J. P., Weaver, S. R., Harper, C. R., Kuperminc, G. P., & Emshoff, J. G. (2013). Testing effects of community collaboration on rates of low infant birthweight at the county level. American Journal of Community Psychology, 51(3–4), 398–406

    Article  Google Scholar 

  • De Montigny, J. G., Desjardins, S., & Bouchard, L. (2019). The fundamentals of cross-sector collaboration for social change to promote population health. Global Health Promotion, 26(2), 41–50

    Article  Google Scholar 

  • Del Grosso, P., Akers, L., Mraz Esposito, A., & Paulsell, D. (2014). Early care and education partnerships: A review of the literature (OPRE Report No. 2014–64). U.S. Department of Health and Human Services, Administration for Children and Families, Office of Planning, Research and Evaluation.

  • Dufour, R., Eaker, R., and Dufour, R. (2005). On common ground: The power of professional learning communities. National Education Service.

  • Early Childhood Systems Working Group. (2020). Comprehensive early childhood system-building: A tool to inform discussions on collaborative, cross-sector planning. Retrieved from https://www.buildinitiative.org/Portals/0/Uploads/Documents/ECSWG%20Systems%20Planning%20Tool_2014.pdf

  • El Ansari, W., Phillips, C. J., & Hammick, M. (2001). Collaboration and partnerships: developing the evidence base. Health & Social Care in the Community9(4), 215–227..

  • First Focus on Children (2019). Children’s budget 2019. Retrieved from https://firstfocus.org/resources/report/childrens-budget-2019

  • Gajda, R. (2004). Utilizing collaboration theory to evaluate strategic alliances. American Journal of Evaluation, 25(1), 65–77

    Article  Google Scholar 

  • Gajda, R. (2006). Safe schools and strategic alliances: How assessment of collaboration enhances school violence prevention and response. Journal of School Violence, 5, 63–80

    Article  Google Scholar 

  • Gajda, R., & Koliba, C. (2007). Evaluating the imperative of intraorganizational collaboration: A school improvement perspective. American Journal of Evaluation, 28(1), 26–44

    Article  Google Scholar 

  • Garcia, E. and Weiss, E. (2017). Education inequalities at the school starting gate: Gaps, trends, and strategies to address them. Economic Policy Institute.Retrieved from https://www.epi.org/publication/education-inequalities-at-the-school-starting-gate/

  • Gongla, P., & Rizzuto, C. R. (2001). Evolving communities of practice: IBM global services experience. IBM Systems Journal, 40(4), 842–862

    Article  Google Scholar 

  • Greenwald, H. P., & Zukoski, A. P. (2018). Assessing collaboration: Alternative measures and issues for evaluation. American Journal of Evaluation, 39(3), 322–335

  • Guarino, A. (2018). Federal funding for early childhood programs: A decade of bipartisan progress. First Five Years Fund. Retrieved from https://www.ffyf.org/federal-funding-for-early-childhood-programs-a-decade-of-bipartisan-progress/

  • Harper, C. R., Kuperminc, G. P., Weaver, S. R., Emshoff, J., & Erickson, S. (2014). Leveraged resources and systems changes in community collaboration. American Journal of Community Psychology, 54, 348–357

    Article  Google Scholar 

  • Hong, S.S, Yazejian, N., Guss, S., Stein, A., Conners, M., Horm, D., & Kainz, K. (2019). Broadening the definition of collaboration in early care and education. Early Education and Development, 8.https://doi.org/10.1080/10409289.2019.1658050

  • Klein, S. (2016). Benefits of early care and education for children in the child welfare system: A research-to-practice brief (Report #: 2016–68). Office of Planning, Research and Evaluation. US Department of Health and Human Services Early Childhood-Child Welfare Partnership. Retrieved fromhttps://www.acf.hhs.gov/sites/default/files/opre/opre_2016 _benefitschildwelfaresystem_v16_508.pdf

  • Klein, S., Milhalec-Adkins, B., Benson, S., & Lee, S. Y. (2018). The benefits of early care & education for child welfare-involved children: Perspectives from the field. Child Abuse & Neglect: the International Journal, 79, 454–464

    Article  Google Scholar 

  • Lasker, R. D., & Weiss, E. S. (2003). Broadening participation in community problem solving: A multidisciplinary model to support collaborative practice and research. Journal of Urban Health: Bulletin of the New York Academy of Medicine, 80(1), 14–46

    Article  Google Scholar 

  • Love, J. M., Kisker, E. E., Ross, C., Constantine, J., Boller, K., Chazen-Cohen, R., Brady-Smith, C., Sidle Fuligni, A., Raikes, H., Brooks-Gunn, J., Banks Tarullo, L., Schochet, P. Z., Paulsell, D., & Vogel, C. (2005). The effectiveness of early head start for 3-year-old children and their parents: Lessons for policy and programs. Developmental Psychology, 41(6), 885–901

    Article  Google Scholar 

  • Marek, L. I., Brock, D. J. P., & Savla, J. (2015). Evaluating collaboration for effectiveness: Conceptualization and measurement. American Journal of Evaluation, 36(1), 67–85

    Article  Google Scholar 

  • McLeod, G. F. H., Horwood, L. J., Boden, J. M., & Fergusson, D. M. (2018). Early childhood education and later educational attainment and socioeconomic wellbeing outcomes at age 30. New Zealand Journal of Educational Studies, 53(2), 257–273

    Article  Google Scholar 

  • National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Population Health and Public Health Practice; Roundtable on Population Health Improvement. (2018). Exploring early childhood care and education levers to improve population health: Proceedings of a workshop. https://www.ncbi.nlm.nih.gov/books/NBK538055/ doi: https://doi.org/10.17226/25129

  • National Association of Elementary School Principals. (2002). Leading learning communities: Standards for what principals should know and be able to do. Retrieved from https://www.naesp.org/sites/default/files/resources/1/Pdfs/LLC2-ES.pdf

  • National Staff Development Council. (2001). Standards for staff development: Revised edition. Retrieved from https://gtlcenter.org/sites/default/files/docs/pa/3_PDPartnershipsandStandards/NSDCStandards_No.pdf.

  • OKFutures. (2019). Strategic plan. Retrieved from https://okschoolreadiness.org/uploads/documents/OPSR%20Strategic%20Plan_1.21.19_FINAL.pdf

  • QSR International. (2018). NVivo Pro (version 12) [computer software]. Available from http://www.qsrinternational.com/default.aspx

  • Santos, F. M., & Eisenhardt, K. M. (2005). Organizational boundaries and theories of organization. Organization Science, 16(5), 491–508

    Article  Google Scholar 

  • Schilder, D., Curenton, S.M., & Broadstone, M. (2019) Introduction to the special issue on early car and education collaboration. Early Education and Development 8. https://doi.org/10.1080/10409289.2019.1658050

  • Stevenson, J. F., & Mitchell, R. E. (2003). Community-level collaboration for substance abuse prevention. Journal of Primary Prevention, 23(3), 371–404

    Article  Google Scholar 

  • US Department of Education. (2016). Non-regulatory guidance early learning in the every student succeeds act: Expanding opportunities to support our youngest learners. Retrieved from https://www2.ed.gov/policy/elsec/leg/essa/essaelguidance10202016.pdf

  • Woodland, R. H., & Hutton, M. S. (2012). Evaluating organizational collaborations: Suggested entry points and strategies. American Journal of Evaluation, 33(3), 366–383

    Article  Google Scholar 

  • Yoshikawa, H., Weiland, C., Brooks-Gunn, J., Burchinal, M.R., Espinosa, L.M., Gormley, W.T., & Zaslow, M. (2013). Investing in our future: The evidence base on preschool education. Society for Research in Child Development and Foundation for Child Development.

Download references

Acknowledgements

We are grateful to the editorial assistance of Adrien Malek-Lasater. Her careful attention to detail and thoughtful feedback was greatly appreciated. (The authors assume responsibility for any errors.) We would also like to acknowledge the staff at the Oklahoma Parternship for School Readiness for their support and efforts, which made this evaluation possible.

Funding

This research was funded through a subcontract with the Oklahoma Partnership for School Readiness for their US Department of Health and Human Services, Administration for Children and Families, Office of Child Care, Grant No. 90TP0037.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kelly Tabbutt.

Ethics declarations

Availability of Data, Codes, and Research Materials

Data, codes, and research materials are available as needed for verification of the research findings in this report or further research or application upon request. For questions about or requests for access to data, codes, or other research materials, please contact the first author.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tabbutt, K., Maher, E.J. & Horm, D. Foundations for Success: A Mixed-Methods Evaluation of a Statewide, Cross-Sector Early Childhood Collaborative. Child Youth Care Forum 51, 111–135 (2022). https://doi.org/10.1007/s10566-021-09622-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10566-021-09622-4

Keywords

Navigation