Comparing Self-Reported and Performance-Based Online Feedback on Early Childhood Teachers’ Implementation of Language Strategies

  • Kate AscettaEmail author
  • Beth Harn
  • Lillian Durán


This professional development (PD) study examined the effect of feedback type on changing preschool teachers’ use of language enhancement strategies and language outcomes for children. We included 21 Head Start teachers and 107 children. We randomized classrooms to PD feedback condition: (a) self-reported or (b) observed use of strategies. All teachers completed online learning modules on language enhancement strategies (i.e. open-ended questions, self-talk, repetition, expansion, and narration) and teacher self-monitoring. After completing the PD, teachers were provided weekly, individualized feedback based on their submissions of: (a) self-reported, or (b) observed performance (via 10-min video) of their use of language enhancement strategies. Results suggested that the PD experience (less than 8 weeks, 1 h per week) increased teachers’ frequency in using language enhancement strategies (performance, Hedges’ g = 0.65; self-report, Hedges’ g = 1.43) across condition, with no significant differences by condition. Additionally, children demonstrated mean gains in expressive vocabulary and overall language skills. We believe that this brief, but targeted PD experience, warrants further research to explore the impact of using self-reported feedback with a larger sample. Determining more efficient and effective PD approaches will enable the field to better meet the needs of teachers and improve outcomes for children.


Early childhood Language enhancement Professional development Head Start Randomized control trial 



  1. Alicke, M. D., Klotz, M. L., Breitenbecher, D. L., Yurak, T. J., & Vredenburg, D. S. (1995). Personal contact, individuation, and the better-than-average effect. Journal of Personality and Social Psychology, 68(5), 804–825.CrossRefGoogle Scholar
  2. Anderson, T. (2003). Getting the mix right again: An updated and theoretical rationale for interaction. The International Review of Research in Open and Distance Learning, 4(2), 1–18.CrossRefGoogle Scholar
  3. Artman-Meeker, K. M., & Hemmeter, M. L. (2013). Effects of training and feedback on teachers’ use of classroom preventive practices. Topics in Early Childhood Special Education, 33, 112–123.CrossRefGoogle Scholar
  4. Barton, E. E., Pribble, L., & Chen, C. (2014). The use of e-mail to deliver performance-based feedback to early childhood practitioners. Journal of Early Intervention, 35(3), 270–297.CrossRefGoogle Scholar
  5. Berkel, C., Mauricio, A., Schoenfelder, E., & Sandler, I. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 22–33.CrossRefGoogle Scholar
  6. Dede, C., Ketelhut, D. J., Whitehouse, P., Breit, L., & McCloskey, E. M. (2009). A research agenda for online teacher professional development. Journal of Teacher Education, 60, 8–19.CrossRefGoogle Scholar
  7. Desimone, L. M. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Education and Educational Research, 88, 181–199.CrossRefGoogle Scholar
  8. Dickinson, D. K., & Caswell, L. (2007). Building support for language and early literacy in preschool classrooms through in-service professional development: Effects of the Literacy Environment Enrichment Program (LEEP). Early Childhood Research Quarterly, 22, 243–260.CrossRefGoogle Scholar
  9. Early, D. M., Bryant, D. M., Pianta, R. C., Clifford, R. M., Burchinal, M. R., Ritchie, S., … Barbarin, O. (2006). Are teachers’ education, major, and credentials related to classroom quality and children’s academic gains in pre-kindergarten? Early Childhood Research Quarterly, 21, 174–195.CrossRefGoogle Scholar
  10. Fallon, L. M., Collier-Meek, M. A., Maggin, D. M., Sanetti, L. M. H., & Johnson, A. H. (2015). Is Performance feedback for educators an evidence-based practice? A systematic review and evaluation based on single-case research. Exceptional Children, 81, 227–246.CrossRefGoogle Scholar
  11. Feingold, A. (2009). Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis. Psychological Methods, 14(1), 43–53.CrossRefGoogle Scholar
  12. Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38, 915–945.CrossRefGoogle Scholar
  13. Gast, D. L. (2010). Single subject research methodology in behavioral sciences. New York: Routledge.Google Scholar
  14. Girolametto, L., & Weitzman, E. (2002). Responsiveness of child care providers in interactions with toddlers and preschoolers. Language, Speech, and Hearing Services in Schools, 33, 268–281.CrossRefGoogle Scholar
  15. Girolametto, L., Weitzman, E., & Greenberg, J. (2006). Facilitating language skills: In-service education for early childhood educators and preschool teachers. Infants and Young Children, 19, 36–48.CrossRefGoogle Scholar
  16. Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327.CrossRefGoogle Scholar
  17. Harms, T., & Clifford, R. (1980). Early childhood environment rating scale (ECERS). New York, NY: Teacher’s College Press.Google Scholar
  18. Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore, MD: Brookes.Google Scholar
  19. Hedges, L., & Olkin, I. (1985). Statistical models for meta-analysis. San Diego: Academic Press.Google Scholar
  20. Hemmeter, M. L., Snyder, P., Kinder, K., & Artman, K. (2011). Impact of performance feedback delivered via electronic mail on preschool teachers’ use of descriptive praise. Early Childhood Research Quarterly, 26, 96–109.CrossRefGoogle Scholar
  21. Hendricks, G. C., Thoresen, C. E., & Hubbard, D. R. (1974). Effects of behavioral self observation on elementary teachers and students. Stanford Center for Research and Development, Memorandum No. 121.Google Scholar
  22. Higgins, E. T. (1989). Self-discrepancy theory: What patterns of self-beliefs cause people to suffer? Advances in experimental social psychology, 22, 93–136.Google Scholar
  23. Justice, L. M., Mashburn, A. J., Hamre, B. K., & Pianta, R. C. (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23, 51–68.CrossRefGoogle Scholar
  24. Lambert, R. G., Kim, D. H., & Burts, D. C. (2015). The measurement properties of the Teaching Strategies GOLD® assessment system. Early Childhood Research Quarterly, 33, 49–63.CrossRefGoogle Scholar
  25. Maguire, M. C. (1999). Treating the dyad as the unit of analysis: A primer on three analytic approaches. Journal of Marriage and the Family, 61, 213–223.CrossRefGoogle Scholar
  26. McConnell, S., Bradfield, T., Wackerle-Hollman, A., & Rodriguez, M. (2012). Individual growth and development indicators of early literacy (IGDIs-EL) (2nd ed.). Saint Paul: Early Learning Labs, Inc.Google Scholar
  27. McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22, 276–282.CrossRefGoogle Scholar
  28. McNeish, D., & Stapleton, L. M. (2016). Modeling clustered data with very few clusters. Multivariate Behavioral Research, 51, 495–518.CrossRefGoogle Scholar
  29. NICHD Early Child Care Research Network. (2002). Early child care and children’s development prior to school entry: Results from the NICHD study of early child care. American Educational Research Journal, 39, 133–164.CrossRefGoogle Scholar
  30. Odom, S. L. (2009). The tie that binds: Evidence-based practice, implementation science and outcomes for children. Topics in Early Childhood Special Education, 29, 53–61.CrossRefGoogle Scholar
  31. Pellecchia, M., Connell, J. E., Eisenhart, D., Kane, M., Schoener, C., Turkel, K., … Mandell, D. S. (2011). We’re all in this together now: Group performance feedback to increase classroom team data collection. Journal of School Psychology, 49, 411–431.CrossRefGoogle Scholar
  32. Pianta, R. C., Mashburn, A. J., Downer, J. T., Hamre, B. K., & Justice, L. (2008). Effects of web-mediated professional development resources on teacher-child interactions in pre-kindergarten classrooms. Early Childhood Research Quarterly, 23, 431–451.CrossRefGoogle Scholar
  33. Piasta, S. B., Justice, L. M., Cabell, S. Q., Wiggins, A. K., Turnbull, K. P., & Curenton, S. M. (2012). Impact of professional development on preschool teachers’ conversational responsivity and children’s linguistic productivity and complexity. Early Childhood Research Quarterly, 27, 387–400.CrossRefGoogle Scholar
  34. Powell, D. R., Diamond, K. E., Burchinal, M. R., & Koehler, M. (2010). Effects of an early literacy professional development intervention on head start teachers and children. Journal of Educational Psychology, 102, 299–312.CrossRefGoogle Scholar
  35. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (Vol. 1). Thousand Oaks: Sage.Google Scholar
  36. Reinke, W. M., Lewis-Palmer, T., & Martin, E. (2008). The effect of visual performance feedback on teacher use of behavior-specific praise. Behavior Modification, 31, 247–263.CrossRefGoogle Scholar
  37. Roberts, A. M., LoCasale-Crouch, J., DeCoster, J., Hamre, B. K., Downer, J. T., Williford, A. P., & Pianta, R. C. (2015). Individual and contextual factors associated with pre- kindergarten teachers: Responsiveness to the MyTeachingPartner coaching intervention. Prevention Science, 16, 1044–1053.CrossRefGoogle Scholar
  38. Ryan, J., & Scott, A. (2008). How online discussion can be used to develop informed and critical literacy teachers. Teaching and Teacher Education, 24, 1635–1644.CrossRefGoogle Scholar
  39. Simonsen, B., MacSuga, A. S., Fallon, L. M., & Sugai, G. (2012). The effects of self-monitoring on teachers’ use of specific praise. Journal of Positive Behavior, 15, 5–15.CrossRefGoogle Scholar
  40. Snyder, P., Hemmeter, M. L., & McLaughlin, T. (2012). Professional development in early childhood intervention: Where we stand on the silver anniversary of PL 99–457. Journal of Early Intervention, 33, 357–370.CrossRefGoogle Scholar
  41. Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment. School Psychology Review, 41, 74074.Google Scholar
  42. Treacy, B., Kleiman, G., & Peterson, K. (2002). Successful online professional development. International Society for Technology in Education, 30, 42–47.Google Scholar
  43. U.S. Department of Health and Human Services, Administration for Children and Families. (2016). Program Information Report. Washington, DC: Author.Google Scholar
  44. Van Houten, R., & Sullivan, K. (1975). Effects of an audio cueing system on the rate of teacher praise. Journal of Applied Behavior Analysis, 8, 197–201.CrossRefGoogle Scholar
  45. Vasilyeva, M., & Waterfall, H. (2011). Variability in language development: Relation to SES and environmental input. In S. Neuman & D. Dickinson (Eds.), Handbook of early literacy research (pp. 36–48). New York: Guilford Press.Google Scholar
  46. Vazire, S. (2010). Who knows what about a person? The self–other knowledge asymmetry (SOKA) model. Journal of Personality and Social Psychology, 98(2), 281–300.CrossRefGoogle Scholar
  47. Wasik, B. A., Bond, M. A., & Hindman, A. (2006). The effects of a language and literacy intervention on Head Start children and teachers. Journal of Educational Psychology, 98, 63–74.CrossRefGoogle Scholar
  48. Wackerle-Hollman, A., Duran, L., & Rodriguez, M. (2015). Individual growth and development indicators-espanol. Mendota Heights, MN: Early Learning Labs.Google Scholar
  49. Yoon, K. S., Duncan, T., Lee, S. W. Y., Scarloss, B., & Shapley, K. L. (2007). Reviewing the evidence on how teacher professional development affects student achievement Reviewing the evidence on how teacher professional development. Evaluation, (REL 2007033), 62. Retrieved from
  50. Zaslow, M., Tout, K., Halle, T., Whittaker, J. V., & Lavelle, B. (2010). Toward the identification of features of effective professional development for early educators, Literature review. Washington, DC: U.S. Department of Education, Office of Planning. Retrieved from list/opepd/ppss/reports.html.
  51. Zauche, L. H., Thul, T. A., Mahoney, A. E. D., & Stapel-Wax, J. L. (2016). Influence of language nutrition on children’s language and cognitive development: An integrated review. Early Childhood Research Quarterly, 36, 318–333.CrossRefGoogle Scholar

Copyright information

© Springer Nature B.V. 2019

Authors and Affiliations

  1. 1.University of South CarolinaColumbiaUSA
  2. 2.University of OregonEugeneUSA

Personalised recommendations