Comparing Live and Video Observation to Assess Early Parent-child Interactions in the Home
Observation is the ‘gold standard’ for assessing parent-child behavior, however few studies have compared coding live, in real time, versus coding from videotapes in terms of their achievable levels of coder reliability within the field of parent programme research. This is important for practitioners and researchers for whom decisions might be influenced by time and financial constraints, but where outcomes may have real practical and clinical implications. Trained coders in the Dyadic Parent-Child Interaction Coding System Revised, coded 40 half-hour videotapes of 33 parent-toddler dyads interacting in the home on 29 items of dyadic behaviour. Four theorised composite variables were constructed. Videotaped data were compared to data drawn from the same interactions previously coded ‘live’ in the home. Correlations indicated significant agreement between the two modes at the item by item level (p < .001). Wilcoxon Rank tests revealed significant differences (p < .001) between the two modes. Eight items exceeded a ±30% change in median score suggesting clinically relevant differences. Although both methods achieved acceptable levels of inter-rater reliability, video coding achieved higher levels of agreement. Subtle differences exist between the two modes. Whilst neither mode proved superior it is suggested that they should not be used interchangeably.
KeywordsObservation Reliability Agreement Parent-child interaction
This study was conducted as part of a self-funded Masters and a fully funded PhD (2/3 School of Psychology, Bangor University; 1/3 Children’s Early Intervention Trust Charity). We would like to acknowledge Dr’s Karen Jones, Nia Griffith, Catrin Eames, Pamela Martin-Forbes, Kirsty Pye and Joanna Charles for conducting the live observation visits. Finally, we would like to thank the parents and children who took part in the randomised controlled trial from which this data was drawn, for their commitment to the project and for providing us with this data.
N. G. designed and executed the study, conducted data analyses, and wrote the paper. T. B. collaborated with the design and writing of the study, and editing the final manuscript. J. H. collaborated with the design and writing of the study, and editing the final manuscript.
Compliance with Ethical Standards
Conflict of Interest
The authos declare that they have no conflict of interest.
Ethical approval for the current study was provided by Bangor University, Wales, UK.
- Bjorseth, A., McNeil, C., & Wichstrom, L. (2015). Screening for behvaioural disorders with the Dyadic Parent-Child Interaction Coding System: sensitivity, specificity, and core discriminative components. Child and Family Behaviour Therapy, 37, 20–37. https://doi.org/10.1080/07317107.2015.1000228.CrossRefGoogle Scholar
- Bywater, T., Hutchings, J., Daley, D., Whitaker, C., Yeo, S. T., Jones, K., Eames, C., & Tudor Edwards, R. (2009). Long-term effectiveness of a parenting intervention for children at risk of developing conduct disorder. The British Journal of Psychiatry, 195, 318–324. https://doi.org/10.1192/bjp.bp.108.056531.CrossRefPubMedGoogle Scholar
- Curby, T. W., Johnson, P., Mashburn, A. J., & Carlis, L. (2016). Live versus video observations: comparing the reliability and validity of two methods of assessing classroom quality. Journal of Psychoeducational Assessment, 34(8), 765–781. https://doi.org/10.1177/0734282915627115.CrossRefGoogle Scholar
- Fagot, B. & Hagan, R. (1988). Is what we see what we get? Comparisons of taped and live observations. Behavioural Assessment, 10, 367–374. https://doi.org/ 0191-5401/88.Google Scholar
- Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore MD: Paul H Brookes Publishing.Google Scholar
- Hutchings, J., Griffith, N., Bywater, T., & Williams, M. (2017). Evaluating the Incredible Years Toddler Parenting Programme with parents of toddlers in disadvantaged (Flying Start) areas of Wales. Child: Care, Health and Development, 43, 104–113. https://doi.org/10.1111/cch/12415.CrossRefGoogle Scholar
- Hutchings, J., Bywater, T., Daley, D., Gardner, F., Whitaker, C., Jones, K., Eames, C., & Edwards, R. T. (2007). Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. British Medical Journal, 334, 678–684. https://doi.org/10.1136/bmj/j.39126.620799.55.CrossRefPubMedGoogle Scholar
- Jones, K., Daley, D., Hutchings, J., Bywater, T., & Eames, C. (2007). Efficacy of the Incredible Years Programme as an early intervention for children with conduct problems and ADHD: long-term follow up. Child Care Health and Development, 33(6), 749–756. https://doi.org/10.1111/j.1365-2214.2008.00817.x.CrossRefGoogle Scholar
- Leadsom, A., Field, F., Burstow, P., & Lucas, C. (2013). The 1001 critical days: The importance of the conception to age two period. London: A Cross Party Manifesto. https://www.1001criticaldays.co.uk/sites/default/files/1001%20days_oct16_1st.pdf.Google Scholar
- McGilloway, S., NiMhaille, G., Bywater, T., Leckey, Y., Kelly, P., Furlong, M., Comiskey, C., O’Neill, D., & Donnelly, M. (2014). Reducing child conduct disordered behaviour and improving parent mental health in disadvantaged families: a 12-month follow up and cost analysis of a parenting intervention. European Child and Adolescent Psychiatry, 23, 783–794. https://doi.org/10.1007/s00787-013-0499-2.CrossRefPubMedGoogle Scholar
- Melhuish, E., Quinn, L., Sylva, K., Sammons, P., Siraj-Blatchford, I., & Taggart, B. (2012). Preschool affects longer term literacy and numeracy: results from a general population longitudinal study in Northern Ireland. School Effectiveness and School Improvement, 24, 234–250. https://doi.org/10.1080/09243453.2012.749796.CrossRefGoogle Scholar
- Middel, B., & van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care, 2, 1–21. https://doi.org/10.5334/ijic.65.CrossRefGoogle Scholar
- Reid, M. J., Webster-Stratton, C., & Beauchaine, T. P. (2001). Parent training in head start: a comparison of program response among African American, Asian American, Caucasian, and Hispanic mothers. Prevention Science, 2, 209–227. https://doi.org/10.1023/A:1013618309070.CrossRefPubMedGoogle Scholar
- Scott, S., Doolan, M., Beckett, C., Harry, S., Cartwright, S., & The HCA team. (2014). How is parenting style related to child anti-social behaviour? Preliminary findings from the Helping Children Achieve study. Research Report DFE-RR185a. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/197732/DFE-RR185a.pdf.
- Seabra-Santos, M. J., Gaspar, M. F., Azevedo, A. F., Homem, T. C., Guerra, J., Martins, V., & Leitao, S. (2016). Incredible Years parent training: what changes, for whom, how, from how long? Journal of Applied Developmental Psychology, 44, 93–104. https://doi.org/10.1016/j.appdev.2016.04.004.CrossRefGoogle Scholar
- Shrum, W., Duque, R., & Brown, T. (2005). Digital video as research practice: Methodology for the Millennium. Journal of Research Practice, 1, 1–19. http://jrp.icaap.org/index.php/jrp/article/view/6/12.Google Scholar