Advertisement

Journal of Child and Family Studies

, Volume 27, Issue 6, pp 1818–1829 | Cite as

Comparing Live and Video Observation to Assess Early Parent-child Interactions in the Home

  • Nicole GridleyEmail author
  • Tracey Jane Bywater
  • Judy Mary Hutchings
Original Paper

Abstract

Observation is the ‘gold standard’ for assessing parent-child behavior, however few studies have compared coding live, in real time, versus coding from videotapes in terms of their achievable levels of coder reliability within the field of parent programme research. This is important for practitioners and researchers for whom decisions might be influenced by time and financial constraints, but where outcomes may have real practical and clinical implications. Trained coders in the Dyadic Parent-Child Interaction Coding System Revised, coded 40 half-hour videotapes of 33 parent-toddler dyads interacting in the home on 29 items of dyadic behaviour. Four theorised composite variables were constructed. Videotaped data were compared to data drawn from the same interactions previously coded ‘live’ in the home. Correlations indicated significant agreement between the two modes at the item by item level (p < .001). Wilcoxon Rank tests revealed significant differences (p < .001) between the two modes. Eight items exceeded a ±30% change in median score suggesting clinically relevant differences. Although both methods achieved acceptable levels of inter-rater reliability, video coding achieved higher levels of agreement. Subtle differences exist between the two modes. Whilst neither mode proved superior it is suggested that they should not be used interchangeably.

Keywords

Observation Reliability Agreement Parent-child interaction 

Notes

Acknowledgements

This study was conducted as part of a self-funded Masters and a fully funded PhD (2/3 School of Psychology, Bangor University; 1/3 Children’s Early Intervention Trust Charity). We would like to acknowledge Dr’s Karen Jones, Nia Griffith, Catrin Eames, Pamela Martin-Forbes, Kirsty Pye and Joanna Charles for conducting the live observation visits. Finally, we would like to thank the parents and children who took part in the randomised controlled trial from which this data was drawn, for their commitment to the project and for providing us with this data.

Author Contributions

N. G. designed and executed the study, conducted data analyses, and wrote the paper. T. B. collaborated with the design and writing of the study, and editing the final manuscript. J. H. collaborated with the design and writing of the study, and editing the final manuscript.

Compliance with Ethical Standards

Conflict of Interest

The authos declare that they have no conflict of interest.

Ethical Approval

Ethical approval for the current study was provided by Bangor University, Wales, UK.

References

  1. Bennetts, S. K., Mensah, F. K., Westrupp, E. M., Hackworth, N. J., & Reilly, S. (2016). The agreement between parent-reported and directly measured child language and parenting behaviours. Frontiers in Psychology, 7, 1–18.  https://doi.org/10.3389/fpsyg.2016.01710.CrossRefGoogle Scholar
  2. Bjorseth, A., McNeil, C., & Wichstrom, L. (2015). Screening for behvaioural disorders with the Dyadic Parent-Child Interaction Coding System: sensitivity, specificity, and core discriminative components. Child and Family Behaviour Therapy, 37, 20–37.  https://doi.org/10.1080/07317107.2015.1000228.CrossRefGoogle Scholar
  3. Bywater, T., Hutchings, J., Daley, D., Whitaker, C., Yeo, S. T., Jones, K., Eames, C., & Tudor Edwards, R. (2009). Long-term effectiveness of a parenting intervention for children at risk of developing conduct disorder. The British Journal of Psychiatry, 195, 318–324.  https://doi.org/10.1192/bjp.bp.108.056531.CrossRefPubMedGoogle Scholar
  4. Curby, T. W., Johnson, P., Mashburn, A. J., & Carlis, L. (2016). Live versus video observations: comparing the reliability and validity of two methods of assessing classroom quality. Journal of Psychoeducational Assessment, 34(8), 765–781.  https://doi.org/10.1177/0734282915627115.CrossRefGoogle Scholar
  5. Elsen, R. M., Hersen, M., & Agras, W. S. (1973). Videotape: a method for the controlled observation of non-verbal interpersonal behaviour. Behaviour Therapy, 4, 420–425.  https://doi.org/10.1016/S0005-7894(73)80123-6.CrossRefGoogle Scholar
  6. Fagot, B. & Hagan, R. (1988). Is what we see what we get? Comparisons of taped and live observations. Behavioural Assessment, 10, 367–374. https://doi.org/ 0191-5401/88.Google Scholar
  7. Fernald, A., Marchman, V. A., & Weisleder, A. (2014). SES differences in language processing skill and vocabulary are evident at 18 months. Developmental Science, 16, 234–248.  https://doi.org/10.1111/desc/12019.CrossRefGoogle Scholar
  8. Gardner, F. (2000). Methodological issues in the direct observation of parent-child interaction: do observational findings reflect the natural behaviour of participants?. Clinical Child and Family Psychology Review, 3, 185–198. https://doi.org/1096-4037/00/0900-0185.CrossRefGoogle Scholar
  9. Gridley, N., Baker-Henningham, H., & Hutchings, J. (2016). Measuring parental language to target families for early intervention services. Child Care in Practice, 22, 348–367.  https://doi.org/10.1080/13575279.2016.1188761.CrossRefGoogle Scholar
  10. Haidet, K. K., Tate, J., Divirgilio-Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video recorded behavioural data. Research in Nursing and Health, 32, 465–474.  https://doi.org/10.1002/nur.20334.CrossRefPubMedGoogle Scholar
  11. Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore MD: Paul H Brookes Publishing.Google Scholar
  12. Hawes, D. J., & Dadds, M. R. (2006). Assessing parenting practices through parent-report and direct observation during parent-training. Journal of Child and Family Studies, 15(5), 554–567.  https://doi.org/10.1007/s10826-006-9029.CrossRefGoogle Scholar
  13. Hutchings, J., Griffith, N., Bywater, T., & Williams, M. (2017). Evaluating the Incredible Years Toddler Parenting Programme with parents of toddlers in disadvantaged (Flying Start) areas of Wales. Child: Care, Health and Development, 43, 104–113.  https://doi.org/10.1111/cch/12415.CrossRefGoogle Scholar
  14. Hutchings, J., Bywater, T., Daley, D., Gardner, F., Whitaker, C., Jones, K., Eames, C., & Edwards, R. T. (2007). Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. British Medical Journal, 334, 678–684.  https://doi.org/10.1136/bmj/j.39126.620799.55.CrossRefPubMedGoogle Scholar
  15. Huttenlocher, J., Waterfall, H., Vasilyeva, M., Vevea, J., & Hedges, L. V. (2010). Sources of variability in children’s language growth. Cognitive Psychology, 61(4), 343–365.  https://doi.org/10.1016/j.cogpsych.2010.08.002.CrossRefPubMedPubMedCentralGoogle Scholar
  16. Johnson, S. M., & Bolstad, O. D. (1975). Reactivity to home observation: a comparison of audio recorded behaviour with observers present or absent. Journal of Applied Behaviour Analysis, 8, 181–185.  https://doi.org/10.1901/jaba.1975.8-181.CrossRefGoogle Scholar
  17. Jones, K., Daley, D., Hutchings, J., Bywater, T., & Eames, C. (2007). Efficacy of the Incredible Years Programme as an early intervention for children with conduct problems and ADHD: long-term follow up. Child Care Health and Development, 33(6), 749–756.  https://doi.org/10.1111/j.1365-2214.2008.00817.x.CrossRefGoogle Scholar
  18. Kent, R. N., O’Leary, D., Dietz, A., & Diament, C. (1979). Comparison of observational recordings in vivo, via mirror, and via television. Journal of Applied Behaviour Analysis, 12, 517–522.  https://doi.org/10.1901/jaba.1979.12-517.CrossRefGoogle Scholar
  19. Leadsom, A., Field, F., Burstow, P., & Lucas, C. (2013). The 1001 critical days: The importance of the conception to age two period. London: A Cross Party Manifesto. https://www.1001criticaldays.co.uk/sites/default/files/1001%20days_oct16_1st.pdf.Google Scholar
  20. McGilloway, S., NiMhaille, G., Bywater, T., Leckey, Y., Kelly, P., Furlong, M., Comiskey, C., O’Neill, D., & Donnelly, M. (2014). Reducing child conduct disordered behaviour and improving parent mental health in disadvantaged families: a 12-month follow up and cost analysis of a parenting intervention. European Child and Adolescent Psychiatry, 23, 783–794.  https://doi.org/10.1007/s00787-013-0499-2.CrossRefPubMedGoogle Scholar
  21. Melhuish, E., Quinn, L., Sylva, K., Sammons, P., Siraj-Blatchford, I., & Taggart, B. (2012). Preschool affects longer term literacy and numeracy: results from a general population longitudinal study in Northern Ireland. School Effectiveness and School Improvement, 24, 234–250.  https://doi.org/10.1080/09243453.2012.749796.CrossRefGoogle Scholar
  22. Middel, B., & van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care, 2, 1–21.  https://doi.org/10.5334/ijic.65.CrossRefGoogle Scholar
  23. Moore, L. F., & Lee, A. J. (1974). Comparability of interviewer, group and individual interview ratings. Journal of Applied Psychology, 59, 163–167.  https://doi.org/10.1037/h0036518.CrossRefGoogle Scholar
  24. Page, P. (2014). Beyond statistical significance: clinical interpretation of rehabilitation research literature. International Journal of Sports Physical Therapy, 9, 726–736. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4197528/.PubMedPubMedCentralGoogle Scholar
  25. Reid, M. J., Webster-Stratton, C., & Beauchaine, T. P. (2001). Parent training in head start: a comparison of program response among African American, Asian American, Caucasian, and Hispanic mothers. Prevention Science, 2, 209–227.  https://doi.org/10.1023/A:1013618309070.CrossRefPubMedGoogle Scholar
  26. Robinson, E. A. & Eyberg, S. M. (1981). The dyadic parent-child interaction coding system: standardization and validation. Journal of Consulting and Clinical Psychology, 49, 245–250. https://doi.org/0022-006x/81/4902-0245.CrossRefGoogle Scholar
  27. Rosenstein, B. (2002). Video use in social science research and program evaluation. International Journal of Qualitative Methods, 1(3), 1–38. http://www.ualberta.ca/~iiqm/backissues/1_3Final/html/rosenstein.html.CrossRefGoogle Scholar
  28. Ryan, A. M., Daum, D., Bauman, T., Grisez, M., Mattimore, K., Nalodka, T. & McCormick, S. (1995). Direct, indirect, and controlled observation and rating accuracy. Journal of Applied Psychology, 80, 664–670. https://doi.org/0021-9010/95.CrossRefGoogle Scholar
  29. Scott, S., Knapp, M., Henderson, J., & Maugham, B. (2001). Financial cost of social exclusion: follow up study of antisocial children into adulthood. British Medical Journal, 323, 1–5.  https://doi.org/10.1136/bmj.323.7306.191.CrossRefGoogle Scholar
  30. Scott, S., Doolan, M., Beckett, C., Harry, S., Cartwright, S., & The HCA team. (2014). How is parenting style related to child anti-social behaviour? Preliminary findings from the Helping Children Achieve study. Research Report DFE-RR185a. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/197732/DFE-RR185a.pdf.
  31. Seabra-Santos, M. J., Gaspar, M. F., Azevedo, A. F., Homem, T. C., Guerra, J., Martins, V., & Leitao, S. (2016). Incredible Years parent training: what changes, for whom, how, from how long? Journal of Applied Developmental Psychology, 44, 93–104.  https://doi.org/10.1016/j.appdev.2016.04.004.CrossRefGoogle Scholar
  32. Shrum, W., Duque, R., & Brown, T. (2005). Digital video as research practice: Methodology for the Millennium. Journal of Research Practice, 1, 1–19. http://jrp.icaap.org/index.php/jrp/article/view/6/12.Google Scholar
  33. Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: a comparison of child and parent training interventions. Journal of Consulting and Clinical Psychology, 65, 93–109.  https://doi.org/10.1037/0022-006x.65.1.93.CrossRefPubMedGoogle Scholar
  34. Wysocki, T. (2015). Introduction to the special issue: direct observation in pediatric psychology research. Journal of Pediatric Psychology, 40, 1–7.  https://doi.org/10.1093/jpepsy/jsu104.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Health SciencesUniversity of YorkYorkUK
  2. 2.Centre for Evidence Based Early InterventionBangor UniversityBangorUK

Personalised recommendations