Skip to main content
SpringerLink
Log in

Comparing Live and Video Observation to Assess Early Parent-child Interactions in the Home

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

Observation is the ‘gold standard’ for assessing parent-child behavior, however few studies have compared coding live, in real time, versus coding from videotapes in terms of their achievable levels of coder reliability within the field of parent programme research. This is important for practitioners and researchers for whom decisions might be influenced by time and financial constraints, but where outcomes may have real practical and clinical implications. Trained coders in the Dyadic Parent-Child Interaction Coding System Revised, coded 40 half-hour videotapes of 33 parent-toddler dyads interacting in the home on 29 items of dyadic behaviour. Four theorised composite variables were constructed. Videotaped data were compared to data drawn from the same interactions previously coded ‘live’ in the home. Correlations indicated significant agreement between the two modes at the item by item level (p < .001). Wilcoxon Rank tests revealed significant differences (p < .001) between the two modes. Eight items exceeded a ±30% change in median score suggesting clinically relevant differences. Although both methods achieved acceptable levels of inter-rater reliability, video coding achieved higher levels of agreement. Subtle differences exist between the two modes. Whilst neither mode proved superior it is suggested that they should not be used interchangeably.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bennetts, S. K., Mensah, F. K., Westrupp, E. M., Hackworth, N. J., & Reilly, S. (2016). The agreement between parent-reported and directly measured child language and parenting behaviours. Frontiers in Psychology, 7, 1–18. https://doi.org/10.3389/fpsyg.2016.01710.

    Article  Google Scholar 

  • Bjorseth, A., McNeil, C., & Wichstrom, L. (2015). Screening for behvaioural disorders with the Dyadic Parent-Child Interaction Coding System: sensitivity, specificity, and core discriminative components. Child and Family Behaviour Therapy, 37, 20–37. https://doi.org/10.1080/07317107.2015.1000228.

    Article  Google Scholar 

  • Bywater, T., Hutchings, J., Daley, D., Whitaker, C., Yeo, S. T., Jones, K., Eames, C., & Tudor Edwards, R. (2009). Long-term effectiveness of a parenting intervention for children at risk of developing conduct disorder. The British Journal of Psychiatry, 195, 318–324. https://doi.org/10.1192/bjp.bp.108.056531.

    Article  PubMed  Google Scholar 

  • Curby, T. W., Johnson, P., Mashburn, A. J., & Carlis, L. (2016). Live versus video observations: comparing the reliability and validity of two methods of assessing classroom quality. Journal of Psychoeducational Assessment, 34(8), 765–781. https://doi.org/10.1177/0734282915627115.

    Article  Google Scholar 

  • Elsen, R. M., Hersen, M., & Agras, W. S. (1973). Videotape: a method for the controlled observation of non-verbal interpersonal behaviour. Behaviour Therapy, 4, 420–425. https://doi.org/10.1016/S0005-7894(73)80123-6.

    Article  Google Scholar 

  • Fagot, B. & Hagan, R. (1988). Is what we see what we get? Comparisons of taped and live observations. Behavioural Assessment, 10, 367–374. https://doi.org/ 0191-5401/88.

    Google Scholar 

  • Fernald, A., Marchman, V. A., & Weisleder, A. (2014). SES differences in language processing skill and vocabulary are evident at 18 months. Developmental Science, 16, 234–248. https://doi.org/10.1111/desc/12019.

    Article  Google Scholar 

  • Gardner, F. (2000). Methodological issues in the direct observation of parent-child interaction: do observational findings reflect the natural behaviour of participants?. Clinical Child and Family Psychology Review, 3, 185–198. https://doi.org/1096-4037/00/0900-0185.

    Article  Google Scholar 

  • Gridley, N., Baker-Henningham, H., & Hutchings, J. (2016). Measuring parental language to target families for early intervention services. Child Care in Practice, 22, 348–367. https://doi.org/10.1080/13575279.2016.1188761.

    Article  Google Scholar 

  • Haidet, K. K., Tate, J., Divirgilio-Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video recorded behavioural data. Research in Nursing and Health, 32, 465–474. https://doi.org/10.1002/nur.20334.

    Article  PubMed  Google Scholar 

  • Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experience of young American children. Baltimore MD: Paul H Brookes Publishing.

    Google Scholar 

  • Hawes, D. J., & Dadds, M. R. (2006). Assessing parenting practices through parent-report and direct observation during parent-training. Journal of Child and Family Studies, 15(5), 554–567. https://doi.org/10.1007/s10826-006-9029.

    Article  Google Scholar 

  • Hutchings, J., Griffith, N., Bywater, T., & Williams, M. (2017). Evaluating the Incredible Years Toddler Parenting Programme with parents of toddlers in disadvantaged (Flying Start) areas of Wales. Child: Care, Health and Development, 43, 104–113. https://doi.org/10.1111/cch/12415.

    Article  Google Scholar 

  • Hutchings, J., Bywater, T., Daley, D., Gardner, F., Whitaker, C., Jones, K., Eames, C., & Edwards, R. T. (2007). Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trial. British Medical Journal, 334, 678–684. https://doi.org/10.1136/bmj/j.39126.620799.55.

    Article  PubMed  Google Scholar 

  • Huttenlocher, J., Waterfall, H., Vasilyeva, M., Vevea, J., & Hedges, L. V. (2010). Sources of variability in children’s language growth. Cognitive Psychology, 61(4), 343–365. https://doi.org/10.1016/j.cogpsych.2010.08.002.

    Article  PubMed  PubMed Central  Google Scholar 

  • Johnson, S. M., & Bolstad, O. D. (1975). Reactivity to home observation: a comparison of audio recorded behaviour with observers present or absent. Journal of Applied Behaviour Analysis, 8, 181–185. https://doi.org/10.1901/jaba.1975.8-181.

    Article  Google Scholar 

  • Jones, K., Daley, D., Hutchings, J., Bywater, T., & Eames, C. (2007). Efficacy of the Incredible Years Programme as an early intervention for children with conduct problems and ADHD: long-term follow up. Child Care Health and Development, 33(6), 749–756. https://doi.org/10.1111/j.1365-2214.2008.00817.x.

    Article  Google Scholar 

  • Kent, R. N., O’Leary, D., Dietz, A., & Diament, C. (1979). Comparison of observational recordings in vivo, via mirror, and via television. Journal of Applied Behaviour Analysis, 12, 517–522. https://doi.org/10.1901/jaba.1979.12-517.

    Article  Google Scholar 

  • Leadsom, A., Field, F., Burstow, P., & Lucas, C. (2013). The 1001 critical days: The importance of the conception to age two period. London: A Cross Party Manifesto. https://www.1001criticaldays.co.uk/sites/default/files/1001%20days_oct16_1st.pdf.

    Google Scholar 

  • McGilloway, S., NiMhaille, G., Bywater, T., Leckey, Y., Kelly, P., Furlong, M., Comiskey, C., O’Neill, D., & Donnelly, M. (2014). Reducing child conduct disordered behaviour and improving parent mental health in disadvantaged families: a 12-month follow up and cost analysis of a parenting intervention. European Child and Adolescent Psychiatry, 23, 783–794. https://doi.org/10.1007/s00787-013-0499-2.

    Article  PubMed  Google Scholar 

  • Melhuish, E., Quinn, L., Sylva, K., Sammons, P., Siraj-Blatchford, I., & Taggart, B. (2012). Preschool affects longer term literacy and numeracy: results from a general population longitudinal study in Northern Ireland. School Effectiveness and School Improvement, 24, 234–250. https://doi.org/10.1080/09243453.2012.749796.

    Article  Google Scholar 

  • Middel, B., & van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care, 2, 1–21. https://doi.org/10.5334/ijic.65.

    Article  Google Scholar 

  • Moore, L. F., & Lee, A. J. (1974). Comparability of interviewer, group and individual interview ratings. Journal of Applied Psychology, 59, 163–167. https://doi.org/10.1037/h0036518.

    Article  Google Scholar 

  • Page, P. (2014). Beyond statistical significance: clinical interpretation of rehabilitation research literature. International Journal of Sports Physical Therapy, 9, 726–736. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4197528/.

    PubMed  PubMed Central  Google Scholar 

  • Reid, M. J., Webster-Stratton, C., & Beauchaine, T. P. (2001). Parent training in head start: a comparison of program response among African American, Asian American, Caucasian, and Hispanic mothers. Prevention Science, 2, 209–227. https://doi.org/10.1023/A:1013618309070.

    Article  PubMed  Google Scholar 

  • Robinson, E. A. & Eyberg, S. M. (1981). The dyadic parent-child interaction coding system: standardization and validation. Journal of Consulting and Clinical Psychology, 49, 245–250. https://doi.org/0022-006x/81/4902-0245.

    Article  Google Scholar 

  • Rosenstein, B. (2002). Video use in social science research and program evaluation. International Journal of Qualitative Methods, 1(3), 1–38. http://www.ualberta.ca/~iiqm/backissues/1_3Final/html/rosenstein.html.

    Article  Google Scholar 

  • Ryan, A. M., Daum, D., Bauman, T., Grisez, M., Mattimore, K., Nalodka, T. & McCormick, S. (1995). Direct, indirect, and controlled observation and rating accuracy. Journal of Applied Psychology, 80, 664–670. https://doi.org/0021-9010/95.

    Article  Google Scholar 

  • Scott, S., Knapp, M., Henderson, J., & Maugham, B. (2001). Financial cost of social exclusion: follow up study of antisocial children into adulthood. British Medical Journal, 323, 1–5. https://doi.org/10.1136/bmj.323.7306.191.

    Article  Google Scholar 

  • Scott, S., Doolan, M., Beckett, C., Harry, S., Cartwright, S., & The HCA team. (2014). How is parenting style related to child anti-social behaviour? Preliminary findings from the Helping Children Achieve study. Research Report DFE-RR185a. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/197732/DFE-RR185a.pdf.

  • Seabra-Santos, M. J., Gaspar, M. F., Azevedo, A. F., Homem, T. C., Guerra, J., Martins, V., & Leitao, S. (2016). Incredible Years parent training: what changes, for whom, how, from how long? Journal of Applied Developmental Psychology, 44, 93–104. https://doi.org/10.1016/j.appdev.2016.04.004.

    Article  Google Scholar 

  • Shrum, W., Duque, R., & Brown, T. (2005). Digital video as research practice: Methodology for the Millennium. Journal of Research Practice, 1, 1–19. http://jrp.icaap.org/index.php/jrp/article/view/6/12.

    Google Scholar 

  • Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: a comparison of child and parent training interventions. Journal of Consulting and Clinical Psychology, 65, 93–109. https://doi.org/10.1037/0022-006x.65.1.93.

    Article  PubMed  Google Scholar 

  • Wysocki, T. (2015). Introduction to the special issue: direct observation in pediatric psychology research. Journal of Pediatric Psychology, 40, 1–7. https://doi.org/10.1093/jpepsy/jsu104.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This study was conducted as part of a self-funded Masters and a fully funded PhD (2/3 School of Psychology, Bangor University; 1/3 Children’s Early Intervention Trust Charity). We would like to acknowledge Dr’s Karen Jones, Nia Griffith, Catrin Eames, Pamela Martin-Forbes, Kirsty Pye and Joanna Charles for conducting the live observation visits. Finally, we would like to thank the parents and children who took part in the randomised controlled trial from which this data was drawn, for their commitment to the project and for providing us with this data.

Author Contributions

N. G. designed and executed the study, conducted data analyses, and wrote the paper. T. B. collaborated with the design and writing of the study, and editing the final manuscript. J. H. collaborated with the design and writing of the study, and editing the final manuscript.

Author information

Authors and Affiliations

  1. Department of Health Sciences, University of York, York, YO10 5DD, UK

    Nicole Gridley & Tracey Jane Bywater

  2. Centre for Evidence Based Early Intervention, Bangor University, Bangor, UK

    Judy Mary Hutchings

Authors
  1. Nicole Gridley
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tracey Jane Bywater
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Judy Mary Hutchings
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nicole Gridley.

Ethics declarations

Conflict of Interest

The authos declare that they have no conflict of interest.

Ethical Approval

Ethical approval for the current study was provided by Bangor University, Wales, UK.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gridley, N., Bywater, T.J. & Hutchings, J.M. Comparing Live and Video Observation to Assess Early Parent-child Interactions in the Home. J Child Fam Stud 27, 1818–1829 (2018). https://doi.org/10.1007/s10826-018-1039-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-018-1039-y

Keywords

Search

Navigation