To accurately assess children’s emotional and behavioral distress via self-report, we must design instruments that are meaningful to them. This study was an essential first step in co-designing digitally animated assessment items for a new self-reported screening instrument for children: The Interactive Child Distress Screener (ICDS). Twenty children aged five to 11 years participated in semi-structured small group interviews to discuss 15 pairs of contrasting emotional and behavioral constructs (EBC’s). Interview questions were designed to determine how children comprehend, express, and recognize these EBC’s and were correlated to the following five categories to aid the development of the animated items: lexical understanding, visual expression, narrative settings, behavioral actions, and audio cues. Data were analyzed by cataloguing common responses for each EBC across the five categories and examining whether age-specific response typologies were apparent. Except for lexical labeling abilities, results indicated a distinct lack of age-related differences in children’s comprehension of physical and expressive displays of EBC’s between age group levels. This highlights the importance of audio-visual depictions of EBC’s over written text. Typology tables for each of the construct pairs were produced describing corresponding visual demonstrations, narrative contexts, behavioral actions, and audio cues shared by all children. These typologies provide insight into the child’s perspective of socio-emotional and behavioral archetypes and were utilized to inform the development of animated items for a novel screening tool. This study utilized co-design methodologies and produced datasets that may inform the development of mental health tools, interventions, or activities for children concerning emotional and behavioral concepts.
Audiovisual depictions of emotions and behaviours are promising assessment items for collecting child reported data.
Narrative contexts and visually expressive movements enhance children’s understanding of emotions and behaviours.
Age differences in verbal labeling ability does not constrain emotion understanding when multisensory data is integrated.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Price includes VAT (USA)
Tax calculation will be finalised during checkout.
Achenbach, T. M., McConaughy, S. H., Ivanova, M. Y., & Rescorla, L. A. (2011). Manual for the ASEBA Brief Problem Monitor (BPM). In Technical Manual. USA: Research Center for Children Youth and Families, University of Vermont.
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms and Profiles. University of Vermont Research Center for Children, Youth, and Families.
Agar, M., MacDonald, J., Basch, C. E., Bertrand, J. T., Brown, J. E., Ward, V. M., Bogardus, E. S., Charlesworth, M. K., Rodwell, M. K., Clark, C. D., Clark, L., Marsh, G. W., Davis, M., Igoe, J., Stember, M., Doswell, G., Vandestienne, G., Elliott, R., Fischer, C. T., Wight, D. (2005). Exploring children’s views through focus groups. In S. Greene & D. Hogan (Eds.), Researching children’s experience (pp. 237–252). SAGE Publications Ltd. https://doi.org/10.4135/9781849209823.n13.
American Academy of Pediatrics Task Force on Mental Health. (2010). Enhancing pediatric mental health care: Mental health screening and assessment tools for primary care. Pediatrics, 125(suppl), S173–S192. https://doi.org/10.1542/peds.2010-0788R.
Apple Inc. (2018). Voice Memos [Mobile application software].
Australian Bureau of Statistics. (2016). Census of population and housing: socio-economic indexes for areas (SEIFA), Australia, 2016. https://www.abs.gov.au/ausstats/abs@.nsf/Lookup/by%20Subject/2033.0.55.001~2016~Main%20Features~SEIFA%20Basics~5.
Baca, C. B., Vickrey, B. G., Hays, R. D., Vassar, S. D., & Berg, A. T. (2010). Differences in child versus parent reports of the child’s health-related quality of life in children with epilepsy and healthy siblings. Value in Health, 13(6), 778–786. https://doi.org/10.1111/j.1524-4733.2010.00732.x.
Bagner, D. M., Rodríguez, G. M., Blake, C. A., Linares, D., & Carter, A. S. (2012). Assessment of behavioral and emotional problems in infancy: A systematic review. Clinical Child and Family Psychology Review, 15(2), 113–128. https://doi.org/10.1007/s10567-012-0110-2.
Barrett, L. F., Mesquita, B., & Gendron, M. (2011). Context in emotion perception. Current Directions in Psychological Science, 20(5), 286–290. https://doi.org/10.1177/0963721411422522.
Barrett, L. F., & Satpute, A. B. (2019). Historical pitfalls and new directions in the neuroscience of emotion. Neuroscience Letters, 693, 9–18. https://doi.org/10.1016/j.neulet.2017.07.045.
Boeije, H. (2002). A purposeful approach to the constant comparative method in the analysis of qualitative interviews. Quality and Quantity, 36(4), 391–409. https://doi.org/10.1023/A:1020909529486.
Bowen, N. K. (2008). Cognitive testing and the validity of child-report data from the Elementary School Success Profile. Social Work Research, 32(1), 18–28. https://doi.org/10.1093/swr/32.1.18.
Briggs-Gowan, M. J., Carter, A. S., Bosson-Heenan, J., Guyer, A. E., & Horwitz, S. M. (2006). Are infant-toddler social-emotional and behavioral problems transient? Journal of the American Academy of Child and Adolescent Psychiatry, 45(7), 849–858. https://doi.org/10.1097/01.chi.0000220849.48650.59.
Butler-Kisber, L. (2018). Constant comparison inquiry. In Qualitative inquiry (pp. 41-59). SAGE Publications Ltd, https://doi.org/10.4135/9781526417978.
Carter, B., & Ford, K. (2013). Researching children’s health experiences: The place for participatory, child-centered, arts-based approaches. Research in Nursing and Health, 36(1), 95–107. https://doi.org/10.1002/nur.21517.
Childs, J., Deighton, J., & Wolpert, M. (2012). Defining and measuring mental health and wellbeing in children. A response mode report requested by the Department of Health for the Policy Research Unit in the Health of Children, Young People and Families. https://www.ucl.ac.uk/evidence-based-practice-unit/publications-and-resources/project-reports.
Choudhury, M. S., Pimental, S. S., & Kendall, P. C. (2003). Childhood anxiety disorders: Parent-Child (dis) agreement using a structured interview for the DSM-IV. Journal of the American Academy of Child & Adolescent Psychiatry, 42(8), 957–964. https://doi.org/10.1097/01.CHI.0000046898.27264.A2.
Darling-Churchill, K. E., & Lippman, L. (2016). Early childhood social and emotional development: Advancing the field of measurement. Journal of Applied Developmental Psychology, 45, 1–7. https://doi.org/10.1016/j.appdev.2016.02.002.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. https://doi.org/10.1037/a0038498.
Deighton, J., Croudace, T., Fonagy, P., Brown, J., Patalay, P., & Wolpert, M. (2014). Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: A review of child self-report measures. Child and Adolescent Psychiatry and Mental Health, 8(1), 1–14. https://doi.org/10.1186/1753-2000-8-14.
Deighton, J., Tymms, P., Vostanis, P., Belsky, J., Fonagy, P., Brown, A., Martin, A., Patalay, P., & Wolpert, M. (2013). The development of a school-based measure of child mental health. Journal of Psychoeducational Assessment, 31(3), 247–257. https://doi.org/10.1177/0734282912465570.
DeVellis, R. F. (2017). Scale development: theory and applications (D. J. Rog & L. Bickman (Eds.). 4th ed. Los Angeles: SAGE Publications, Inc.
Egger, H. L., & Angold, A. (2006). Common emotional and behavioral disorders in preschool children: Presentation, nosology, and epidemiology. Journal of Child Psychology and Psychiatry and Allied Disciplines, 47(3–4), 313–337. https://doi.org/10.1111/j.1469-7610.2006.01618.x.
Eiser, C., & Morse, R. (2001). Can parents rate their child’s health related quality of life? Results of a systematic review. Quality of Life Research, 10(4), 347–357.
Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3–4), 169–200. https://doi.org/10.1080/02699939208411068.
Ekman, P. (2016). What scientists who study emotion agree about. Perspectives on Psychological Science, 11(1), 31–34. https://doi.org/10.1177/1745691615596992.
Foley, D., Rutter, M., Pickles, A., Angold, A., Maes, H., Silberg, J., & Eaves, L. (2004). Informant disagreement for separation anxiety disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 43(4), 452–460. https://doi.org/10.1097/00004583-200404000-00011.
Gendron, M., & Barrett, L. F. (2018). Emotion perception as conceptual synchrony. Emotion Review, 10(2), 101–110. https://doi.org/10.1177/1754073917705717.
Given, L. M. (2008). The SAGE encyclopedia of qualitative research methods (Vols. 1-0). Thousand Oaks, CA: SAGE Publications, Inc. 10.4135/9781412963909.
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry and Allied Disciplines, 38(5), 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x.
Goodman, R., Meltzer, H., & Bailey, V. (2003). The Strengths and Difficulties Questionnaire: A pilot study on the validity of the self-report version. International Review of Psychiatry, 15(1–2), 173–177. https://doi.org/10.1080/0954026021000046137.
Groundwater-Smith, S., Dockett, S., & Bottrell, D. (2015). Participatory research with children and young people. SAGE Publications Ltd. https://doi.org/10.4135/9781473910751.
Heffer, R. W, Barry, T. D. & Garland, B. H. In: In J. L. Matson, M. L. Matson F. Andrasik, (eds.) 2009). History, overview, and trends in child and adolescent psychological assessment. Assessing childhood psychopathology and developmental disabilities. (pp. 3–29). New York, NY: Springer. https://doi.org/10.1007/978-0-387-09528-8_1.
Herba, C. M., Landau, S., Russell, T., Ecker, C., & Phillips, M. L. (2006). The development of emotion-processing in children: Effects of age, emotion, and intensity. Journal of Child Psychology and Psychiatry and Allied Disciplines, 47(11), 1098–1106. https://doi.org/10.1111/j.1469-7610.2006.01652.x.
Hill, M. (1997). Participatory research with children. Child & Family Social Work, 2(3), 171–183. https://doi.org/10.1046/j.1365-2206.1997.00056.x.
Huitt, W., & Hummel, J. (2003). Piaget’s theory of cognitive development. Educational Pyschology Interactive. Valdosta, GA: Valdosta State University. Retrieved [10.08/21] from https://intranet.newriver.edu/images/stories/library/stennett_psychology_articles/Piagets%20Theory%20of%20Cognitive%20Development.pdf.
Humphrey, N., Kalambouka, A., Wigelsworth, M., Lendrum, A., Deighton, J., & Wolpert, M. (2011). Measures of social and emotional skills for children and young people: A systematic review. Educational and Psychological Measurement, 71(4), 617–637. https://doi.org/10.1177/0013164410382896.
Humphrey, N., & Wigelsworth, M. (2016). Making the case for universal school-based mental health screening. Emotional and Behavioural Difficulties, 21(1), 22–42. https://doi.org/10.1080/13632752.2015.1120051.
Jeffrey, J., Klomhaus, A., Enenbach, M., Lester, P., & Krishna, R. (2020). Self-report rating scales to guide measurement-based care in child and adolescent psychiatry. Child and Adolescent Psychiatric Clinics of North America, 29(4), 601–629. https://doi.org/10.1016/j.chc.2020.06.002.
Jensen, P. S., Rubio-Stipec, M., Canino, G., Bird, H. R., Dulcan, M. K., Schwab-Stone, M. E., & Lahey, B. B. (1999). Parent and child contributions to diagnosis of mental disorder: Are both informants always necessary? Journal of the American Academy of Child & Adolescent Psychiatry, 38(12), 1569–1579. https://doi.org/10.1097/00004583-199912000-00019.
Jensen, S. A., Fabiano, G. A., Lopez-Williams, A., & Chacko, A. (2006). The reading grade level of common measures in child and adolescent clinical psychology. Psychological Assessment, 18(3), 346–352. https://doi.org/10.1037/1040-35126.96.36.1996.
Johnson, S. E., Lawrence, D., Hafekost, J., Saw, S., Buckingham, W. J., Sawyer, M., Ainley, J., & Zubrick, S. R. (2016). Service use by Australian children for emotional and behavioural problems: Findings from the second Australian child and adolescent survey of mental health and wellbeing. Australian & New Zealand Journal of Psychiatry, 50(9), 887–898. https://doi.org/10.1177/0004867415622562.
Jones, D., Dodge, K. A., Foster, E. M., Nix, R., Bierman, K. L., Coie, J. D., Greenberg, M., Lochman, J. E., McMahon, R. J., & Pinderhughes, E. E. (2002). Early identification of children at risk for costly mental health service use. Prevention Science, 3(4), 247–256. https://doi.org/10.1023/A:1020896607298.
Kayyal, M., Widen, S., & Russell, J. A. (2015). Context is more powerful than we think: Contextual cues override facial cues even for valence. Emotion, 15(3), 287–291. https://doi.org/10.1037/emo0000032.
Kessler, R. C., Angermeyer, M., Anthony, J. C., De Graaf, R., Demyttenaere, K., Gasquet, I., De Girolamo, G., Gluzman, S., Gureje, O., Haro, J. M., Kawakami, N., Karam, A., Levinson, D., Medina Mora, M. E., Oakley Browne, M. A., Posada-Villa, J., Stein, D. J., Adley Tsang, C. H., Aguilar-Gaxiola, S., & Ustün, T. B. (2007). Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 6(3), 168–176.
Kim-Cohen, J., Arseneault, L., Newcombe, R., Adams, F., Bolton, H., Cant, L., Delgado, K., Freeman, J., Golaszewski, A., Kelesidi, K., Matthews, C., Mountain, N., Oxley, D., Watson, S., Werts, H., Caspi, A., & Moffitt, T. E. (2009). Five-year predictive validity of DSM-IV conduct disorder research diagnosis in 4 1/2-5-year-old children. European Child and Adolescent Psychiatry, 18(5), 284–291. https://doi.org/10.1007/s00787-008-0729-1.
Lagattuta, K. H., Sayfan, L., & Bamford, C. (2012). Do you know how I feel? Parents underestimate worry and overestimate optimism compared to child self-report. Journal of Experimental Child Psychology, 113(2), 211–232. https://doi.org/10.1016/j.jecp.2012.04.001.
March, S., Day, J., Zieschank, K., & Ireland, M. (2018). The interactive child distress screener: Development and preliminary feasibility testing. JMIR MHealth and UHealth, 6(4), e90 https://doi.org/10.2196/mhealth.9456.
McCrae, J. S., & Brown, S. M. (2018). Systematic review of social–emotional screening instruments for young children in child welfare. Research on Social Work Practice, 28(7), 767–788. https://doi.org/10.1177/1049731516686691.
Moffa, K., Wagle, R., Dowdy, E., Palikara, O., Castro, S., Dougherty, D., & Furlong, M. J. (2019). The me and my school questionnaire: Examining the cross-cultural validity of a children’s self-report mental health measure. International Journal of School and Educational Psychology, 1–11. https://doi.org/10.1080/21683603.2019.1650858.
Newman, L. (2012). Getting in early: Identification of risk in early childhood. Australian and New Zealand Journal of Psychiatry, 46(8), 697–699. https://doi.org/10.1177/0004867412454341.
Niditch, L. A., & Varela, R. E. (2011). Mother-child disagreement in reports of child anxiety: Effects of child age and maternal anxiety. Journal of Anxiety Disorders, 25(3), 450–455. https://doi.org/10.1016/j.janxdis.2010.11.009.
Olson, J. D., McAllister, C., Grinnell, L. D., Walters, K. G., & Appunn, F. (2016). Applying constant comparative method with multiple investigators and inter-coder reliability. Qualitative Report, 21(1), 26–42.
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). SAGE Publications, Inc.
Prisma Labs Inc. (2019). Prisma Photo Editor [Mobile application software].
Rescorla, L. A. (2009). Rating scale systems for assessing psychopathology: The achenbach system of empirically based assessment (ASEBA) and the behavior assessment system for children-2 (BASC-2). Assessing Childhood Psychopathology and Developmental Disabilities (pp. 117–149). New York, NY: Springer. https://doi.org/10.1007/978-0-387-09528-8_5.
Ritchie, J., Lewis, J., McNaughton Nicholls, C., & Ormston, R. (2014). Qualitative research practice: A guide for social science students and researchers (2nd ed.). SAGE Publications.
Rodger, H., Lao, J., & Caldara, R. (2018). Quantifying facial expression signal and intensity use during development. Journal of Experimental Child Psychology, 174, 41–59. https://doi.org/10.1016/j.jecp.2018.05.005.
Schreuder, E., van Erp, J., Toet, A., & Kallen, V. L. (2016). Emotional responses to multisensory environmental stimuli: A conceptual framework and literature review. SAGE Open, 6(1), 1–19. https://doi.org/10.1177/2158244016630591.
Smart, D. (2011). How young children are faring: Behaviour problems and competencies. In B. Maguire (Ed.), Annual statistical report 2010 (pp. 91–106). Australian Insitute of Family Studies.
Stiffler, M. C., & Dever, B. V. (2015). Mental health screening at school. Springer International Publishing. https://doi.org/10.1007/978-3-319-19171-3.
Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8,591 children across age subgroups with the PedsQLTM 4.0 Generic Core Scales. Health and Quality of Life Outcomes, 5, 1–13. https://doi.org/10.1186/1477-7525-5-1.
Vaz, S., Cordier, R., Boyes, M., Parsons, R., Joosten, A., Ciccarelli, M., Falkmer, M., & Falkmer, T. (2016). Is using the strengths and difficulties questionnaire in a community sample the optimal way to assess mental health functioning? PLOS ONE, 11(1), e0144039 https://doi.org/10.1371/journal.pone.0144039.
Widen, S. C. (2013). Children’s interpretation of facial expressions: The long path from valence-based to specific discrete categories. Emotion Review, 5(1), 72–77. https://doi.org/10.1177/1754073912451492.
Widen, S. C., Pochedly, J. T., & Russell, J. A. (2015). The development of emotion concepts: A story superiority effect in older children and adolescents. Journal of Experimental Child Psychology, 131, 186–192. https://doi.org/10.1016/j.jecp.2014.10.009.
Widen, S. C., & Russell, J. A. (2008). Children acquire emotion categories gradually. Cognitive Development, 23(2), 291–312. https://doi.org/10.1016/j.cogdev.2008.01.002.
Widen, S. C., & Russell, J. A. (2010). Children’s scripts for social emotions: Causes and consequences are more central than are facial expressions. British Journal of Developmental Psychology, 28(3), 565–581. https://doi.org/10.1348/026151009X457550d.
Widen, S. C., & Russell, J. A. (2015). Do dynamic facial expressions convey emotions to children better than do static ones? Journal of Cognition and Development, 16(5), 802–811. https://doi.org/10.1080/15248372.2014.916295.
Woolley, M. E., Bowen, G. L., & Bowen, N. K. (2004). Cognitive pretesting and the developmental validity of child self-report instruments: Theory and applications. Research on Social Work Practice, 14(3), 191–200. https://doi.org/10.1177/1049731503257882.
This research was supported by an Australian Commonwealth Government Research Training Scheme scholarship.
Conflict of Interest
The authors declare no competing interests.
Consent to Publish
Additional assent was obtained from all child participants and written, informed consent from participants parents/legal guardians to publish images in Figures 1 through 15 included in Supplementary material.
“All procedures performed in studies involving human participants were in accordance with the ethical standards of the University of Southern Queensland Human Research Ethics Committee H16REA003 and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards”.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zieschank, K.L., Machin, T., Day, J. et al. Children’s Perspectives on Emotions Informing a Child-Reported Screening Instrument. J Child Fam Stud 30, 3105–3120 (2021). https://doi.org/10.1007/s10826-021-02086-z
- Child perspective
- Screening instruments