Skip to main content

Non-verbal Behavior and Its Role in Narrative Production

  • Chapter
  • First Online:
Language, Music and Gesture: Informational Crossroads

Abstract

Mastering the skills of the interpretation of non-verbal behavior takes up all childhood. The factors that influence the explicit representation of characters’ non-verbal behavior in narratives were determined based on the analysis of unprepared oral stories by 125 Russian-native monolingual children aged from 4 years 7 months to 7 years 6 months and a control group of 19 Russian-native adults. These factors are the meaning of non-verbal acts, their importance for the plot progress and their dependence on the presence or absence of speech context. When representing a non-verbal act within the framework of an unprepared retelling, Russian speakers use any of the following strategies: describing the non-verbal act, interpreting it, identifying a situation that it can correspond to, or reproducing a possible speech context. Failure to perceive a non-verbal act results in either omitting or misinterpreting it. With the development of communication skills, the number of such failures clearly decreases. Russian-speaking preschool children recognize non-verbal behavior presented without a speech context, but tend to better interpret the episodes that are significant for the plot progress and, thus, perform a connecting function. In contrast to the narrative significant non-verbal acts, communicative non-verbal acts require a speech context and were less frequently present in the analyzed narratives, especially in the ones produced by younger children.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bates, E., Dick, F.: Language, gesture, and the developing brain. Dev. Psychobiol. 40, 293–310 (2002). https://doi.org/10.1002/dev.10034.

  2. Capone, N, Mcgregor, K.: Gesture Development: A Review for Clinical and Research Practices. Journal of speech, language, and hearing research: JSLHR. 47, 173–86 (2004). https://doi.org/10.1044/1092-4388(2004/015).

    Article  Google Scholar 

  3. Hostetter, A.: When Do Gestures Communicate? A Meta-Analysis. Psychological Bulletin 137, 297–315 (2011). https://doi.org/10.1037/a0022128.

    Article  Google Scholar 

  4. Colegrove, V., Havighurst, S.: Review of Nonverbal Communication in Parent–Child Relationships: Assessment and Intervention. Journal of Child and Family Studies. 26, (2017). https://doi.org/10.1007/s10826-016-0563-x.

  5. Goldin‐Meadow, S.: Nonverbal communication: The hand’s role in talking and thinking. In Damon W., Lerner R.M., Kuhn D., Siegler R. (eds.) Handbook of child psychology, 2, 336-372 (2007). https://doi.org/10.1002/9780470147658.chpsy0208.

  6. Gullberg, M., de Bot, K., Volterra, V.: Gestures and some key issues in the study of language development. Gesture. 8, 149–179 (2008). https://doi.org/10.1075/gest.8.2.03gul.

    Article  Google Scholar 

  7. Wakefield, E. M., Goldin-Meadow, S.: Harnessing Our Hands to Teach Mathematics In Dunlosky, J., Rawson, K. A. (Eds.), The Cambridge Handbook of Cognition and Education, New York: Cambridge University Press, 209–233 (2019). 

    Google Scholar 

  8. Nowicki, S., Duke, M.P.: The association of children’s nonverbal decoding abilities with their popularity, locus of control, and academic achievement. The Journal of Genetic Psychology, 153, 385–394 (1992).

    Article  Google Scholar 

  9. Carton, J.S., Kessler, E.A., Pape, C.L.: Nonverbal Decoding Skills and Relationship Well-Being in Adults. Journal of Nonverbal Behavior 23, 91–100 (1999). https://doi.org/10.1023/A:1021339410262.

    Article  Google Scholar 

  10. Stagg, S. D., Slavny, R., Hand, C., Cardoso, A., Smith, P.: Does facial expressivity count? How typically developing children respond initially to children with autism. Autism, 18(6), 704–711 (2014).

    Google Scholar 

  11. Nowicki, S., Bliwise, N, Joinson, C.: The Association of Children’s Locus of Control Orientation and Emotion Recognition Abilities at 8 Years of Age and Teachers’ Ratings of Their Personal and Social Difficulties at 10 Years. Journal of Nonverbal Behavior, 43(3), 381–396 (2019). https://doi.org/10.1007/s10919-019-00304-3.

    Article  Google Scholar 

  12. Boone, R. T., Cunningham, J.: Children’s Decoding of Emotion in Expressive Body Movement: The Development of Cue Attunement. Developmental psychology. 34. 1007–1016 (1998). https://doi.org/10.1037/0012-1649.34.5.1007.

    Article  Google Scholar 

  13. Barrett, L. F., Adolphs, R., Martinez, A., Marsella, S., Pollak, S.: Emotional expressions reconsidered: Challenges to inferring emotion in human facial movements. Psychological Science in the Public Interest, 20, 1–68 (2019).

    Article  Google Scholar 

  14. Witkower Z., Tracy J.L.: Bodily Communication of Emotion: Evidence for Extrafacial Behavioral Expressions and Available Coding Systems. Emotion Review, 11 (2): 184–193 (2019). https://doi.org/10.1177/1754073917749880.

    Article  Google Scholar 

  15. Krauss, R. M., Chen, Y., Chawla, P.: Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us? In M. Zanna (Ed.), Advances in experimental social psychology, Tampa: Academic Press, 389–450 (1996).

    Google Scholar 

  16. Lyons, J.: Semantics. Cambridge: Cambridge University Press (1977). https://doi.org/10.1017/cbo9780511620614

  17. Abner, N., Cooperrider, K., Goldin‐Meadow, S.: Gesture for Linguists: A Handy Primer. Language and Linguistics Compass, 9, 437– 449 (2015). https://doi.org/10.1111/lnc3.12168.

  18. Colletta, J. -M., Guidetti, M., Capirci, O., Cristilli, C., Demir, O. E., Kunene-Nicolas, R. N., et al.: Effects of age and language on co-speech gesture production: an investigation of French, American, and Italian children’s narratives. J. Child Lang. 42, 122–145 (2014). https://doi.org/10.1017/s0305000913000585.

    Article  Google Scholar 

  19. Parrill, F., Sweetser, E.: What We Mean by Meaning: Conceptual Integration in Gesture Analysis and Transcription. Gesture. 4, 197–219 (2004). https://doi.org/10.1075/gest.4.2.05par.

    Article  Google Scholar 

  20. Żywiczyński, P., Wacewicz, S., Sibierska, M.: Defining Pantomime for Language Evolution Research. Topoi. 37 (2), 307–318 (2018). https://doi.org/10.1007/s11245-016-9425-9.

    Article  Google Scholar 

  21. Lewis V., Boucher J., Lupton L., Watson S.: Relationships between symbolic play, functional play, verbal and non-verbal ability in young children. International Journal of Language & Communication Disorders, 35:1, 117–127 (2000). doi: https://doi.org/10.1080/136828200247287

  22. Suddendorf T., Fletcher-Flinn C., Johnston L.: Pantomime and Theory of Mind. The Journal of Genetic Psychology, 160:1, 31–45 (1999) https://doi.org/10.1080/00221329909595378.

  23. Kendon, A.: Language and gesture: Unity or duality? In D. McNeill (Ed.), Language and Gesture (Language Culture and Cognition), Cambridge: Cambridge University Press, 47–63 (2000). https://doi.org/10.1017/cbo9780511620850.004.

  24. Cienki, A.: Gestures and grammatical constructions. In T. V. Romanova (Ed.), Integrative Processes In Cognitive Linguistics: Papers of International Congresson Cognitive LinguisticsMay, 16–18 (Cognitive studies of language; Vol. 37). DEKOM Publishing House, 120–125 (2019).

    Google Scholar 

  25. Kelly, S. D., Barr, D. J., Church, R. B., Lynch, K.: Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577–592 (1999).

    Article  Google Scholar 

  26. Lundqvist, D., Öhman, A.: Caught by the Evil Eye: Nonconscious Information Processing, Emotion, and Attention to Facial Stimuli. In L. F. Barrett, P. M. Niedenthal, P. Winkielman (Eds.), Emotion and consciousness, The Guilford Press, 97–122 (2005).

    Google Scholar 

  27. Poggi, I., Pelachaud, C.: Performative facial expressions in animated faces. In:  Cassell J., Sullivan J., Prevost S., Churchill E.F. (eds.) Embodied conversational agents, 155–189 (2000).

    Google Scholar 

  28. Adornetti I, Ferretti F, Chiera A, Wacewicz S, Żywiczyński P, Deriu V, Marini A, Magni R, Casula L, Vicari S., Valeri G.: Do Children with Autism Spectrum Disorders Understand Pantomimic Events? Front. Psychol. 10:1382 (2019). https://doi.org/10.3389/fpsyg.2019.01382.

    Article  Google Scholar 

  29. Marentette P, Furman R, Suvanto ME, Nicoladis E.: Pantomime (Not Silent Gesture) in Multimodal Communication: Evidence from Children’s Narratives. Front. Psychol. 11:575952 (2020). https://doi.org/10.3389/fpsyg.2020.575952.

    Article  Google Scholar 

  30. McNeill, D.: Gesture-Speech Unity—What it is, where it came from. In: Breckinridge Church R., Alibali M. W., Kelly S. D. (eds.) Why gesture? How the hands function in speaking, thinking and communicating, John Benjamins, 77–101 (2017).

    Google Scholar 

  31. Buck R., VanLear C. A.: Verbal and Nonverbal Communication: Distinguishing Symbolic, Spontaneous, and Pseudo-Spontaneous Nonverbal Behavior, Journal of Communication, 52:3,  522–541 (2002). https://doi.org/10.1111/j.1460-2466.2002.tb02560.x.

    Article  Google Scholar 

  32. Holler, J., Wilkin, K.: Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task. Language and cognitive processes, 24(2), 267–289 (2009).

    Article  Google Scholar 

  33. Macoun, A., Sweller, N.: Listening and watching: The effects of observing gesture on preschoolers’ narrative comprehension. Cognitive Development, 40, 68–81 (2016).

    Article  Google Scholar 

  34. Tomasello, M.: The usage-based theory of language acquisition. In E. Bavin (Ed.), Handbook of Child Language, Cambridge U. Press, 89–106 (2009).

    Google Scholar 

  35. Byrne, R.W., Cochet, H.: Where have all the (ape) gestures gone? Psychon Bull Rev 24, 68–71 (2017). https://doi.org/10.3758/s13423-016-1071-0.

    Article  Google Scholar 

  36. Dargue, N., Sweller, N.: Donald Duck’s garden: the effects of observing iconic reinforcing and contradictory gestures on narrative comprehension. Journal of experimental child psychology, 175, 96–107 (2018).

    Article  Google Scholar 

  37. Colletta, J.-M.: Comparative analysis of children’s narratives at different ages: A multimodal approach. Gesture. 9, 61–96 (2009). https://doi.org/10.1075/gest.9.1.03col.

    Article  Google Scholar 

  38. O’Reilly, A. W.: Using representations: Comprehension and production of actions with imagined objects. Child development, 66(4), 999–1010 (1995).

    Article  Google Scholar 

  39. Varney, N. R., Sivan, A. B.: Pantomime recognition in normal and dyslexic children. Developmental neuropsychology, 1(1), 49–52 (1985).

    Article  Google Scholar 

  40. McNeill, D.: Introduction. In D. McNeill (Ed.), Language and Gesture (Language Culture and Cognition), Cambridge: Cambridge University Press, 1–10 (2000). https://doi.org/10.1017/cbo9780511620850.001.

  41. Eismont P.: Semantika i sintaksis spontannogo narrativa [Semantics and Syntax of Spontaneous Narrative] (in Russian). PhD Thesis, St Petersburg University, manuscript (2008).

    Google Scholar 

  42. Egan, G. J., Brown, R. T., Goonan, L., Goonan, B. T., Celano, M.: The development of decoding of emotions in children with externalizing behavioral disturbances and their normally developing peers. Archives of Clinical Neuropsychology, 13(4), 383–396 (1998).

    Article  Google Scholar 

  43. Novack, M. A., Wakefield, E. M., Goldin-Meadow, S.: What makes a movement a gesture? Cognition, 146, 339–348 (2016).

    Article  Google Scholar 

  44. Colletta, J. -M., Pellenq, C., Guidetti, M.: Age-related changes in co-speech gesture and narrative: evidence from French children and adults. Speech Comm. 52, 565–576 (2010). https://doi.org/10.1016/j.specom.2010.02.009.

    Article  Google Scholar 

  45. Okada, S., Bono, M., Takanashi, K., Sumi, Y., Nitta, K.: Context-based conversational hand gesture classification in narrative interaction. In Proceedings of the 15th ACM on International conference on multimodal interaction, 303–310 (2013).

    Google Scholar 

  46. Tsiourti, C., Weiss, A., Wac, K., Vincze, M.: Designing emotionally expressive robots: a comparative study on the perception of communication modalities. In Proceedings of the 5th international conference on human agent interaction, 213–222 (2017).

    Google Scholar 

  47. Loveland, K. A., Fletcher, J. M., Bailey, V.: Verbal and nonverbal communication of events in learning-disability subtypes. Journal of Clinical and Experimental Neuropsychology, 12(4), 433–447 (1990).

    Article  Google Scholar 

  48. Mccabe, A., Rollins, P.: Assessment of Preschool Narrative Skills. American Journal of Speech-Language Pathology. 3. 45–56 (1994). https://doi.org/10.1044/1058-0360.0301.45.

    Article  Google Scholar 

  49. McNeil, N. M., Alibali, M. W., Evans, J. L.: The role of gesture in children’s comprehension of spoken language: Now they need it, now they don’t. Journal of Nonverbal Behavior, 24(2), 131–150 (2000).

    Article  Google Scholar 

  50. Cienki, A.: Insights for linguistics and gesture studies from film studies: A view from researching cinematic metaphor. In S. Greifenstein, D. Horst, T. Scherer, C. Schmitt, H. Kappelhoff, & C. Müller (Eds.), Cinematic Metaphor in Perspective: Reflections on a Transdisciplinary Framework (Cinepoetics – English edition; Vol. 5). De Gruyter, 53–68 (2018). https://doi.org/10.1515/9783110615036-004.

  51. Eismont P.: Formirovanie ponimanija fazovoj struktury dejstvija v detskoy rechi [Developing the phase structure understanding in child language] (in Russian). Acta Linguistica Petropolitana, 3, 345–366 (2019).

    Google Scholar 

  52. Schachner, A., Carey, S.: Reasoning about ‘irrational’actions: When intentional movements cannot be explained, the movements themselves are seen as the goal. Cognition, 129(2), 309–327 (2013).

    Article  Google Scholar 

  53. Kruszewska, A., Bernatova, R., Petrasova, A., Kocot, A.: Children’s ability to decode mimic and pantomimic expressions, in other words: what do the children know about emotions?. In INTED 2019 Conference Proceedings, 13th International Technology, Education and Development Conference, IATED Academy, 450–459 (2019).

    Google Scholar 

Download references

Acknowledgements

The work is supported by the research grant number 20-012-00290 from the Russian Foundation for Basic Research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Polina Eismont .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Eismont, P. (2021). Non-verbal Behavior and Its Role in Narrative Production. In: Chernigovskaya, T., Eismont, P., Petrova, T. (eds) Language, Music and Gesture: Informational Crossroads. Springer, Singapore. https://doi.org/10.1007/978-981-16-3742-1_8

Download citation

Publish with us

Policies and ethics