Skip to main content

Advertisement

Log in

Differences in functional brain network connectivity during stories presented in audio, illustrated, and animated format in preschool-age children

  • ORIGINAL RESEARCH
  • Published:
Brain Imaging and Behavior Aims and scope Submit manuscript

Abstract

The American Academy of Pediatrics (AAP) recommends that parents begin reading to their children soon after birth, and limits on screen-based media. Benefits of traditional book-sharing are well documented in children, while cited deleterious effects of animated content on narrative processing are controversial. The influence of story format on underlying functional brain networks has not previously been studied. Thirty-three healthy children were recruited for this study via advertisement at an academic medical center, which involved functional magnetic resonance imaging (fMRI) at a single visit. Twenty-seven of them completed fMRI (82%; 15 boys, 12 girls; mean 58 ± 8 months old). The fMRI protocol involved the presentation of 3 similar, unrhymed stories by the same author lasting 5 min each in audio, illustrated, and animated format during separate runs, followed by a test of factual recall. Within- and between-network functional connectivity (FC) was compared across formats involving five functional networks, which were defined via literature review and refined via a data-driven parcellation method: visual perception, visual imagery, language, Default Mode (DMN), and cerebellar association. For illustration relative to audio, FC was decreased within the language network and increased between visual, DMN, and cerebellar networks, suggesting decreased strain on the language network afforded by pictures and visual imagery. Between-network connectivity was decreased for all networks for animation relative to the other formats, particularly illustration, suggesting a bias towards visual perception at the expense of network integration. These findings suggest substantial differences in functional brain network connectivity for animated and more traditional story formats in preschool-age children, reinforcing the appeal of illustrated storybooks at this age to provide efficient scaffolding for language, and suggesting novel neurobiological correlates of how functional networks may contribute to this process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Abbreviations

AAP:

American Academy of Pediatrics

BOLD:

Blood oxygen level–dependent

CB:

Cerebellar network

DMN:

Default Mode Network

FDR:

False discovery rate

FC:

Functional connectivity

fMRI:

Functional magnetic resonance imaging

L:

Language network

MNI:

Montreal Neurologic Institute

SES:

Socioeconomic status

VI:

Visual imagery network

VP:

Visual perception network

References

  • AAP Council on Communications and Media. (2016). Media and young minds. Pediatrics (Vol. 138, p. e20162591). Elk Grove, IL: American Academy of Pediatrics.

    Google Scholar 

  • AAP Council on Early Childhood, High PC and Klass P. (2014). Literacy promotion: An essential component of primary care pediatric practice. Pediatrics, 134(2), 404–409.

    Article  PubMed  Google Scholar 

  • Ardila, A., Bernal, B., & Rosselli, M. (2015). Language and visual perception associations: Meta-analytic connectivity modeling of Brodmann area 37. Behavioural Neurology, 2015, 565871.

    PubMed  PubMed Central  Google Scholar 

  • Bastos, A. M., & Schoffelen, J. M. (2015). A tutorial review of functional connectivity analysis methods and their interpretational pitfalls. Frontiers in Systems Neuroscience, 9, 175.

    PubMed  Google Scholar 

  • Berl, M. M., Duke, E. S., Mayo, J., Rosenberger, L. R., Moore, E. N., VanMeter, J., Ratner, N. B., Vaidya, C. J., & Gaillard, W. D. (2010). Functional anatomy of listening and reading comprehension during development. Brain and Language, 114(2), 115–125.

    Article  PubMed  PubMed Central  Google Scholar 

  • Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009). Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex, 19(12), 2767–2796.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bray, S., Arnold, A. E., Levy, R. M., & Iaria, G. (2015). Spatial and temporal functional connectivity changes between resting and attentive states. Human Brain Mapping, 36(2), 549–565.

    Article  PubMed  Google Scholar 

  • Bridge, H., Harrold, S., Holmes, E. A., Stokes, M., & Kennard, C. (2012). Vivid visual mental imagery in the absence of the primary visual cortex. Journal of Neurology, 259(6), 1062–1070.

    Article  PubMed  Google Scholar 

  • Buckner, R. L. (2013). The cerebellum and cognitive function: 25 years of insight from anatomy and neuroimaging. Neuron, 80(3), 807–815.

    Article  PubMed  CAS  Google Scholar 

  • Bullmore, E., & Sporns, O. (2012). The economy of brain network organization. Nature Reviews. Neuroscience, 13(5), 336–349.

    Article  CAS  PubMed  Google Scholar 

  • Bus, A. G., Takacs, Z. K., & Kegel, A. T. (2015). Affordances and limitations of electronic storybooks for young children's emergent literacy. Developmental Review, 35, 75–97.

    Article  Google Scholar 

  • Calhoun, V. D., Adali, T., McGinty, V. B., Pekar, J. J., Watson, T. D., & Pearlson, G. D. (2001). fMRI activation in a visual-perception task: Network of areas detected using the general linear model and independent components analysis. Neuroimage, 14(5), 1080–1088.

    Article  PubMed  CAS  Google Scholar 

  • Chiong, C., Ree, J., & Takeuchi, L. (2012). Comparing parent-child co-reading on print, basic, and enhanced e-book platforms. New York: The Joan Ganz Cooney Center at Sesame Workshop.

    Google Scholar 

  • Christakis, D. A., Zimmerman, F. J., & Garrison, M. M. (2007). Effect of block play on language acquisition and attention in toddlers: A pilot randomized controlled trial. Archives of Pediatrics & Adolescent Medicine, 161(10), 967–971.

    Article  Google Scholar 

  • Christakis, D. A., Gilkerson, J., Richards, J. A., Zimmerman, F. J., Garrison, M. M., Xu, D., Gray, S., & Yapanel, U. (2009). Audible television and decreased adult words, infant vocalizations, and conversational turns: A population-based study. Archives of Pediatrics & Adolescent Medicine, 163(6), 554–558.

    Article  Google Scholar 

  • Craddock, R. C., G. A. James, P. E. Holtzheimer, 3rd, X. P. Hu and H. S. Mayberg (2012). "A whole brain fMRI atlas generated via spatially constrained spectral clustering." Human Brain Mapping 33(8): 1914–1928.

    Article  PubMed  PubMed Central  Google Scholar 

  • Crain-Thoreson, C., & Dale, P. (1999). Enhancing linguistic performance: Parents and teachers as book reading partners for children with language delays. Topics in Early Childhood Special Education, 19(1), 28–39.

    Article  Google Scholar 

  • Daselaar, S. M., Porat, Y., Huijbers, W., & Pennartz, C. M. (2010). Modality-specific and modality-independent components of the human imagery system. Neuroimage, 52(2), 677–685.

    Article  PubMed  Google Scholar 

  • De Pisapia, N., Bacci, F., Parrott, D., & Melcher, D. (2016). Brain networks for visual creativity: A functional connectivity study of planning a visual artwork. Scientific Reports, 6, 39185.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Dehaene, S., Cohen, L., Morais, J., & Kolinsky, R. (2015). Illiterate to literate: Behavioural and cerebral changes induced by reading acquisition. Nature Reviews. Neuroscience, 16(4), 234–244.

    Article  PubMed  CAS  Google Scholar 

  • Di, X., Gohel, S., Kim, E. H., & Biswal, B. B. (2013). Task vs. rest-different network configurations between the coactivation and the resting-state brain networks. Frontiers in Human Neuroscience, 7, 493.

    PubMed  PubMed Central  Google Scholar 

  • Diedrichsen, J., Balsters, J. H., Flavell, J., Cussans, E., & Ramnani, N. (2009). A probabilistic MR atlas of the human cerebellum. Neuroimage, 46(1), 39–46.

    Article  PubMed  Google Scholar 

  • Fair, D. A., Cohen, A. L., Dosenbach, N. U., Church, J. A., Miezin, F. M., Barch, D. M., Raichle, M. E., Petersen, S. E., & Schlaggar, B. L. (2008). The maturing architecture of the brain's default network. Proceedings of the National Academy of Sciences of the United States of America, 105(10), 4028–4032.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Gambrell, L. B., & Jawitz, P. B. (1993). Mental imagery, text illustrations, and Children's story comprehension and recall. Reading Research Quarterly, 28(3), 264–276.

    Article  Google Scholar 

  • Gambrell, L. B., & Koskinen, P. S. (2002). Imagery: A strategy for enhancing comprehension. Improving comprehension instruction. CollinsBlock C and Pressley M. San Francisco: Jossey-Bass.

    Google Scholar 

  • Ganis, G., & Schendan, H. E. (2011). Visual imagery. Wiley Interdisciplinary Reviews: Cognitive Science, 2(3), 239–252.

    PubMed  Google Scholar 

  • Garrison, M. M., & Christakis, D. A. (2005). A Teacher in the Living Room? Educational Media for Babies, Toddlers, and Preschoolers. Menlo Park: The Kaiser Family Foundation.

    Google Scholar 

  • Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C., Nugent 3rd, T. F., Herman, D. H., Clasen, L. S., Toga, A. W., Rapoport, J. L., & Thompson, P. M. (2004). Dynamic mapping of human cortical development during childhood through early adulthood. Proceedings of the National Academy of Sciences of the United States of America, 101(21), 8174–8179.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Guell, X., Hoche, F., & Schmahmann, J. D. (2015). Metalinguistic deficits in patients with cerebellar dysfunction: Empirical support for the dysmetria of thought theory. Cerebellum, 14(1), 50–58.

    Article  PubMed  Google Scholar 

  • Hasson, U., Malach, R., & Heeger, D. J. (2010). Reliability of cortical activity during natural stimulation. Trends in Cognitive Sciences, 14(1), 40–48.

    Article  PubMed  Google Scholar 

  • High, P. C., & Klass, P. (2014). Literacy promotion: An essential component of primary care pediatric practice. Pediatrics, 134(2), 404–409.

    Article  PubMed  Google Scholar 

  • Holland, S. K., Vannest, J., Mecoli, M., Jacola, L. M., Tillema, J. M., Karunanayaka, P. R., Schmithorst, V. J., Yuan, W., Plante, E., & Byars, A. W. (2007). Functional MRI of language lateralization during development in children. International Journal of Audiology, 46(9), 533–551.

    Article  PubMed  PubMed Central  Google Scholar 

  • Horowitz-Kraus, T., & Hutton, J. S. (2015). From emergent literacy to reading: How learning to read changes a child's brain. Acta Paediatrica, 104(7), 648–656.

    Article  PubMed  Google Scholar 

  • Horowitz-Kraus, T., Hutton, J. S., Phelan, K., & Holland, S. K. (2018). Maternal reading fluency is positively associated with greater functional connectivity between the child's future reading network and regions related to executive functions and language processing in preschool-age children. Brain and Cognition, 121, 17–23.

    Article  PubMed  Google Scholar 

  • Huijbers, W., Pennartz, C. M., Rubin, D. C., & Daselaar, S. M. (2011). Imagery and retrieval of auditory and visual information: Neural correlates of successful and unsuccessful performance. Neuropsychologia, 49(7), 1730–1740.

    Article  PubMed  Google Scholar 

  • Hutton, J., Horowitz-Kraus, T., Mendelsohn, A., DeWitt, T., & Holland, S. (2015). Home Reading environment and brain activation in preschool children listening to stories. Pediatrics, 136(3), 466–478.

    Article  PubMed  Google Scholar 

  • Hutton, J. S., Phelan, K., Horowitz-Kraus, T., Dudley, J., Altaye, M., DeWitt, T., & Holland, S. K. (2017a). Shared Reading quality and brain activation during story listening in preschool-age children. J Pediatr 191, e201, 204–211.

    Article  Google Scholar 

  • Hutton, J. S., Phelan, K., Horowitz-Kraus, T., Dudley, J., Altaye, M., DeWitt, T., & Holland, S. K. (2017b). Story time turbocharger? Child engagement during shared reading and cerebellar activation and connectivity in preschool-age children listening to stories. PLoS One, 12(5), e0177398.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Just, M. A., Newman, S. D., Keller, T. A., McEleney, A., & Carpenter, P. A. (2004). Imagery in sentence comprehension: An fMRI study. Neuroimage, 21(1), 112–124.

    Article  PubMed  Google Scholar 

  • Knudsen, E. I. (2004). Sensitive periods in the development of the brain and behavior. Journal of Cognitive Neuroscience, 16(8), 1412–1425.

    Article  PubMed  Google Scholar 

  • Levin, J. R. (1972). Comprehending what we read: An outside looks in. Journal of Reading Behavior, 4(4).

    Article  Google Scholar 

  • Lillard, A. S., & Peterson, J. (2011). The immediate impact of different types of television on young children's executive function. Pediatrics, 128(4), 644–649.

    Article  PubMed  Google Scholar 

  • Lillard, A. S., Li, H., & Boguszewski, K. (2015). Television and children's executive function. Advances in Child Development and Behavior, 48, 219–248.

    Article  PubMed  Google Scholar 

  • Ma, J., & Birken, C. (2017). Handheld screen time linked with speech delays in young children. San Francisco: Pediatric Academic Societies Meeting.

    Google Scholar 

  • McDonough, C., Song, L., Hirsh-Pasek, K., Golinkoff, R. M., & Lannon, R. (2011). An image is worth a thousand words: Why nouns tend to dominate verbs in early word learning. Developmental Science, 14(2), 181–189.

    Article  PubMed  PubMed Central  Google Scholar 

  • Mechelli, A., Price, C. J., Friston, K. J., & Ishai, A. (2004). Where bottom-up meets top-down: Neuronal interactions during perception and imagery. Cerebral Cortex, 14(11), 1256–1265.

    Article  PubMed  Google Scholar 

  • Mohan, A., Roberto, A. J., Mohan, A., Lorenzo, A., Jones, K., Carney, M. J., Liogier-Weyback, L., Hwang, S., & Lapidus, K. A. (2016). The significance of the default mode network (DMN) in neurological and neuropsychiatric disorders: A review. The Yale Journal of Biology and Medicine, 89(1), 49–57.

    PubMed  PubMed Central  Google Scholar 

  • Molnar-Szakacs, I., & Uddin, L. Q. (2013). Self-processing and the default mode network: Interactions with the mirror neuron system. Frontiers in Human Neuroscience, 7, 571.

    Article  PubMed  PubMed Central  Google Scholar 

  • Oliver, M. C., Bays, R. B., & Zabrucky, K. M. (2016). False memories and the DRM paradigm: Effects of imagery, list, and test type. The Journal of General Psychology, 143(1), 33–48.

    Article  PubMed  Google Scholar 

  • Panel, N. E. L. (2008). Developing early literacy: Report of the National Early Literacy Panel. Washington, DC: National Institute for Literacy.

    Google Scholar 

  • Parish-Morris, J., Mahajan, N., Hirsh-Pasek, K., Golinkoff, R., & Collins, M. (2013). Once upon a time: Parent–child dialogue and storybook Reading in the electronic era. Mind, Brain, and Education., 7(3), 200–211.

    Article  Google Scholar 

  • Pearson, J., Naselaris, T., Holmes, E. A., & Kosslyn, S. M. (2015). Mental imagery: Functional mechanisms and clinical applications. Trends in Cognitive Sciences, 19(10), 590–602.

    Article  PubMed  PubMed Central  Google Scholar 

  • Power, J. D., Fair, D. A., Schlaggar, B. L., & Petersen, S. E. (2010). The development of human functional brain networks. Neuron, 67(5), 735–748.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage, 62(2), 816–847.

    Article  PubMed  Google Scholar 

  • Raichle, M. E. (2015). The brain's default mode network. Annual Review of Neuroscience, 38, 433–447.

    Article  PubMed  CAS  Google Scholar 

  • Read Aloud 15 Minutes National Campaign. (2018). Read aloud survey report: "how America reads aloud to its children". Washington, DC: YouGov.

    Google Scholar 

  • Rideout, V. (2017). The common sense census: Media use by kids age zero to eight. San Francisco: Common Sense Media.

    Google Scholar 

  • Schmithorst, V. J., Holland, S. K., & Plante, E. (2007). Object identification and lexical/semantic access in children: A functional magnetic resonance imaging study of word-picture matching. Human Brain Mapping, 28(10), 1060–1074.

    Article  PubMed  Google Scholar 

  • Scholastic. (2015). Kids & Family Reading Report. New York.

  • Seidkhani, H., Nikolaev, A. R., Meghanathan, R. N., Pezeshk, H., Masoudi-Nejad, A., & van Leeuwen, C. (2017). Task modulates functional connectivity networks in free viewing behavior. Neuroimage, 159, 289–301.

    Article  PubMed  Google Scholar 

  • Sestieri, C., Corbetta, M., Romani, G. L., & Shulman, G. L. (2011). Episodic memory retrieval, parietal cortex, and the default mode network: Functional and topographic analyses. The Journal of Neuroscience, 31(12), 4407–4420.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  • Sporns, O. (2011). The non-random brain: Efficiency, economy, and complex dynamics. Frontiers in Computational Neuroscience, 5, 5.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sporns, O. (2013). Structure and function of complex brain networks. Dialogues in Clinical Neuroscience, 15(3), 247–262.

    Article  PubMed  PubMed Central  Google Scholar 

  • Stoodley, C. J. (2012). The cerebellum and cognition: Evidence from functional imaging studies. Cerebellum, 11(2), 352–365.

    Article  PubMed  Google Scholar 

  • U.S. Department of Education. (2015). Shared Book Reading. What Works Clearinghouse. Washington, D.C.: Institute of Education Sciences.

    Google Scholar 

  • Uddin, L. Q., Kelly, A. M., Biswal, B. B., Castellanos, F. X., & Milham, M. P. (2009). Functional connectivity of default mode network components: Correlation, anticorrelation, and causality. Human Brain Mapping, 30(2), 625–637.

    Article  PubMed  Google Scholar 

  • Vannest, J., Rajagopal, A., Cicchino, N. D., Franks-Henry, J., Simpson, S. M., Lee, G., Altaye, M., Sroka, C., & Holland, S. K. (2014). Factors determining success of awake and asleep magnetic resonance imaging scans in nonsedated children. Neuropediatrics.

  • Weber, R., Alicea, B., Huskey, R., & Mathiak, K. (2018). Network dynamics of attention during a naturalistic behavioral paradigm. Frontiers in Human Neuroscience, 12, 182.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wertsch, J. V. (1980). The significance of dialogue in Vygotsky's account of social, egocentric, and inner speech. Contemporary Educational Psychology, 5(2), 150–162.

    Article  Google Scholar 

  • Whitfield-Gabrieli, S., & Nieto-Castanon, A. (2012). Conn: A functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connectivity, 2(3), 125–141.

    Article  PubMed  Google Scholar 

  • Whittingstall, K., Bernier, M., Houde, J. C., Fortin, D., & Descoteaux, M. (2014). Structural network underlying visuospatial imagery in humans. Cortex, 56, 85–98.

    Article  PubMed  Google Scholar 

  • Wood, D. J., Bruner, J., & Ross, G. (1976). The role of tutoring in problem-solving. Journal of Child Psychology and Psychiatry, 17, 89–100.

    Article  PubMed  CAS  Google Scholar 

  • Xiao, Y., Zhai, H., Friederici, A. D., & Jia, F. (2015). The development of the intrinsic functional connectivity of default network subsystems from age 3 to 5. In Brain Imaging Behav.

    Google Scholar 

  • Zimmerman, F. J., Christakis, D. A., & Meltzoff, A. N. (2007). Television and DVD/video viewing in children younger than 2 years. Archives of Pediatrics & Adolescent Medicine, 161(5), 473–479.

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Christy Banks for coordinating recruitment and administration of our fMRI protocol, and Dr. Jennifer Vannest for providing critique of early drafts of this manuscript. We thank Robert Munsch for his writing and storytelling, and permission to use audio and video versions used in this research. We finally thank the Thrasher Research Fund for their support of early-career investigators and this work.

Contributors’ statement

John S. Hutton designed all aspects of the study including brain network selection and definition, collaborated in analyses, drafted the initial manuscript and subsequent revisions, and approved the final manuscript as submitted.

Jonathan Dudley conducted brain network parcellation and all fMRI and other statistical analyses used in this study, created all tables and figures, assisted with manuscript preparation and revision, and approved the final manuscript as submitted.

Tzipi Horowitz-Kraus provided guidance on study design and analysis, assisted with MRI acquisition, reviewed and revised the manuscript, and approved the final manuscript as submitted.

Tom DeWitt provided guidance on study design, analysis, and presentation, reviewed and revised the manuscript, and approved the final manuscript as submitted.

Scott K. Holland provided guidance on study design and presentation, developed the concept for the a priori network connectivity approach used in the analysis, helped develop and oversaw the MRI acquisition protocol, and reviewed and approved the final manuscript as submitted.

Funding source

This study was funded by a grant from the Thrasher Research Fund with additional support provided via a Ruth L Kirschstein National Research Service Award (Hutton).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John S. Hutton.

Ethics declarations

Conflict of interest

Drs. Hutton, Dudley, Horowitz-Kraus, DeWitt, and Holland declare that they have no conflict of interest.

Informed consent

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, and the applicable revisions at the time of the investigation. Informed consent was obtained from all patients for being included in the study.

Financial disclosure

The authors have no financial relationships relevant to this article to disclose.

Electronic supplementary material

ESM 1

(DOCX 2099 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hutton, J.S., Dudley, J., Horowitz-Kraus, T. et al. Differences in functional brain network connectivity during stories presented in audio, illustrated, and animated format in preschool-age children. Brain Imaging and Behavior 14, 130–141 (2020). https://doi.org/10.1007/s11682-018-9985-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11682-018-9985-y

Keywords

Navigation