Combining Voice and Face Content in the Primate Temporal Lobe
- 510 Downloads
The interactions of many social animals critically depend on identifying other individuals to approach or avoid. Recognizing specific individuals requires extracting and integrating cross-sensory indexical cues from richly informative communication signals such as voice and face content. Knowledge on how the brain processes faces and voices as unisensory or multisensory signals has grown; neurobiological insights are now available not only from human neuroimaging data but also from comparative neuroimaging studies in nonhuman animals, which together identify the correspondences that can be made between brain processes in humans and other species. These advances have also had the added benefit of establishing animal models in which neuronal processes and pathways are interrogated at finer neurobiological scales than possible in humans. This chapter overviews the latest insights on neuronal representations of voice and face content, including information on sensory convergence sites and pathways that combine multisensory signals in the primate temporal lobe. The information synthesized here leads to a conceptual model whereby the sensory integration of voice and face content depends on temporal lobe convergence sites, which are a midway processing stage and a conduit between audiovisual sensory-processing streams and the frontal cortex.
KeywordsAuditory Communication Comparative Face areas Functional magnetic resonance imaging Neurons Neurophysiology Oscillations Spikes Superior-temporal sulcus Visual Voice areas
We thank Christoph Kayser and Nikos Logothetis for useful discussion, support, and encouragement. This work was supported by the Max Planck Society, Wellcome Trust Investigator Award WT092606AIA to Christopher I. Petkov, Sir Henry Wellcome Fellowship 110238/Z/15/Z to Catherine Perrodin, the European Research Council to Christopher I. Petkov (MECHIDENT), and Biotechnology and Biological Sciences Research Council BB/J009849/1 to Christopher I. Petkov jointly with Q. Vuong.
Compliance with Ethics Requirements
Catherine Perrodin declares that she has no conflict of interest.Christopher I. Petkov declares that he has no conflict of interest.
- Gifford, G. W., 3rd, MacLean, K. A., Hauser, M. D., & Cohen, Y. E. (2005). The neurophysiology of functionally meaningful categories: Macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. Journal of Cognitive Neuroscience, 17(9), 1471–1482.PubMedPubMedCentralCrossRefGoogle Scholar
- Matsui, T., Tamura, K., Koyano, K. W., Takeuchi, D., Adachi, Y., Osada, T., & Miyashita, Y. (2011). Direct comparison of spontaneous functional connectivity and effective connectivity measured by intracortical microstimulation: An fMRI study in macaque monkeys. Cerebral Cortex, 21(10), 2348–2356.PubMedCrossRefPubMedCentralGoogle Scholar
- Perrodin, C., Kayser, C., Logothetis, N. K., & Petkov, C. I. (2015a). Natural asynchronies in audiovisual communication signals regulate neuronal multisensory interactions in voice-sensitive cortex. Proceedings of the National Academy of Sciences of the United States of America, 112(1), 273–278.PubMedCrossRefPubMedCentralGoogle Scholar
- Petkov, C. I., Kikuchi, Y., Milne, A. E., Mishkin, M., Rauschecker, J. P., & Logothetis, N. K. (2015). Different forms of effective connectivity in primate frontotemporal pathways. Nature Communications, 6. https://doi.org/10.1038/ncomms7000.
- Saleem, K. S., & Logothetis, N. K. (2007). A combined MRI and histology: Atlas of the rhesus monkey brain in stereotaxic coordinates. London: Academic.Google Scholar
- Schroeder, C. E., Smiley, J., Fu, K. G., McGinnis, T., O'Connell, M. N., & Hackett, T. A. (2003). Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. International Journal of Psychophysiology, 50(1-2), 5–17.PubMedCrossRefPubMedCentralGoogle Scholar