© 2019

Multisensory Processes

The Auditory Perspective

  • Adrian K. C. Lee
  • Mark T. Wallace
  • Allison B. Coffin
  • Arthur N. Popper
  • Richard R. Fay

Part of the Springer Handbook of Auditory Research book series (SHAR, volume 68)

Table of contents

  1. Front Matter
    Pages i-xvi
  2. Adrian K. C. Lee, Mark T. Wallace
    Pages 1-8
  3. David Alais, David Burr
    Pages 9-31
  4. Ken W. Grant, Joshua G. W. Bernstein
    Pages 33-57
  5. Adrian K. C. Lee, Ross K. Maddox, Jennifer K. Bizley
    Pages 59-83
  6. Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox
    Pages 85-104
  7. Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal
    Pages 105-133 Open Access
  8. Bethany Plakke, Lizabeth M. Romanski
    Pages 135-159
  9. Catherine Perrodin, Christopher I. Petkov
    Pages 177-199
  10. Julian Keil, Daniel Senkowski
    Pages 201-220
  11. Patrick Bruns, Brigitte Röder
    Pages 221-242
  12. Sarah H. Baum Miller, Mark T. Wallace
    Pages 243-272
  13. Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal
    Pages C1-C1

About this book


Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations.

Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace

Cue Combination within a Bayesian Framework David Alais and David Burr

Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein

An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley   Hearing in a “Moving” Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox

Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal

Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski

Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp

Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov

Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski

Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder

Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace 

Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle

Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville

Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA

Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park

Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago

The chapter “Multisensory Processing in the Auditory Cortex” is available open access under a Creative Commons Attribution 4.0 International License via


cognition hearing neuroimaging perception interaction visual processing communication

Editors and affiliations

  • Adrian K. C. Lee
    • 1
  • Mark T. Wallace
    • 2
  • Allison B. Coffin
    • 3
  • Arthur N. Popper
    • 4
  • Richard R. Fay
    • 5
  1. 1.Department of Speech and Hearing Sciences, Institute for Learning and Brain SciencesUniversity of WashingtonSeattleUSA
  2. 2.Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Vanderbilt Brain InstituteVanderbilt UniversityNashvilleUSA
  3. 3.Department of Integrative Physiology and NeuroscienceWashington State University VancouverVancouverUSA
  4. 4.Department of BiologyUniversity of MarylandCollege ParkUSA
  5. 5.Department of PsychologyLoyola University ChicagoChicagoUSA

About the editors

Dr. Adrian K.C. Lee is Director of the Center for Auditory Neuroimaging and Assistant Professor of Speech & Hearing Sciences and Institute for Learning & Brain Sciences at University of Washington. The Lee lab is interested in mapping the cortical dynamics associated with auditory attention as well as how the oculomotor and the visual attentional network interact with auditory attention. 

Dr. Mark T. Wallace is Director of the Vanderbilt Brain Institute and Professor of Hearing and Speech Sciences, Psychology and Psychiatry at Vanderbilt University. The Wallace lab is interested in better understanding how the brain synthesizes information from multiple sensory systems and employs an array of approaches ranging from neurophysiology in animal models to neuroimaging in “typical” and clinical populations.

Bibliographic information

  • Book Title Multisensory Processes
  • Book Subtitle The Auditory Perspective
  • Editors Adrian K. C. Lee
    Mark T. Wallace
    Allison B. Coffin
    Arthur N. Popper
    Richard R. Fay
  • Series Title Springer Handbook of Auditory Research
  • Series Abbreviated Title Springer Hdb.Auditory Res.
  • DOI
  • Copyright Information Springer Nature Switzerland AG 2019
  • Publisher Name Springer, Cham
  • eBook Packages Biomedical and Life Sciences Biomedical and Life Sciences (R0)
  • Hardcover ISBN 978-3-030-10459-7
  • eBook ISBN 978-3-030-10461-0
  • Series ISSN 0947-2657
  • Series E-ISSN 2197-1897
  • Edition Number 1
  • Number of Pages XVI, 272
  • Number of Illustrations 21 b/w illustrations, 49 illustrations in colour
  • Topics Otorhinolaryngology
  • Buy this book on publisher's site


“The audience is larger than just communication sciences and disorders professionals because of its multidisciplinary approach and contributors. It would be of interest to anyone in the speech and hearing sciences including clinicians, doctors, and researchers. … The intent of this book is outstanding. Bringing multidisciplinary authors together to assess research and demonstrating the brain's ability to use many senses to obtain a cohesive sensory experience of the world around us is excellent.” (Lorelei J Peirson, Doody's Book Reviews, July 12, 2019)