Neural Correlates of Auditory Object Perception

  • Jan W. H. Schnupp
  • Christian Honey
  • Ben D. B. Willmore
Chapter
Part of the Springer Handbook of Auditory Research book series (SHAR, volume 45)

Abstract

As you sit in front of this book, reading these words, pause for a moment, listen, and ask yourself: What do I hear? Perhaps you hear some conversations going on in the background, some devices making noises of various kinds (an almost omnipresent feature of the modern world). Or perhaps you are in an unusually quiet place, and there is effectively nothing to hear. Almost certain is that you would not describe your auditory experience as one of oscillating air pressure in your ear canals that gently wiggle your ear drums. Yet strictly speaking, on the surface of it, that is all there ever is to “hearing.”

Keywords

acoustics categorical perception cortex electrophysiology ­invariance phonemes scene analysis segregation sound speech timbre vocalization 

References

  1. Andersen, R. A., & Buneo, C. A. (2002). Intentional maps in posterior parietal cortex. Annual Review of Neuroscience, 25, 189–220.PubMedCrossRefGoogle Scholar
  2. Bar-Yosef, O., & Nelken, I. (2007). The effects of background noise on the neural responses to natural sounds in cat primary auditory cortex. Frontiers in Computational Neuroscience, 1(3), doi: 10.3389/neuro.10/003.2007.Google Scholar
  3. Bizley, J. K., Walker, K. M. M., Silverman, B. W., King, A. J., & Schnupp, J. W. H. (2009). Interdependent encoding of pitch, timbre, and spatial location in auditory cortex. Journal of Neuroscience, 29(7), 2064–2075.PubMedCrossRefGoogle Scholar
  4. Bleeck, S., Ingham, N. J., Verhey, J. L., & Winter, I M. (2008). Rebound depolarization in single units of the ventral cochlear nucleus: A contribution to grouping by common onset. Neuroscience, 154(1), 139–146.PubMedCrossRefGoogle Scholar
  5. Bregman, A. S. (1994). Auditory scene analysis: The perceptual organization of sound. Cambridge, MA: MIT Press.Google Scholar
  6. Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (2009). A relationship between behavioral choice and the visual responses of neurons in macaque MT. Visual Neuroscience, 13(1), 87–100.CrossRefGoogle Scholar
  7. Brugge, J. F., & Merzenich, M. M. (1973). Responses of neurons in auditory cortex of the macaque monkey to monaural and binaural stimulation. Journal of Neurophysiology, 36(6), 1138–1158.PubMedGoogle Scholar
  8. Chechik, G., Anderson, M. J., Bar-Yosef, O., Young, E. D., Tishby, N., & Nelken, I. (2006). Reduction of information redundancy in the ascending auditory pathway. Neuron, 51(3), 359–368.PubMedCrossRefGoogle Scholar
  9. Darwin, C. J., & Sutherland, N.S. (1984). Grouping frequency components of vowels: When is a harmonic not a harmonic? Quarterly Journal of Experimental Psychology Section A, 36(2), 193–208.CrossRefGoogle Scholar
  10. Desimone, R., Albright, T. D., Gross, C. G., & Bruce, C. (1984). Stimulus-selective properties of inferior temporal neurons in the macaque. Journal of Neuroscience, 4(8), 2051–2062.PubMedGoogle Scholar
  11. Eggermont, J. J. (1995). Representation of a voice onset time continuum in primary auditory cortex of the cat. Journal of the Acoustical Society of America, 98(2 Pt 1), 911–920.PubMedCrossRefGoogle Scholar
  12. Elhilali, M., Ma, L., Micheyl, C., Oxenham, A. J., & Shamma, S. A. (2009). Temporal coherence in the perceptual organization and cortical representation of auditory scenes. Neuron, 61, 317–329.PubMedCrossRefGoogle Scholar
  13. Eriksson, J. L., & Villa, A. E. P. (2006). Learning of auditory equivalence classes for vowels by rats. Behavioural Processes, 73(3), 348–359.PubMedCrossRefGoogle Scholar
  14. Firzlaff, U., Schuchmann, M., Grunwald, J. E., Schuller, G., & Wiegrebe, L. (2007). Object-oriented echo perception and cortical representation in echolocating bats. PLoS Biology, 5(5), e100.PubMedCrossRefGoogle Scholar
  15. Fishman, Y. I., Arezzo, J. C., & Steinschneider, M. (2004). Auditory stream segregation in monkey auditory cortex: Effects of frequency separation, presentation rate, and tone duration. Journal of the Acoustical Society of America, 116(3), 1656–1670.PubMedCrossRefGoogle Scholar
  16. Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2003). A comparison of primate prefrontal and inferior temporal cortices during visual categorization. Journal of Neuroscience, 23(12), 5235–5246.PubMedGoogle Scholar
  17. Geissler, D. B., & Ehret, G. (2004). Auditory perception vs. recognition: Representation of complex communication sounds in the mouse auditory cortical fields. European Journal of Neuroscience, 19(4), 1027–1040.PubMedCrossRefGoogle Scholar
  18. Ghazanfar, A. A., & Santos, L. R. (2004). Primate brains in the wild: The sensory bases for social interactions. Nature Reviews Neuroscience, 5, 603–616.PubMedCrossRefGoogle Scholar
  19. Gifford, G. W., MacLean, K. A., Hauser, M. D., & Cohen, Y. E. (2005). The neurophysiology of functionally meaningful categories: Macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. Journal of Cognitive Neuroscience, 9, 1471–1482.CrossRefGoogle Scholar
  20. Gourévitch, B., & Eggermont, J. J. (2007). Spatial representation of neural responses to natural and altered conspecific vocalizations in cat auditory cortex. Journal of Neurophysiology, 97(1), 144–158.PubMedCrossRefGoogle Scholar
  21. Griffiths, T. D., Warren, J. D., Scott, S. K., Nelken, I., & King, A. J. (2004). Cortical processing of complex sound: A way forward. Trends in Neurosciences, 27(4), 181–185.PubMedCrossRefGoogle Scholar
  22. Guenther, F. H., & Gjaja, M. N. (1996). The perceptual magnet effect as an emergent property of neural map formation. Journal of the Acoustical Society of America, 100(2Pt 1), 1111–1121.PubMedCrossRefGoogle Scholar
  23. Han, Y. K., Köver, H., Insanally, M. N., Semerdjian, J. H., & Bao, S (2007). Early experience impairs perceptual discrimination. Nature Neuroscience, 10(9), 1191–1197.PubMedCrossRefGoogle Scholar
  24. Harrington, I. A., Stecker, G. C., Macpherson, E. A., & Middlebrooks, J. C. (2008). Spatial sensitivity of neurons in the anterior, posterior, and primary fields of cat auditory cortex. Hearing Research, 240(1–2), 22–41.PubMedCrossRefGoogle Scholar
  25. Histed, M. H., Pasupathy, A., & Miller, E. K. (2009). Learning substrates in the primate prefrontal cortex and striatum: Sustained activity related to successful actions. Neuron, 63(2), 244–253.PubMedCrossRefGoogle Scholar
  26. Holmes, S. D., & Roberts, B. (2006). Inhibitory influences on asynchrony as a cue for auditory segregation. Journal of Experimental Psychology, 32(5), 1231–1242.PubMedGoogle Scholar
  27. Holt, L. L., Lotto, A. J., & Kluender, K. R. (2001). Influence of fundamental frequency on stop-consonant voicing perception: A case of learned covariation or auditory enhancement. Journal of the Acoustical Society of America, 109(2), 764–774.PubMedCrossRefGoogle Scholar
  28. Kaas, J. H., & Hackett, T. A. (2000). Subdivisions of auditory cortex and processing streams in primates. Proceedings of the National Academy of Sciences of the USA, 97(22), 11793–11799.PubMedCrossRefGoogle Scholar
  29. Kalatsky, V. A., Polley, D. B., Merzenich, M. M., Schreiner, C. E., & Stryker, M. P. (2005). Fine functional organization of auditory cortex revealed by Fourier optical imaging. Proceedings of the National Academy of Sciences of the USA, 102(37), 13325–13330.CrossRefGoogle Scholar
  30. Kluender, K., Diehl, R., & Killeen, P. (1987). Japanese quail can learn phonetic categories. Science, 237(4819), 1195–1197.PubMedCrossRefGoogle Scholar
  31. Kluender, K. R., & Lotto, A. J. (1994). Effects of first formant onset frequency on [-voice] judgments result from auditory processes not specific to humans. Journal of the Acoustical Society of America, 95(2), 1044–1052.Google Scholar
  32. Kluender, K. R., Lotto, A. J., Holt, L. L., & Bloedel, S. L. (1998). Role of experience for language-specific functional mappings of vowel sounds. Journal of the Acoustical Society of America, 104(6), 3568–3582.PubMedCrossRefGoogle Scholar
  33. Kuhl, P. K. (1991). Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not. Perception & Psychophysics, 50(2), 93–107.CrossRefGoogle Scholar
  34. Kuhl, P. K., & Miller, J. D. (1975). Speech perception by the chinchilla: Voiced-voiceless distinction in alveolar plosive consonants. Science, 190(4209), 69–72.PubMedCrossRefGoogle Scholar
  35. Lee, J. H., Russ, B. E., Orr, L. E., & Cohen, Y. E. (2009). Prefrontal activity predicts monkeys’ decisions during an auditory category task. Frontiers in Integrative Neuroscience, 3(16), 1–12.Google Scholar
  36. Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. (1957). The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54(5), 358–368.PubMedCrossRefGoogle Scholar
  37. Loh, M., Pasupathy, A., Miller, E. K., & Deco, G. (2008). Neurodynamics of the prefrontal cortex during conditional visuomotor associations. Journal of Cognitive Neuroscience, 20(3), 421–431.PubMedCrossRefGoogle Scholar
  38. Lomber, S. G., & Malhotra, S. (2008). Double dissociation of ’what’ and “where” processing in auditory cortex. Nature Neuroscience, 11(5), 609–616.PubMedCrossRefGoogle Scholar
  39. Luczak, A., Barthó, P., Marguet, S. L., Buzsáki, G., & Harris, K. D. (2007). Sequential structure of neocortical spontaneous activity in vivo. Proceedings of the National Academy of Sciences of the USA, 104(1), 347–352.PubMedCrossRefGoogle Scholar
  40. Luczak, A., Barthó, P., & Harris, K. D. (2009). Spontaneous events outline the realm of possible sensory responses in neocortical populations. Neuron, 62(3), 413–425.PubMedCrossRefGoogle Scholar
  41. Mercado, E., Orduña, I., & Nowak, J. M. (2005). Auditory categorization of complex sounds by rats (Rattus norvegicus). Journal of Comparative Psychology, 119(1), 90–98.PubMedCrossRefGoogle Scholar
  42. Micheyl, C., Tian, Biao, Carlyon, R. P., & Rauschecker, Josef P. (2005). Perceptual organization of tone sequences in the auditory cortex of awake macaques. Neuron, 48(1), 139–148.PubMedCrossRefGoogle Scholar
  43. Middlebrooks, J., Clock, A., Xu, L., & Green, D. (1994). A panoramic code for sound location by cortical neurons. Science, 264(5160), 842–844.PubMedCrossRefGoogle Scholar
  44. Miller, E. K., Freedman, D. J., & Wallis, J. D. (2002). The prefrontal cortex: Categories, concepts and cognition. Philosophical Transactions of the Royal Society B: Biological Sciences, 357(1424), 1123–1136.CrossRefGoogle Scholar
  45. Nassi, J. J., & Callaway, E. M. (2009). Parallel processing strategies of the primate visual system. Nature Reviews Neuroscience, 10(5), 360.PubMedCrossRefGoogle Scholar
  46. Nelken, I. (2008). Processing of complex sounds in the auditory system. Current Opinion in Neurobiology, 18(4), 413–417.PubMedCrossRefGoogle Scholar
  47. Nelken, I., Fishbach, A., Las, L., Ulanovsky, N., & Farkas, D. (2003). Primary auditory cortex of cats: Feature detection or something else. Biological Cybernetics, 89(5), 397–406.PubMedCrossRefGoogle Scholar
  48. Nelken, I., Bizley, J. K., Nodal, F. R., Ahmed, B., Schnupp, J. W. H., & King, A. J. (2004). Large-scale organization of ferret auditory cortex revealed using continuous acquisition of intrinsic optical signals. Journal of Neurophysiology, 92(4), 2574–2588.PubMedCrossRefGoogle Scholar
  49. Nelken, I., Chechik, G., Mrsic-Flogel, T. D., King, A. J., & Schnupp, J. W. H. (2005). Encoding stimulus information by spike numbers and mean response time in primary auditory cortex. Journal of Computational Neuroscience, 19(2), 199–221.PubMedCrossRefGoogle Scholar
  50. Ohl, F. W., Scheich, H., & Freeman, W. J. (2001). Change in pattern of ongoing cortical activity with auditory category learning. Nature, 412(6848), 733–736.PubMedCrossRefGoogle Scholar
  51. Olveczky, B. P., & Gardner, T. J. (2011). A bird’s eye view of neural circuit formation. Current Opinion in Neurobiology, 21(1), 124–131.PubMedCrossRefGoogle Scholar
  52. Pasupathy, A., & Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature, 433(7028), 873–876.PubMedCrossRefGoogle Scholar
  53. Poremba, A. (2003). Functional mapping of the primate auditory system. Science, 299(5606), 568–572.PubMedCrossRefGoogle Scholar
  54. Pressnitzer, D., & Hupé, J.-M. (2006). Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization. Current Biology, 16(13), 1351–1357.PubMedCrossRefGoogle Scholar
  55. Pressnitzer, D., Sayles, M., Micheyl, C., & Winter, I. M. (2008). Perceptual organization of sound begins in the auditory periphery. Current Biology, 18(15), 1124–1128.PubMedCrossRefGoogle Scholar
  56. Roberts, B., & Holmes, S. D. (2006). Grouping and the pitch of a mistuned fundamental component: Effects of applying simultaneous multiple mistunings to the other harmonics. Hearing Research, 222(1–2), 79–88.PubMedCrossRefGoogle Scholar
  57. Roberts, B., & Holmes, S. D. (2007). Contralateral influences of wideband inhibition on the effect of onset asynchrony as a cue for auditory grouping. Journal of the Acoustical Society of America, 121(6), 3655–3665.PubMedCrossRefGoogle Scholar
  58. Romanski, L. M., & Averbeck, B. B. (2009). The primate cortical auditory system and neural representation of conspecific vocalizations. Annual Review of Neuroscience, 32, 315–346.PubMedCrossRefGoogle Scholar
  59. Romanski, L. M., Tian, B., Fritz, J., Mishkin, M., Goldman-Rakic, P. S., & Rauschecker, J. P. (1999). Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nature Neuroscience, 2(12), 1131–1136.PubMedCrossRefGoogle Scholar
  60. Russ, B. E., Ackelson, A. L., Baker, A. E., & Cohen, Y. E. (2008). Coding of auditory-stimulus identity in the auditory non-spatial processing stream. Journal of Neurophysiology, 99(1), 87–95.PubMedCrossRefGoogle Scholar
  61. Schnupp, J. W. H. (2008). Auditory neuroscience: Sound segregation in the brainstem. Current Biology, 18(16), 705–706.CrossRefGoogle Scholar
  62. Schnupp, J. W. H., Hall, T. M., Kokelaar, R. F., & Ahmed, B. (2006). Plasticity of temporal pattern codes for vocalization stimuli in primary auditory cortex. Journal of Neuroscience, 26(18), 4785–4795.PubMedCrossRefGoogle Scholar
  63. Schnupp, J., Nelken, I., & King, A. (2010). Auditory neuroscience: Making sense of sound. Cambridge, MA: MIT Press.Google Scholar
  64. Schouten, M. E., & van Hessen, A. J. (1992). Modeling phoneme perception. I: Categorical perception. Journal of the Acoustical Society of America, 92(4 Pt 1), 1841–1855.PubMedCrossRefGoogle Scholar
  65. Shamma, S., Elhilali, M., & Micheyl, C. (2011). Temporal coherence and attention in auditory scene analysis. Trends in Neurosciences, 34, 114–123.PubMedCrossRefGoogle Scholar
  66. Sinnott, J. M., & Brown, C. H. (1997). Perception of the American English liquid /ra-la/ contrast by humans and monkeys. Journal of the Acoustical Society of America, 102(1), 588–602.PubMedCrossRefGoogle Scholar
  67. Sinnott, J., Brown, C., & Borneman, M.A. (1998). Effects of syllable duration on stop-glide identification in syllable-initial and syllable-final position by humans and monkeys. Perception & Psychophysics, 60(6), 1032–1043.CrossRefGoogle Scholar
  68. Steinschneider, M., Fishman, Y. I., & Arezzo, J. C. (2003). Representation of the voice onset time (VOT) speech parameter in population responses within primary auditory cortex of the awake monkey. Journal of the Acoustical Society of America, 114(1), 307–321.PubMedCrossRefGoogle Scholar
  69. Tian, B., Reser, D., Durham, A., Kustov, A., & Rauschecker, J. P. (2001). Functional specialization in Rhesus monkey auditory cortex. Science, 292(5515), 290–293.PubMedCrossRefGoogle Scholar
  70. Tovee, M. J., Rolls, E. T., & Azzopardi, P. (1994). Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. Journal of Neurophysiology, 72(3), 1049–1060.PubMedGoogle Scholar
  71. Ungerleider, L. G., & Haxby, J. V. (1994). “What” and “where” in the human brain. Current Opinion in Neurobiology, 4(2), 157–165.PubMedCrossRefGoogle Scholar
  72. van Noorden, L. (1975). Temporal coherence in the perception of tone sequences. Doctoral thesis, Technische Hogeschool Eindhoven.Google Scholar
  73. Walker, K. M. M., Ahmed, B., & Schnupp, J. W. H. (2008). Linking cortical spike pattern codes to auditory perception. Journal of Cognitive Neuroscience, 20(1), 135–152.PubMedCrossRefGoogle Scholar
  74. Weinberger, N. M. (2004). Specific long-term memory traces in primary auditory cortex. Nature Reviews Neuroscience, 5(4), 279.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Jan W. H. Schnupp
    • 1
  • Christian Honey
    • 1
  • Ben D. B. Willmore
    • 1
  1. 1.Department of Physiology, Anatomy and GeneticsUniversity of OxfordOxfordUK

Personalised recommendations