Abstract
Interaural time differences (ITDs) at low frequencies are important for sound localization and spatial speech unmasking. These ITD cues are not encoded in commonly used envelope-based stimulation strategies for cochlear implants (CIs) using high pulse rates. However, ITD sensitivity can be improved by adding extra pulses with short inter-pulse intervals (SIPIs) in unmodulated high-rate trains. Here, we investigated whether this improvement also applies to amplitude-modulated (AM) high-rate pulse trains. To this end, we systematically varied the temporal position of SIPI pulses within the envelope cycle (SIPI phase), the fundamental frequency (F0) of AM (125 Hz and 250 Hz), and AM depth (from 0.1 to 0.9). Stimuli were presented at an interaurally place-matched electrode pair at a reference pulse rate of 1000 pulses/s. Participants performed an ITD-based left/right discrimination task. SIPI insertion resulted in improved ITD sensitivity throughout the range of modulation depths and for both male and female F0s. The improvements were largest for insertion at and around the envelope peak. These results are promising for conveying salient ITD cues at high pulse rates commonly used to encode speech information.
Similar content being viewed by others
References
Arora K, Dawson P, Dowell R, Vandali A (2009) Electrical stimulation rate effects on speech perception in cochlear implants. Int J Audiol 48:561–567
Bernstein LR, Trahiotis C (2002) Enhancing sensitivity to interaural delays at high frequencies by using “transposed stimuli”. J Acoust Soc Am 112:1026–1036
Bernstein LR, Trahiotis C (2009) How sensitivity to ongoing interaural temporal disparities is affected by manipulations of temporal features of the envelopes of high-frequency stimuli. J Acoust Soc Am 125:3234–3242
Brughera A, Dunai L, Hartmann WM (2013) Human interaural time difference thresholds for sine tones: the high-frequency limit. J Acoust Soc Am 133:2839–2855
Buechel BD, Hancock KE, Chung Y, Delgutte B (2018) Improved neural coding of ITD with bilateral cochlear implants by introducing short inter-pulse intervals. J Assoc Res Otolaryngol 19:681–702
Churchill TH, Kan A, Goupell MJ, Litovsky RY (2014) Spatial hearing benefits demonstrated with presentation of acoustic temporal fine structure cues in bilateral cochlear implant listeners. J Acoust Soc Am 136:1246–1256
Dietz M, Marquardt T, Salminen NH, McAlpine D (2013) Emphasis of spatial cues in the temporal fine structure during the rising segments of amplitude-modulated sounds. Proc Natl Acad Sci U S A 110:15151–15156
Dorman MF, Wilson BS (2004) The design and function of cochlear implants: fusing medicine, neural science and engineering, these devices transform human speech into an electrical code that deafened ears can understand. Am Sci 92(5):436–445
Egger K, Majdak P, Laback B (2016) Channel interaction and current level affect across-electrode integration of interaural time differences in bilateral cochlear-implant listeners. J Assoc Res Otolaryngol 17:55–67
Egger K, Majdak P, Laback B (2017) Binaural timing information in electric hearing at low rates: effects of inaccurate encoding and loudness. J Acoust Soc Am 141:3164–3174
Francart T, Lenssen A, Wouters J (2014) Modulation enhancement in the electrical signal improves perception of interaural time differences with bimodal stimulation. JAssoc Res Otolaryngol 15:633–647
Garofolo JS, Lamel LF, Fisher WM, Fiscus JG, Pallett DS (1993) DARPA TIMIT acoustic-phonetic continous speech corpus CD-ROM. NIST speech disc 1-1.1. NASA STIRecon Tech Rep N. 93
Grantham DW, Ashmead DH, Ricketts TA, Haynes DS, Labadie RF (2008) Interaural time and level difference thresholds for acoustically presented signals in post-lingually deafened adults fitted with bilateral cochlear implants using CIS+ processing. Ear Hear 29:33–44
Grantham DW, Ashmead DH, Ricketts TA, Labadie RF, Haynes DS (2007) Horizontal-plane localization of noise and speech signals by postlingually deafened adults fitted with bilateral cochlear implants. Ear Hear 28:524–541
Green DM, Swets JA (1966) Signal detection theory and psychophysics. Wiley New York
Hancock KE, Chung Y, Delgutte B (2012) Neural ITD coding with bilateral cochlear implants: effect of binaurally coherent jitter. J Neurophysiol 108:714–728
Hochmair I, Nopp P, Jolly C, Schmidt M, Schösser H, Garnham C, Anderson I (2006) MED-EL cochlear implants: state of the art and a glimpse into the future. Trends Amplif 10:201–219
van Hoesel R, Böhm M, Pesch J, Vandali A, Battmer RD, Lenarz T (2008) Binaural speech unmasking and localization in noise with bilateral cochlear implants using envelope and fine-timing based strategies. J Acoust Soc Am 123:2249–2263
van Hoesel RJM, Jones GL, Litovsky RY (2009) Interaural time-delay sensitivity in bilateral cochlear implant users: effects of pulse rate, modulation rate, and place of stimulation. J Assoc Res Otolaryngol 10:557–567
Hsieh I-H, Petrosyan A, Gonçalves ÓF, Hickok G, Saberi K (2011) Observer weighting of interaural cues in positive and negative envelope slopes of amplitude-modulated waveforms. Hear Res 277:143–151
Hu H, Ewert SD, McAlpine D, Dietz M (2017) Differences in the temporal course of interaural time difference sensitivity between acoustic and electric hearing in amplitude modulated stimuli. J Acoust Soc Am 141:1862
Ihlefeld A, Kan A, Litovsky RY (2014) Across-frequency combination of interaural time difference in bilateral cochlear implant listeners. Front Syst Neurosci 8:1–10
Ihlefeld A, Litovsky RY (2012) Interaural level differences do not suffice for restoring spatial release from masking in simulated cochlear implant listening. PLoS One 7:e45296
Jesteadt W (1980) An adaptive procedure for subjective judgments. Percept Psychophys 28:85–88
Kan A, Litovsky RY, Goupell MJ (2015) Effects of interaural pitch matching and auditory image centering on binaural sensitivity in cochlear implant users. Ear Hear 36(3):e62
Kidd G Jr, Mason CR, Best V, Marrone N (2010) Stimulus factors influencing spatial release from speech-on-speech masking. J Acoust Soc Am 128:1965–1978
Klein SA (2001) Measuring, estimating, and understanding the psychometric function: a commentary. Percept Psychophys 63:1421–1455
Klein-Hennig M, Dietz M, Hohmann V, Ewert SD (2011) The influence of different segments of the ongoing envelope on sensitivity to interaural time delays. J Acoust Soc Am 129:3856–3872
Klumpp RG, Eady HR (1956) Some measurements of interaural time difference thresholds. J Acoust Soc Am 28:859–860
Kohler KJ (1996) Labelled data bank of spoken standard German: the Kiel corpus of read/spontaneous speech. In: Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP’96. pp. 1938–1941. IEEE
Laback B, Egger K, Majdak P (2015) Perception and coding of interaural time differences with bilateral cochlear implants. Hear Res 322:138–150
Laback B, Majdak P (2008) Binaural jitter improves interaural-time difference sensitivity of cochlear implantees at high pulse rates. Proc Natl Acad Sci U A 105:814–817
Laback B, Majdak P, Baumgartner W-D (2007) Lateralization discrimination of interaural time delays in four-pulse sequences in electric and acoustic hearing. J Acoust Soc Am 121:2182–2191
Laback B, Pok S-M, Baumgartner W-D, Deutsch WA, Schmid K (2004) Sensitivity to interaural level and envelope time differences of two bilateral cochlear implant listeners using clinical sound processors. Ear Hear 25:488–500
Laback B, Zimmermann I, Majdak P, Baumgartner W-D, Pok S-M (2011) Effects of envelope shape on interaural envelope delay sensitivity in acoustic and electric hearing. J Acoust Soc Am 130:1515–1529
Levitt H (1971) Transformed up-down methods in psychoacoustics. J Acoust Soc Am 49:467–477
Lindenbeck M, Laback B, Majdak P, Srinivasan S (in press) Temporal-pitch sensitivity in electric hearing with amplitude modulation and short inter-pulse intervals. J Acoust Soc Am
Litovsky RY, Jones GL, Agrawal S, van Hoesel R (2010) Effect of age at onset of deafness on binaural sensitivity in electric hearing in humans. J Acoust Soc Am 127(1):400–414
Loizou PC, Poroy O, Dorman M (2000) The effect of parametric variations of cochlear implant processors on speech understanding. J Acoust Soc Am 108:790–802
Macpherson EA, Middlebrooks JC (2002) Listener weighting of cues for lateral angle: the duplex theory of sound localization revisited. J Acoust Soc Am 111:2219–2236
Majdak P, Laback B, Baumgartner W-D (2006) Effects of interaural time differences in fine structure and envelope on lateral discrimination in electric hearing. J Acoust Soc Am 120:2190–2201
McKay CM, Henshall KR (2010) Amplitude modulation and loudness in cochlear implantees. J Assoc Res Otolaryngol 11:101–111
McKay CM, McDermott HJ (1998) Loudness perception with pulsatile electrical stimulation: the effect of interpulse intervals. J Acoust Soc Am 104:1061–1074
McKay CM, McDermott HJ, Clark GM (1995) Pitch matching of amplitude-modulated current pulse trains by cochlear implantees: the effect of modulation depth. J Acoust Soc Am 97:1777–1785
Middlebrooks JC, Onsan ZA (2012) Stream segregation with high spatial acuity. J Acoust Soc Am 132:3896–3911
Monaghan JJ, Seeber BU (2016) A method to enhance the use of interaural time differences for cochlear implants in reverberant environments. J Acoust Soc Am 140:1116–1129
Nelson BS, Takahashi TT (2010) Spatial hearing in echoic environments: the role of the envelope in owls. Neuron. 67:643–655
Noel VA, Eddington DK (2013) Sensitivity of bilateral cochlear implant users to fine-structure and envelope interaural time differences. J Acoust Soc Am 133:2314–2328
Nuetzel JM, Hafter ER (1981) Discrimination of interaural delays in complex waveforms: spectral effects. J Acoust Soc Am 69:1112–1118
Pépiot E (2014) Male and female speech: a study of mean f0, f0 range, phonation type and speech rate in Parisian French and American English speakers. Speech Prosody 7:305–309
Poon BB, Eddington DK, Noel V, Colburn HS (2009) Sensitivity to interaural time difference with bilateral cochlear implants: development over time and effect of interaural electrode spacing. J Acoust Soc Am 126:806–815
Riss D, Hamzavi J-S, Blineder M, Honeder C, Ehrenreich I, Kaider A, Baumgartner W-D, Gstoettner W, Arnoldner C (2014) FS4, FS4-p, and FSP: a 4-month crossover study of three fine structure sound-coding strategies. Ear Hear 35:e272–e281
Seeber BU, Fastl H (2008) Localization cues with bilateral cochlear implants. J Acoust Soc Am 123:1030–1042
Shannon RV (1985) Threshold and loudness functions for pulsatile stimulation of cochlear implants. Hear Res 18:135–143
Smith Z (2010) Improved sensitivity to interaural time differences with the FAST coding strategy. 11th International Conference on Cochlear Implants and Other Implantable Auditory Technologies. Stockholm, Sweden
Srinivasan S, Laback B, Majdak P, Delgutte B (2018) Introducing short interpulse intervals in high-rate pulse trains enhances binaural timing sensitivity in electric hearing. J Assoc Res Otolaryngol 19:301–315
Strutt JW (1876) Our perception of the direction of a source of sound. Nature. 14:32–33
Thakkar T, Kan A, Jones HG, Litovsky RY (2018) Mixed stimulation rates to improve sensitivity of interaural timing differences in bilateral cochlear implant listeners. J Acoust Soc Am 143:1428–1440
Vandali A, Sly D, Cowan R, van Hoesel R (2013) Pitch and loudness matching of unmodulated and modulated stimuli in cochlear implantees. Hear Res 302:32–49
Wightman FL, Kistler DJ (1992) The dominant role of low-frequency interaural time differences in sound localization. J Acoust Soc Am 91:1648–1661
Williges B, Jürgens T, Hu H, Dietz M (2018) Coherent coding of enhanced interaural cues improves sound localization in noise with bilateral cochlear implants. Trends Hear 22:2331216518781746
Wilson BS, Finley CC, Lawson DT, Wolford RD, Eddington DK, Rabinowitz WM (1991) Better speech recognition with cochlear implants. Nature. 352:236–238
Wilson BS (2006) Speech processing strategies. In: Cooper HR, Craddock LC (eds) Cochlear implants: a practical guide, 2nd edn. John Wiley & Sons, Hoboken, NJ, pp 21–69
Acknowledgments
We thank all our listeners for their participation in our study. We thank Michael Mihocic for assistance with data collection and the experimental hardware and software setup. We thank the Institute of Ion Physics and Applied Physics, Leopold-Franzens-University of Innsbruck, Austria, for providing the equipment for direct electric stimulation. We thank the associate editor and two anonymous reviewers for helpful comments on an earlier version of this article.
Funding
This study was funded by the National Institutes of Health grant R01 DC 005775 via a subcontract. Additional funding was provided by the European Commission (Project ALT, Grant 691229) and the Danube Partnership project (MULT-DR 11/2017).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
All procedures presented here were approved by the ethics committee of the Medical University of Vienna (vote no. 2155/2013).
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The authors are ordered according to their contribution to this study.
Rights and permissions
About this article
Cite this article
Srinivasan, S., Laback, B., Majdak, P. et al. Improving Interaural Time Difference Sensitivity Using Short Inter-pulse Intervals with Amplitude-Modulated Pulse Trains in Bilateral Cochlear Implants. JARO 21, 105–120 (2020). https://doi.org/10.1007/s10162-020-00743-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10162-020-00743-6