Abstract
Most cochlear implants encode the fundamental frequency of periodic sounds by amplitude modulation of constant-rate pulsatile stimulation. Pitch perception provided by such stimulation strategies is markedly poor. Two experiments are reported here that consider potential advantages of pulse rate compared to modulation frequency for providing stimulation timing cues for pitch. The first experiment examines beat frequency distortion that occurs when modulating constant-rate pulsatile stimulation. This distortion has been reported on previously, but the results presented here indicate that distortion occurs for higher stimulation rates than previously reported. The second experiment examines pitch resolution as provided by pulse rate compared to modulation frequency. The results indicate that pitch discrimination is better with pulse rate than with modulation frequency. The advantage was large for rates near what has been suggested as the upper limit of temporal pitch perception conveyed by cochlear implants. The results are relevant to sound processing design for cochlear implants particularly for algorithms that encode fundamental frequency into deep envelope modulations or into precisely timed pulsatile stimulation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bahmer A, Langner G (2009) A simulation of chopper neurons in the cochlear nucleus with wideband input from onset neurons. Biol Cybern 100:21–33. https://doi.org/10.1007/s00422-008-0276-3
Baumann U, Nobbe A (2004) Pulse rate discrimination with deeply inserted electrode arrays. Hear Res 196:49–57. https://doi.org/10.1016/j.heares.2004.06.008
Bernstein LR, Trahiotis C (2010) Accounting quantitatively for sensitivity to envelope-based interaural temporal disparities at high frequencies. J Acoust Soc Am 128:1224-1234. https://doi.org/10.1121/1.3466877
Bernstein LR, Trahiotis C (2002) Enhancing sensitivity to interaural delays at high frequencies by using “transposed stimuli.” J Acoust Soc Am 112:1026–1036. https://doi.org/10.1121/1.1497620
Bernstein LR, Trahiotis C (2009) How sensitivity to ongoing interaural temporal disparities is affected by manipulations of temporal features of the envelopes of high-frequency stimuli. J Acoust Soc Am 125:3234-3242. https://doi.org/10.1121/1.3101454
Bernstein LR, Trahiotis C (2005) The normalized correlation: accounting for binaural detection across center frequency. J Acoust Soc Am 100:3774–3784. https://doi.org/10.1121/1.417237
Bernstein LR, Trahiotis C (2014) Sensitivity to envelope-based interaural delays at high frequencies: center frequency affects the envelope rate-limitation. J Acoust Soc Am 135:808–816. https://doi.org/10.1121/1.4861251
Bianchi F, Carney LH, Dau T, Santurette S (2019) Effects of musical training and hearing loss on fundamental frequency discrimination and temporal fine structure processing: psychophysics and modeling. JARO - J Assoc Res Otolaryngol 277:263–277. https://doi.org/10.1007/s10162-018-00710-2
Cariani PA, Delgutte B (1996a) Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase invariance, pitch circularity, rate pitch, and the dominance region for pitch. J Neurophysiol 76:1717–1734. https://doi.org/10.1152/jn.1996.76.3.1717
Cariani PA, Delgutte B (1996b) Neural correlates of the pitch of complex tones. I. Pitch and Pitch Salience J Neurophysiol 76:1698–1716. https://doi.org/10.1152/jn.1996.76.3.1698
Carlyon RP, Deeks JM, McKay CM (2010) The upper limit of temporal pitch for cochlear-implant listeners: stimulus duration, conditioner pulses, and the number of electrodes stimulated. J Acoust Soc Am 127:1469–1478. https://doi.org/10.1121/1.3291981
Carlyon RP, Long CJ, Micheyl C (2012) Across-channel timing differences as a potential code for the frequency of pure tones. JARO - J Assoc Res Otolaryngol 13:159–171. https://doi.org/10.1007/s10162-011-0305-0
Cedolin L, Delgutte B (2010) Spatiotemporal representation of the pitch of harmonic complex tones in the auditory nerve. J Neurosci 30:12712–12724. https://doi.org/10.1523/JNEUROSCI.6365-09.2010
Chatterjee M, Oberzut C (2011) Detection and rate discrimination of amplitude modulation in electrical hearing. J Acoust Soc Am 130:1567–1580. https://doi.org/10.1121/1.3621445
Cohen J (1992) A Power Primer Quant Methods Psychol 112:155–159. https://doi.org/10.1037/0033-2909.112.1.155
Deeks JM, Carlyon RP (2004) Simulations of cochlear implant hearing using filtered harmonic complexes: implications for concurrent sound segregation. J Acoust Soc Am 115:1736. https://doi.org/10.1121/1.1675814
Deeks JM, Gockel HE, Carlyon RP (2013) Further examination of complex pitch perception in the absence of a place-rate match. J Acoust Soc Am 133:377–388. https://doi.org/10.1121/1.4770254
Drennan WR, Won JH, Nie K et al (2010) Sensitivity of psychophysical measures to signal processor modifications in cochlear implant users. Hear Res 262:1–8. https://doi.org/10.1016/j.heares.2010.02.003
Dreyer A, Delgutte B (2006) Phase locking of auditory-nerve fibers to the envelopes of high frequency sounds: implications for sound localization. J Neurophysiol 96:2327–2341
Driscoll VD (2013) Music appreciation and training for cochlear implant recipients: a review. Semin Hear 33:307–334. https://doi.org/10.1055/s-0032-1329222.MUSIC
Dynes SB, Delgutte B (1992) Phase-locking of auditory-nerve discharges to sinusoidal electric stimulation of the cochlea. Hear Res 58:79–90
Erfanian Saeedi N, Blamey PJ, Burkitt AN, Grayden DB (2017) An integrated model of pitch perception incorporating place and temporal pitch codes with application to cochlear implant research. Hear Res 344:135–147. https://doi.org/10.1016/j.heares.2016.11.005
Fink NE, Wang NY, Visaya J et al (2007) Childhood Development after Cochlear Implantation (CDaCI) study: design and baseline characteristics. Cochlear Implants Int 8:92–116. https://doi.org/10.1002/cii.333
Francart T, Osses A, Wouters J (2015) Speech perception with F0mod, a cochlear implant pitch coding strategy. Int J Audiol. 54:424-432. https://doi.org/10.3109/14992027.2014.989455
Fraser M, McKay CM (2012) Temporal modulation transfer functions in cochlear implantees using a method that limits overall loudness cues. Hear Res 283:59–69. https://doi.org/10.1016/j.heares.2011.11.009
Gfeller KE, Lansing CR (1991) Melodic, rhythmic, and timbral perception of adult cochlear implant users. J Speech Hear Res 34:916–920
Gfeller KE, Mallalieu RMM, Mansouri A et al (2019) Practices and attitudes that enhance music engagement of adult cochlear implant users. Front Neurosci 13:1368. https://doi.org/10.3389/fnins.2019.01368
Gfeller KE, Oleson J, Knutson JF et al (2008) Multivariate predictors of music perception and appraisal by adult cochlear implant users. J Am Acad Audiol 19:120–134. https://doi.org/10.3766/jaaa.19.2.3
Gfeller KE, Olszewski C, Turner C et al (2006) Music perception with cochlear implants and residual hearing. Audiol Neurootol 11(Suppl 1):12–15. https://doi.org/10.1159/000095608
Goldsworthy RL (2015) Correlations between pitch and phoneme perception in cochlear implant users and their normal hearing peers. J Assoc Res Otolaryngol 16:797-809. https://doi.org/10.1007/s10162-015-0541-9
Goldsworthy RL, Delhorne LA, Braida LD, Reed CM (2013) Psychoacoustic and phoneme identification measures in cochlear-implant and normal-hearing listeners. Trends Amplif 17:27–44. https://doi.org/10.1177/1084713813477244
Goldsworthy RL, Shannon RV (2014) Training improves cochlear implant rate discrimination on a psychophysical task. J Acoust Soc Am 135:334–341. https://doi.org/10.1121/1.4835735
Green T, Faulkner A, Rosen S, Macherey O (2005) Enhancement of temporal periodicity cues in cochlear implants: effects on prosodic perception and vowel identification. J Acoust Soc Am 118:375–385. https://doi.org/10.1121/1.1925827
Hay-McCutcheon MJ, Peterson NR, Pisoni DB et al (2018) Performance variability on perceptual discrimination tasks in profoundly deaf adults with cochlear implants. J Commun Disord 72:122–135. https://doi.org/10.1016/j.jcomdis.2018.01.005
Hochmair I, Hochmair E, Nopp P et al (2015) Deep electrode insertion and sound coding in cochlear implants. Hear Res 322:14–23. https://doi.org/10.1016/j.heares.2014.10.006
Hughes ML, Castioni EE, Goehring JL, Baudhuin JL (2012) Temporal response properties of the auditory nerve: data from human cochlear-implant recipients. Hear Res 285:46–57. https://doi.org/10.1016/j.heares.2012.01.010.Temporal
Kaernbach C (1991) Simple adaptive testing with the weighted up-down method. Percept Psychophys 75:227–230
Kaernbach C, Bering C (2001) Exploring the temporal mechanism involved in the pitch of unresolved harmonics. J Acoust Soc Am 110:1039–1048. https://doi.org/10.1121/1.1381535
Kalkman RK, Briaire JJ, Frijns JHM (2014) Current focussing in cochlear implants: an analysis of neural recruitment in a computational model. Hear Res 322:89–98. https://doi.org/10.1016/j.heares.2014.12.004
Kang RS, Nimmons GL, Drennan WR et al (2009) Development and validation of the University of Washington Clinical Assessment of Music Perception test. Ear Hear 30:411–418. https://doi.org/10.1097/AUD.0b013e3181a61bc0
Kidd GR, Watson CS, Gygi B (2007) Individual differences in auditory abilities. J Acoust Soc Am 122:418–435. https://doi.org/10.1121/1.2743154
Kleine Punte A, De Bodt M, Van De Heyning P (2014) Long-term improvement of speech perception with the fine structure processing coding strategy in cochlear implants. Orl 76:36–43. https://doi.org/10.1159/000360479
Kong YY, Carlyon RP (2010) Temporal pitch perception at high rates in cochlear implants. J Acoust Soc Am 127:3114–3123. https://doi.org/10.1121/1.3372713
Kong Y, Deeks JM, Axon PR, Carlyon RP (2009) Limits of temporal pitch in cochlear implants. J Acoust Soc Am 125:1649–1657. https://doi.org/10.1121/1.3068457
Kreft HA, Nelson DA, Oxenham AJ (2013) Modulation frequency discrimination with modulated and unmodulated interference in normal hearing and in cochlear-implant users. JARO - J Assoc Res Otolaryngol 14:591–601. https://doi.org/10.1007/s10162-013-0391-2
Landsberger DM (2008) Effects of modulation wave shape on modulation frequency discrimination with electrical hearing. J Acoust Soc Am 124:EL21–EL27. https://doi.org/10.1121/1.2947624
Landsberger DM, Mckay CM (2005) Perceptual differences between low and high rates of stimulation on single electrodes for cochlear implantees. J Acoust Soc Am 117:319. https://doi.org/10.1121/1.1830672
Larsen E, Cedolin L, Delgutte B (2008) Pitch representations in the auditory nerve: two concurrent complex tones. J Neurophysiol 100:1301–1319. https://doi.org/10.1152/jn.01361.2007
Loeb GE (2005) Are cochlear implant patients suffering from perceptual dissonance? Ear Hear. 26:435-450.
Loeb GE, White MW, Merzenich MM (1983) Spatial cross-correlation. Biol Cybern 47:149–163. https://doi.org/10.1007/BF00337005
Loizou PC (1999) Introduction to cochlear implants. IEEE Eng Med Biol 18:32-42.
Looi V, Gfeller KE, Driscoll VD (2012) Music appreciation and training for cochlear implant recipients: a review. Semin Hear 33:307–334. https://doi.org/10.1055/s-0032-1329222
Looi V, McDermott HJ, McKay CM, Hickson L (2008) The effect of cochlear implantation on music perception by adults with usable pre-operative acoustic hearing. Int J Audiol 47:257–268. https://doi.org/10.1080/14992020801955237
Macherey O, Carlyon RP (2014) Re-examining the upper limit of temporal pitch. J Acoust Soc Am 136:3186. https://doi.org/10.1121/1.4900917
McDermott JH, Oxenham AJ (2008) Music perception, pitch, and the auditory system. Curr Opin Neurobiol 18:452–463. https://doi.org/10.1016/j.conb.2008.09.005
McKay CM, Henshall KR, Farrell RJ, McDermott HJ (2003) A practical method of predicting the loudness of complex electrical stimuli. J Acoust Soc Am 113:2054. https://doi.org/10.1121/1.1558378
McKay CM, McDermott HJ, Clark GM (1994) Pitch percepts associated with amplitude-modulated current pulse trains in cochlear implantees. J Acoust Soc Am 96:2664–2673. https://doi.org/10.1121/1.411377
Meserole RL, Carson CM, Riley AW et al (2019) Assessment of health-related quality of life 6 years after childhood cochlear implantation. 23:721–733. https://doi.org/10.1007/s
Micheyl C, Delhommeau K, Perrot X, Oxenham AJ (2006) Influence of musical and psychoacoustical training on pitch discrimination. Hear Res 219:36–47. https://doi.org/10.1016/j.heares.2006.05.004
Micheyl C, Moore BCJ, Carlyon RP (2000) The Role of Excitation-Pattern Cues and Temporal Cues in the Frequency and Modulation-Rate Discrimination of Amplitude-Modulated Tones. 104:1039–1050
Miyazono H, Moore BCJ (2013) Implications for pitch mechanisms of perceptual learning of fundamental frequency discrimination: effects of spectral region and phase. Acoust Sci Technol 34:404–412. https://doi.org/10.1250/ast.34.404
Moore BCJ, Sek A (2009) Sensitivity of the human auditory system to temporal fine structure at high frequencies. J Acoust Soc Am 125:3186–3193. https://doi.org/10.1121/1.3106525
Niparko JK, Tobey EA, Thal DJ et al (2010) Spoken language development in children following cochlear implantation. JAMA - J Am Med Assoc 303:1498–1506. https://doi.org/10.1001/jama.2010.451
Norman-Haignere S, Kanwisher N, McDermott JH (2013) Cortical pitch regions in humans respond primarily to resolved harmonics and are located in specific tonotopic regions of anterior auditory cortex. J Neurosci 33:19451–19469. https://doi.org/10.1523/JNEUROSCI.2880-13.2013
O’Leary SJ, Richardson RR, McDermott HJ (2009) Principles of design and biological approaches for improving the selectivity of cochlear implant electrodes. J Neural Eng 6. https://doi.org/10.1088/1741-2560/6/5/055002
Oxenham AJ, Bernstein JGW, Penagos H (2004) Correct tonotopic representation is necessary for complex pitch perception. Proc Natl Acad Sci U S A 101:1421–1425. https://doi.org/10.1073/pnas.0306958101
Oxenham AJ, Micheyl C, Keebler MV et al (2011) Pitch perception beyond the traditional existence region of pitch. Proc Natl Acad Sci U S A 108:7629–7634. https://doi.org/10.1073/pnas.1015291108
Plack C, Oxenham AJ (2005) Pitch: neural coding and perception. Springer, US
Rader T, Döge J, Adel Y et al (2016) Place dependent stimulation rates improve pitch perception in cochlear implantees with single-sided deafness. Hear Res 339:94–103. https://doi.org/10.1016/j.heares.2016.06.013
Rhode WS (1997) Neural encoding of single formant stimuli in the cochlear nucleus of the chinchilla. Hear Res 117:39–56
Riss D, Hamzavi JS, Blineder M et al (2014) FS4, FS4-p, and FSP: a 4-month crossover study of 3 fine structure sound-coding strategies. Ear Hear 35:e272–e281. https://doi.org/10.1097/AUD.0000000000000063
Ritsma RJ (1967) Frequencies dominant in the perception of the pitch of complex sounds. J Acoust Soc Am 42:191–198. https://doi.org/10.1121/1.1910550
Shackleton TM, Carlyon RP (1994) The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. J Acoust Soc Am 95:3529–3540. https://doi.org/10.1121/1.409970
Shannon RV (1992) Temporal modulation transfer functions in patients with cochlear implants. J Acoust Soc Am 91:2156–2164
Smith ZM, Delgutte B, Oxenham AJ (2002) Chimaeric sounds reveal dichotomies in auditory perception. Nature 416:87–90. https://doi.org/10.1038/416087a
Spitzer ER, Landsberger DM, Friedmann DR, Galvin JJ (2019) Pleasantness ratings for harmonic intervals with acoustic and electric hearing in unilaterally deaf cochlear implant patients. Front Neurosci 13:1–17. https://doi.org/10.3389/fnins.2019.00922
Svirsky MA (2017) Cochlear implants and electronic hearing. Phys Today 52:53–58. https://doi.org/10.1063/PT.3.3661
Swanson BA, Marimuthu VMR, Mannell RH (2019) Place and Temporal Cues in Cochlear Implant Pitch and Melody Perception. 13:1–18. https://doi.org/10.3389/fnins.2019.01266
Tong YC, Clark GM (1985) Absolute identification of electric pulse rates and electrode positions by cochlear implant patients. J Acoust Soc Am 77:1881–1888
Van Canneyt J, Hofmann M, Wouters J, Francart T (2019) The effect of stimulus envelope shape on the auditory steady-state response. Hear Res 380:22–34. https://doi.org/10.1016/j.heares.2019.05.007
van Hoesel RJM, Tyler RS (2003) Speech perception, localization, and lateralization with bilateral cochlear implants. J Acoust Soc Am 113:1617. https://doi.org/10.1121/1.1539520
Vandali A, Sly D, Cowan R, van Hoesel RJM (2013) Pitch and loudness matching of unmodulated and modulated stimuli in cochlear implantees. Hear Res 302:32–49. https://doi.org/10.1016/j.heares.2013.05.004
Vandali AE, Sucher C, Tsang DJ et al (2005) Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. J Acoust Soc Am 117:3126–3138. https://doi.org/10.1121/1.1874632
Vandali AE, van Hoesel RJM (2012) Enhancement of temporal cues to pitch in cochlear implants: effects on pitch ranking. J Acoust Soc Am 132:392–402. https://doi.org/10.1121/1.4718452
Vandali AE, van Hoesel RJM (2011) Development of a temporal fundamental frequency coding strategy for cochlear implants. J Acoust Soc Am 129:4023–4036. https://doi.org/10.1121/1.3573988
Vandali AE, Whitford LA, Plant KL, Clark GM (2000) Speech perception as a function of electrical stimulation rate: using the Nucleus 24 cochlear implant system. Ear Hear 21:608–624
Verschooten E, Shamma S, Oxenham AJ et al (2019) The upper frequency limit for the use of phase locking to code temporal fine structure in humans: a compilation of viewpoints. Hear Res 377:109–121. https://doi.org/10.1016/j.heares.2019.03.011
Wouters J, Mcdermott HJ, Francart T (2015) Sound coding in cochlear implants. IEEE Signal Process Mag 67–80
Zeng FG (2002) Temporal pitch in electric hearing. Hear Res 174:101–106. https://doi.org/10.1016/S0378-5955(02)00644-5
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Goldsworthy, R.L., Bissmeyer, S.R.S. & Camarena, A. Advantages of Pulse Rate Compared to Modulation Frequency for Temporal Pitch Perception in Cochlear Implant Users. JARO 23, 137–150 (2022). https://doi.org/10.1007/s10162-021-00828-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10162-021-00828-w