Abstract
Front-end speech enhancement methods based on microphone array are helpful to improve the front-end signal quality and speech recognition in cochlear implant. However, the size constraint will limit the available quantity of microphones. In this paper, we propose a dual-microphone signal acquisition method based on four acoustic tubes, and analyze the signal acquisition characteristics and beamforming feature. We research four types of beamforming mode to suit to the speech enhancement demand for cochlear implant, and further summarize the corresponding beamforming direction feature and the influence of different inter-microphone distances. The algorithm proposed in this paper has the characteristics of low computation, few microphones, and multiple sound tubes, and can meet the de-noising requirements of various specific application scenarios of cochlear implant.
Similar content being viewed by others
Data Availability
The program data used in this study are available from the corresponding author on reasonable request.
Code Availability
The program code used in this study are available from the corresponding author on reasonable request.
References
Jaekel, B. N., Weinstein, S., Newman, R. S., & Goupell, M, J. (2021). Few cochlear-implant listeners employ speech repair strategies in noisy listening scenarios. In 20th Conference on Implantable Auditory Prostheses, Lake Tahoe.
Fletcher, M. D., Song, H., & Perry, S. W. (2020). Electro-haptic stimulation enhances speech recognition in spatially separated noise for cochlear implant users. Scientific Reports, 10, 12723.
Zhang, K. Y., Guo, H., Wu, S., et al. (2016). Recent advances and challenges in the study of optical cochlea (in Chinese). Chinese Journal of Otolaryngology Head and Neck Surgery, 51, 73–77.
Jiang, B., Xia, N., Wang, X., et al. (2017). Auditory responses to short-wavelength infrared neural stimulation of the rat cochlear nucleus. In 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Seogwipo, pp. 1942–1945.
Guan, T., Yang, M., Wei, Z., et al. (2017). Simulation of the optical stimulation mechanism of cochlear nerves. Journal of Tsinghua University, 57(10), 1102–1105.
Wang, J., Lu, J., & Tian, L. (2017). Effect of fiberoptic collimation technique on 808 nm wavelength laser stimulation of cochlear neurons. Photomedicine & Laser Surgery, 34(6), 1–6.
Poluboina, V., Pulikala, A., & Muthu, A. N. P. (2022). Contribution of frequency compressed temporal fine structure cues to the speech recognition in noise: An implication in cochlear implant signal processing. Applied Acoustics, 189, 108616.
Moore, B. J. C. (2019). The roles of temporal envelope and fine structure information in auditory perception. Acoustical Science and Technology, 40(2), 61–83.
Geng, Y. Z., Zhang, T., Yaw, M. S., & Wang, H. (2022). A speech enhancement method based on the combination of microphone array and parabolic reflector. Journal of the Audio Engineering Society: Audio, Acoustics, Applications, 70(1), 5–23.
Müller, V., Krause, J., Klünter, H. D., Streicher, B., & Lang-Roth, R. (2022). Speech perception in noise and sound localization using different microphone modes in pediatric bilateral cochlear implant users. International Journal of Pediatric Otorhinolaryngology, 156, 111117.
Fischer, T., Schmid, C., Kompis, M., Mantokoudis, G., & Wimmer, W. (2020). Pinna-imitating microphone directionality improves sound localization and discrimination in bilateral cochlear implant users. Ear and Hearing, 42(1), 214–222.
Wimmer, W., Kompis, M., Stieger, C., et al. (2017). Directional microphone contralateral routing of signals in cochlear implant users: A within-subjects comparison. Ear and Hearing, 38(3), 368–373.
Mosnier, I., Mathias, N., Flament, J., et al. (2017). Benefit of the UltraZoom beamforming technology in noise in cochlear implant users. European Archives of Oto-Rhino-Laryngology, 274(9), 3335–3342.
Kevin, C., Leslie, C., Boyla, M. (2021). A causal deep learning framework for classifying phonemes in cochlear implants. In 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 6498–6502), Toronto.
Tan, K., & Wang, D. L. (2021). Towards model compression for deep learning based speech enhancement. IEEE/ACM Transactions on Audio Speech Language Processing, 29, 1785–1794.
Ahsan, A., Mandar, G., Amir, H., & William, M. W. (2021). Lip-reading driven deep learning approach for speech enhancement. IEEE Transactions on Emerging Topics in Computational Intelligence, 5(3), 481–490.
Nossier, S. A., Wall, J., Moniri, M., Glackin, C., & Cannings, N. (2020). Mapping and Masking Targets Comparison using Different Deep Learning based Speech Enhancement Architectures. In International Joint Conference on Neural Networks, Glasgow, pp. 1–8.
Ma, L. S., He, P. Y., Cui, A., & Yu, W. C. (2022). Adaptive beamforming method based on MISC array in non-uniform noise. Journal of Signal Processing, 38(2), 268–275.
Du, Y. X., Xu, H. Y., Cui, W. J., Jian, C. X., & Zhang, J. (2022). Adaptive beamforming algorithm for coprime array based on interference and noise covariance matrix reconstruction. IET Radar, Sonar & Navigation, 16(4), 668–677.
Hu, B., Wu, X. C., Zhang, X., et al. (2018). Adaptive beamforming based on compressed sensing with gain/phase uncertainties. IEICE Transactions on Fundamentals of Electronics Communications & Computer Sciences, 101(8), 1257–1262.
Lockwood, M. E., Jones, D. L., Bilger, R. C., et al. (2004). Performance of time- and frequency-domain binaural beamformers based on recorded signals from real rooms. The Journal of the Acoustical Society of America, 115(1), 379–391.
Fumero, M. J., Eustaquio-Martín, A., Gorospe, J. M., et al. (2021). A state-of-the-art implementation of a binaural cochlear-implant sound coding strategy inspired by the medial olivocochlear reflex. Hearing Research, 409, 1–14.
Enrique, A. L., Almudena, E. M., Joshua, S. S., et al. (2017). Intelligibility in speech maskers with a binaural cochlear implant sound coding strategy inspired by the contralateral medial olivocochlear reflex. Hearing Research, 348, 134–137.
Sheffield, B. M., Schuchman, G., & Jgw, B. (2017). Pre- and postoperative binaural unmasking for bimodal cochlear implant listeners. Ear and Hearing, 38(5), 554–567.
Goupell, M. J., Stakhovskaya, O. A., & Jgw, B. (2018). Contralateral interference caused by binaurally presented competing speech in adult bilateral cochlear-implant users. Ear and Hearing, 39(1), 110–123.
Acknowledgements
This work was support by the characteristic innovation projects of Guangdong Universities in 2019 under the grant No. 2019GKTSCX094.
Funding
This work was support by the characteristic innovation projects of Guangdong Universities in 2019 under the grant No. 2019GKTSCX094.
Author information
Authors and Affiliations
Contributions
Yousheng Chen initiated and conceived the algorithm, designed simulation experiments and analyzed the algorithm feature, he is the corresponding author and is responsible for revising this manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The author declare that there is no conflict of interests regarding the publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, Y. Research on Four Acoustic Tube Signal Acquisition Based on Dual-Microphone Mode and Parameter Feature for Cochlear Implant. Wireless Pers Commun 132, 147–162 (2023). https://doi.org/10.1007/s11277-023-10604-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-023-10604-z