Differential Prefrontal Response during Natural and Synthetic Speech Perception: An fNIR Based Neuroergonomics Study
Synthetic speech has a growing role in human computer interaction and automated systems with the emergence of ubiquitous computing such as smart phones, car multimedia control and navigation systems. Cognitive processing costs associated with comprehension of synthetic speech relative to comprehension of natural speech have been demonstrated with behavioral (reaction time, accuracy, etc.) and self-reported (ratings, etc.) measures. In this neuroergonomics study, we have used optical brain imaging (fNIR: functional near infrared spectroscopy) to capture the brain activation of participants while they were listening to speech with varied quality, as well as natural speech. Results indicated a differential hemodynamic response with speech quality. As fNIR systems are safe, portable and record brain activation in real world settings, fNIR is a practical and minimally intrusive assessment tool for user experience researchers and can provide an objective metric for the design and development of next generation synthetic speech systems.
KeywordsOptical Brain Imaging functional near infrared spectroscopy fNIR synthetic speech perception auditory processing
Unable to display preview. Download preview PDF.
- 8.Ayaz, H., Shewokis, P.A., İzzetoğlu, M., Çakır, M.P., Onaral, B.: Tangram solved? Prefrontal cortex activation analysis during geometric problem solving. In: 34th Annual International IEEE EMBS Conference, pp. 4724–4727. IEEE (2012)Google Scholar
- 9.Çiftçi, K., Sankur, B., Kahya, Y.P., Akın, A.: Functional Clusters in the Prefrontal Cortex during Mental Arithmetic. In: 16th European Signal Processing Conference (EUSIPCO 2008), Lausanne, Switzerland, pp. 1–4 (2008)Google Scholar
- 12.Power, S.D., Kushki, A., Chau, T.: Towards a system-paced near-infrared spectroscopy brain-computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state. Journal of Neural Engineering 8, 066004 (2011)Google Scholar
- 13.Ayaz, H., Cakir, M.P., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S.C., Onaral, B.: Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging. In: Aerospace Conference, 2012 IEEE, pp. 1–11 (2012)Google Scholar
- 14.Shewokis, P.A., Ayaz, H., Izzetoglu, M., Bunce, S., Gentili, R.J., Sela, I., Izzetoglu, K., Onaral, B.: Brain in the Loop: Assessing Learning Using fNIR in Cognitive and Motor Tasks. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) FAC 2011. LNCS, vol. 6780, pp. 240–249. Springer, Heidelberg (2011)CrossRefGoogle Scholar
- 19.ITU-T: Recommendation P.835 Subjective test methodology for evaluating speech communication systems that include noise suppression algorithm, vol. (11/2003). International Telecommunication Union, Geneva (2003) Google Scholar
- 20.Ayaz, H., Izzetoglu, M., Platek, S.M., Bunce, S., Izzetoglu, K., Pourrezaei, K., Onaral, B.: Registering fNIR data to brain surface image using MRI templates. In; Conf. Proc. IEEE Eng. Med. Biol. Soc., pp. 2671–2674 (2006)Google Scholar
- 21.Ayaz, H., Shewokis, P.A., Curtin, A., Izzetoglu, M., Izzetoglu, K., Onaral, B.: Using MazeSuite and Functional Near Infrared Spectroscopy to Study Learning in Spatial Navigation. J. Vis. Exp., e3443 (2011)Google Scholar
- 22.Ayaz, H., Izzetoglu, M., Shewokis, P.A., Onaral, B.: Sliding-window Motion Artifact Rejection for Functional Near-Infrared Spectroscopy. In: Conf. Proc. IEEE Eng. Med. Biol. Soc., pp. 6567–6570 (2010)Google Scholar
- 25.Paas, F.G.W.C., Van Merriënboer, J.J.G.: The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human Factors: The Journal of the Human Factors and Ergonomics Society 35, 737–743 (1993)Google Scholar