Abstract
How to relate audio and visual perceptual results on bimodal timing — obtained through desynchronization — to the behavioural analysis of visible oro-facial movements in the frame of competing coarticulation models? The coherence of the perceptual building up of audio, visual, and AV, was explored for vowel-to-vowel gestures through acoustic pauses. Results support the claim that the natural audio delay relative to the anticipated visual signal can be reduced by desynchronization without affecting intelligibility, as long as the configurational visual cues remain in accordance with the sound. A related exploration of anticipatory behaviour on the speech production side led us to develop a new coarticulation model, the MEM (Movement expansion model). In this framework results found from zero to large intervocalic intervals fall fairly well within the range of sensitivities obtained for intelligibility in AV desynchronization experiments, thus offering a production rationale for the perceptual phenomenology of bimodal speech coherence.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Abry, C., Lallouache, MT., Cathiard, MA. (1996). How can coarticulation models account for speech sensitivity to audio-visual desynchronization?. In: Stork, D.G., Hennecke, M.E. (eds) Speechreading by Humans and Machines. NATO ASI Series, vol 150. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-13015-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-662-13015-5_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-08252-8
Online ISBN: 978-3-662-13015-5
eBook Packages: Springer Book Archive