Chapter

Spoken Multimodal Human-Computer Dialogue in Mobile Environments

Volume 28 of the series Text, Speech and Language Technology pp 329-348

Effects of Prolonged Use on the Usability of a Multimodal Form-Filling Interface

  • Janienke SturmAffiliated withVassar CollegeDepartment Language and Speech, University of Nijmegen
  • , Bert CranenAffiliated withVassar CollegeDepartment Language and Speech, University of Nijmegen
  • , Jacques TerkenAffiliated withVassar CollegeDepartment of Industrial Design, TU Eindhoven
  • , Ilse BakxAffiliated withVassar CollegeDepartment of Industrial Design, TU Eindhoven

* Final gross prices may vary according to local VAT.

Get Access

Abstract

We present a study of the effect of prolonged use on the way users interact with a multimodal form-filling system. The system accepts spoken input as well as pointing input and provides output both in speech and in graphics. We measured the usability of the system in a pre-test / post-test design and analysed in detail the changes in interaction patterns due to exposure. The study shows that with practice users learn to develop interaction patterns that ensure reliable and efficient interaction, resulting in decreased dialogue duration and more user satisfaction.

Keywords

Dialogue management Multimodal interaction Speech/pen-based interaction Usability evaluation