Human-Computer Interaction – INTERACT 2011

Volume 6946 of the series Lecture Notes in Computer Science pp 11-29

Voice Games: Investigation Into the Use of Non-speech Voice Input for Making Computer Games More Accessible

  • Susumu HaradaAffiliated withIBM Research – Tokyo
  • , Jacob O. WobbrockAffiliated withThe Information School, DUB Group, University of Washington
  • , James A. LandayAffiliated withComputer Science and Engineering, DUB Group, University of Washington


We conducted a quantitative experiment to determine the performance characteristics of non-speech vocalization for discrete input generation in comparison to existing speech and keyboard input methods. The results from the study validated our hypothesis that non-speech voice input can offer significantly faster discrete input compared to a speech-based input method by as much as 50%. Based on this and other promising results from the study, we built a prototype system called the Voice Game Controller that augments traditional speech-based input methods with non-speech voice input methods to make computer games originally designed for the keyboard and mouse playable using voice only. Our preliminary evaluation of the prototype indicates that the Voice Game Controller greatly expands the scope of computer games that can be played hands-free using just voice, to include games that were difficult or impractical to play using previous speech-based methods.


Computer games accessible games speech recognition non-speech vocalization