Understanding Formal Description of Pitch-Based Input

  • Ondřej Poláček
  • Zdeněk Míkovec
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6409)


The pitch-based input (humming, whistling, singing) in acoustic modality has already been studied in several projects. There is also a formal description of the pitch-based input which can be used by designers to define user control of an application. However, as we discuss in this paper, the formal description can contain semantic errors. The aim of this paper is to validate the formal description with designers. We present a tool that is capable of visualizing vocal commands and detecting semantic errors automatically. We have conducted a user study that brings preliminary results on comprehension of the formal description by designers and ability to identify and remove syntactic errors.


Non-verbal Vocal Interaction Vocal Gesture Formal Description User Study 


  1. 1.
    Harada, S., Landay, J.A., Malkin, J., Li, X., Bilmes, J.A.: The vocal joystick: evaluation of voice-based cursor control techniques. In: Proceedings of ASSETS 2006, pp. 197–204. ACM Press, New York (2006)Google Scholar
  2. 2.
    Hämäläinen, P., Mäki-Patola, T., Pulkki, V., Airas, M.: Musical computer games played by singing. In: 7th International Conference on Digital Audio Effects, pp. 367–371 (2004)Google Scholar
  3. 3.
    Igarashi, T., Hughes, J.: Voice as sound: using non-verbal voice input for interactive control. In: Proceedings of UIST 2001, pp. 155–156. ACM Press, New York (2001)Google Scholar
  4. 4.
    MIDI Manufacturers Association: Complete MIDI 1.0 Detailed Specification v96.1, 2nd edn. (2001),
  5. 5.
    Poláček, O., Míkovec, Z., Sporka, A.J., Slavík, P.: New way of vocal interface design: Formal description of non-verbal vocal gestures. In: Proceedings of the CWUAAT 2010, pp. 137–144. Cambridge Press, UK (2010)Google Scholar
  6. 6.
    Sporka, A.J., Kurniawan, M., Slavík, P.: Non-speech Operated Emulation of Keyboard. In: Designing Accessible Technology, pp. 145–154. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Sporka, A.J., Kurniawan, S.H., Mahmud, M., Slavík, P.: Non-speech Input vs Speech Recognition: Real-time Control of Computer Games. In: Proceedings of ASSETS 2006, pp. 213–220. ACM Press, New York (2006)Google Scholar
  8. 8.
    Sporka, A.J., Žikovský, P., Slavík, P.: Explicative Document Reading Controlled by Non-speech Audio Gestures. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2006. LNCS (LNAI), vol. 4188, pp. 695–702. Springer, Heidelberg (2006)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2010

Authors and Affiliations

  • Ondřej Poláček
    • 1
  • Zdeněk Míkovec
    • 1
  1. 1.Faculty of Electrical EngineeringCzech Technical University in PraguePrague 2Czech Republic

Personalised recommendations