Deriving Vocal Interfaces from Logical Descriptions in Multi-device Authoring Environments

  • Fabio Paternò
  • Christian Sisti
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6189)


Model-based approaches for interactive Web applications have neglected vocal interaction. However, ubiquitous multi-device environments call for better support for such modality. In this paper we present a language for logical descriptions of vocal interfaces along with a transformation for deriving corresponding implementations and show an example application. Such results have been integrated into a multi-device authoring environment.


Model-based user interface design Vocal interfaces XML-based user interface languages 


  1. 1.
    Berti, S., Paternò, F.: Model-Based Design of Speech Interfaces. In: Jorge, J.A., Jardim Nunes, N., Falcão e Cunha, J. (eds.) DSV-IS 2003. LNCS, vol. 2844, pp. 231–244. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  2. 2.
    Calvary, G., Coutaz, J., Bouillon, L., Florins, M., Limbourg, O., Marucci, L., Paternò, F., Santoro, C., Souchon, N., Thevenin, D., Vanderdonckt, J.: The CAMELEON reference framework. CAMELEON project, Deliverable 1.1 (2002)Google Scholar
  3. 3.
    Edwards, A., Pitt, I.: Design of Speech-Based devices. Springer, Heidelberg (2007)Google Scholar
  4. 4.
    Honkala, M., Pohja, M.: Multimodal interaction with XForms. In: Proceedings ICWE, pp. 201–208 (2006)Google Scholar
  5. 5.
    Lawson, J., Al-Akkad, A., Vanderdonckt, J., Macq, B.: An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components. In: Proceedings ACM EICS, pp. 245–254 (2009)Google Scholar
  6. 6.
    Lin, J., Landay, J.A.: Employing Patterns and Layers for Early-Stage Design and Prototyping of Cross-Device User Interfaces. In: Proc. CHI, pp. 1313–1322 (2008)Google Scholar
  7. 7.
    Myers, B.A., Hudson, S.E., Pausch, R.: Past, Present and Future of User Interface Software tools. ACM Trans. Comput. Hum. Interact. 7, 3–28 (2000)CrossRefGoogle Scholar
  8. 8.
    Nichols, J., Myers, B.A., Higgins, M., Hughes, J., Harris, T.K., Rosenfeld, R., Pignol, M.: Generating remote control interfaces for complex appliances. In: Proceedings ACM UIST’02, pp. 161–170 (2002)Google Scholar
  9. 9.
    Obrenovic, Z., Starcevic, D., Selic, B.: A Model-Driven Approach to Content Repurposing. IEEE Mutimedia, 62–71 (Januray-March 2004)Google Scholar
  10. 10.
    Paternò, F., Santoro, C., Spano, L.D.: MARIA: A Universal Language for Service-Oriented Applications in Ubiquitous Environment. ACM Transactions on Computer-Human Interaction 16(4), 1–30 (2009)CrossRefGoogle Scholar
  11. 11.
    Stanciulescu, A., Limbourg, Q., Vanderdonckt, J., Michotte, B., Montero, F.: A Transformational Approach for Multimodal Web User Interfaces based on UsiXML. In: Proc. ICMI, pp. 259–266 (2005)Google Scholar
  12. 12.
    Tellme.Studio Voice Browser,
  13. 13.
    Voice extensible markup language (VoiceXML) version 2.0,
  14. 14.
    XSL Transformations (XSLT) Version 2.0,
  15. 15.
    Yankelovich, N., Levow, G., Marx, M.: Designing SpeechActs: Issues in Speech User Interfaces. In: CHI 1995, pp. 369–376 (1995)Google Scholar
  16. 16.
    Voice Browser Activity (W3C),
  17. 17.
    Stanciulescu, A.: A Methodology for Developing Multimodal User Interfaces of Information Systems. Ph.D Thesis, University of Louvain (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Fabio Paternò
    • 1
  • Christian Sisti
    • 1
  1. 1.HIIS LaboratoryCNR-ISTIPisaItaly

Personalised recommendations