UI Prototyping for Multiple Devices Through Specifying Interaction Design

  • Jürgen Falb
  • Roman Popp
  • Thomas Röck
  • Helmut Jelinek
  • Edin Arnautovic
  • Hermann Kaindl
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4662)


While user interface (UI) prototyping is generally considered useful, it may often be too expensive and time-consuming. This problem becomes even more severe through the ubiquitous use of a variety of devices such as PCs, mobile phones and PDAs, since each of these devices has its own specifics that require a special user interface.

Instead of developing UI prototypes directly, we propose specifying one interaction design from which UIs can be automatically generated for multiple devices. Our implemented approach uses communicative acts, which derive from speech act theory and carry desired intentions in interactions. Models of communicative acts, UI domain objects and interaction sequences comprise interaction design specifications in our approach and are based on a metamodel that we have defined. We support the development of such models through an IDE, which is coupled with the UI generator. This allows a new form of UI prototyping, where the effects of each model change can be seen immediately in the automatically generated UIs for every device at once.


User Interface Propositional Content Interaction Design Generate User Interface Multiple Device 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: Using communicative acts in interaction design specifications for automated synthesis of user interfaces. In: ASE 2006. Proceedings of the 21th IEEE/ACM International Conference on Automated Software Engineering, Piscataway, NJ, USA, pp. 261–264. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  2. 2.
    Falb, J., Popp, R., Röck, T., Jelinek, H., Arnautovic, E., Kaindl, H.: Fully-automatic generation of user interfaces for multiple devices from a high-level model based on communicative acts. In: HICSS-40. Proceedings of the 40th Annual Hawaii International Conference on System Sciences, Piscataway, NJ, USA, Jan 2007, IEEE Computer Society Press, Los Alamitos (2007)Google Scholar
  3. 3.
    Searle, J.R.: Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press, Cambridge, England (1969)CrossRefGoogle Scholar
  4. 4.
    Foundation for Intelligent Physical Agents: FIPA communicative act library specification. Technical report, Foundation for Intelligent Physical Agents (2002),
  5. 5.
    W3C: OWL Web Ontology Language Reference (2004),
  6. 6.
    Rosenberg, D.: Revisiting tangible speculation: 20 years of UI prototyping. interactions 13(1), 31–32 (2006)CrossRefGoogle Scholar
  7. 7.
    Snyder, C.: Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces (The Morgan Kaufmann Series in Interactive Technologies). Morgan Kaufmann, San Francisco (2003)Google Scholar
  8. 8.
    Sefelin, R., Tscheligi, M., Giller, V.: Paper prototyping — What is it good for?: A comparison of paper- and computer-based low-fidelity prototyping. In: CHI 2003. Extended Abstracts on Human Factors in Computing Systems, pp. 778–779. ACM Press, New York, NY, USA (2003)Google Scholar
  9. 9.
    Janssen, C., Weisbecker, A.: Generating user interfaces from data models and dialogue net specifications. In: CHI 1993. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 418–423. ACM Press, New York, NY, USA (1993)Google Scholar
  10. 10.
    Elkoutbi, M.: Automated prototyping of user interfaces based on UML scenarios. Automated Software Engg. 13(1), 5–40 (2006)CrossRefGoogle Scholar
  11. 11.
    Puerta, A., Micheletti, M., Mak, A.: The UI pilot: A model-based tool to guide early interface design. In: IUI 2005. Proceedings of the 10th International Conference on Intelligent User Interfaces, pp. 215–222. ACM Press, New York, NY, USA (2005)Google Scholar
  12. 12.
    Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., López-Jaquero, V.: USIXML: A language supporting multi-path development of user interfaces. In: EHCI/DS-VIS, pp. 200–220 (2004)Google Scholar
  13. 13.
    van Setten, M., van der Veer, G.C., Brinkkemper, S.: Comparing interaction design techniques: A method for objective comparison to find the conceptual basis for interaction design. In: DIS 1997. Proceedings of the Conference on Designing Interactive Systems, Amsterdam, The Netherlands, pp. 349–357. ACM Press, New York, NY, USA (1997)Google Scholar
  14. 14.
    Abrams, M., Phanouriou, C.: UIML: An XML language for building device-independent user interfaces. In: Proceedings of the XML 99 (1999)Google Scholar
  15. 15.
    Seffah, A., Forbrig, P., Javahery, H.: Multi-devices “Multiple” user interfaces: development models and research opportunities. J. Syst. Softw. 73(2), 287–300 (2004)CrossRefGoogle Scholar
  16. 16.
    Mori, G., Paterno, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Transactions on Software Engineering 30(8), 507–520 (2004)CrossRefGoogle Scholar
  17. 17.
    Gajos, K., Weld, D.S.: SUPPLE: Automatically generating user interfaces. In: IUI 2004. Proceedings of the 9th International Conference on Intelligent User Interfaces, pp. 93–100. ACM Press, New York (2004)Google Scholar
  18. 18.
    Eisenstein, J., Vanderdonckt, J., Puerta, A.: Applying model-based techniques to the development of UIs for mobile computers. In: IUI 2001. Proceedings of the 6th International Conference on Intelligent User Interfaces, pp. 69–76. ACM Press, New York (2001)Google Scholar
  19. 19.
    Want, R., Pering, T.: System challenges for ubiquitous & pervasive computing. In: ICSE 2005, pp. 9–14. ACM Press, New York (2005)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2007

Authors and Affiliations

  • Jürgen Falb
    • 1
  • Roman Popp
    • 1
  • Thomas Röck
    • 2
  • Helmut Jelinek
    • 2
  • Edin Arnautovic
    • 1
  • Hermann Kaindl
    • 1
  1. 1.Vienna University of Technology, ICT, A-1040 ViennaAustria
  2. 2.Siemens Austria, PSE, A-1210 ViennaAustria

Personalised recommendations