Service-Interaction Descriptions: Augmenting Services with User Interface Models

  • Jo Vermeulen
  • Yves Vandriessche
  • Tim Clerckx
  • Kris Luyten
  • Karin Coninx
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4940)


Semantic service descriptions have paved the way for flexible interaction with services in a mobile computing environment. Services can be automatically discovered, invoked and even composed. On the contrary, the user interfaces for interacting with these services are often still designed by hand. This approach poses a serious threat to the overall flexibility of the system. To make the user interface design process scale, it should be automated as much as possible. We propose to augment service descriptions with high-level user interface models to support automatic user interface adaptation. Our method builds upon OWL-S, an ontology for Semantic Web Services, by connecting a collection of OWL-S services to a hierarchical task structure and selected presentation information. This allows end-users to interact with services on a variety of platforms.


Model-based user interface development Semantic web services Screen layout Automatic generation of user interfaces User interface design Ubiquitous computing 


  1. 1.
    Abrams, M., Phanouriou, C.: Uiml: An XML language for building device-independent user interfaces. In: XML 1999, Philadelphia, USA (1999)Google Scholar
  2. 2.
    Berners-Lee, T., Hendler, J., Lassila, O.: The Semantic Web. Scientific American 284(5), 34–43 (2001)CrossRefGoogle Scholar
  3. 3.
    Borning, A.H.: Thinglab-a constraint-oriented simulation laboratory. PhD thesis (1979)Google Scholar
  4. 4.
    Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Florins, M., Vanderdonckt, J.: Plasticity of user interfaces: A revised reference framework. In: Proceedings of 1st International Workshop on TAsk MOdels and DIAgrams for user interface design, pp. 127–134 (2002)Google Scholar
  5. 5.
    Clerckx, T., Van den Bergh, J., Coninx, K.: Modeling multi-level context influence on the user interface. In: PerCom Workshops, pp. 57–61 (2006)Google Scholar
  6. 6.
    Clerckx, T., Vandervelpen, C., Luyten, K., Coninx, K.: A Prototype-Driven Development Process for Context-Aware User Interfaces. In: Proceedings of the 5th International Workshop on TAsk MOdels and DIAgrams for user interface design, Diepenbeek, Belgium (October 2006)Google Scholar
  7. 7.
    Coninx, K., Luyten, K., Vandervelpen, C., Van den Bergh, J., Creemers, B.: Dygimes: Dynamically generating interfaces for mobile computing devices and embedded systems. In: Chittaro, L. (ed.) Mobile HCI 2003. LNCS, vol. 2795. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  8. 8.
    Olsen Jr., D.R., Jefferies, S., Nielsen, T., Moyes, W., Fredrickson, P.: Cross-modal interaction using xweb. In: UIST 2000: Proceedings of the 13th annual ACM symposium on User interface software and technology, pp. 191–200 (2000)Google Scholar
  9. 9.
    Demeure, A., Calvary, G., Coutaz, J., Vanderdonckt, J.: The comets inspector: Towards run time plasticity control based on a semantic network. In: Proceedings of the 5th International Workshop on TAsk MOdels and DIAgrams for user interface design, Diepenbeek, Belgium (October 2006)Google Scholar
  10. 10.
    Eisenstein, J., Vanderdonckt, J., Puerta, A.: Applying model-based techniques to the development of UIs for mobile computers. In: IUI 2001: Proceedings of the 6th international conference on Intelligent user interfaces, pp. 69–76. ACM Press, New York (2001)Google Scholar
  11. 11.
    Gruber, T.R.: A translation approach to portable ontology specifications. Knowl. Acquis. 5(2), 199–220 (1993)CrossRefGoogle Scholar
  12. 12.
    Badros, G.J., Borning, A., Stuckey, P.J.: The cassowary linear arithmetic constraint solving algorithm. ACM Trans. On Computer-Human Interaction 8(4), 267–306 (2001)CrossRefGoogle Scholar
  13. 13.
    Kassoff, M., Kato, D., Mohsin, W.: Creating guis for web services. IEEE Internet Computing 7(5), 66–73 (2003)CrossRefGoogle Scholar
  14. 14.
    Khushraj, D., Lassila, O.: Ontological approach to generating personalized user interfaces for web services. In: International Semantic Web Conference, pp. 916–927 (2005)Google Scholar
  15. 15.
    Lafon, Y.: Web Services Activity Statement (2002),
  16. 16.
    Limbourg, Q.: Multi-Path Development of User Interfaces, Ph. D. Thesis. PhD thesis (September 2004)Google Scholar
  17. 17.
    Lok, S., Feiner, S., Ngai, G.: Evaluation of visual balance for automated layout. In: IUI 2004: Proceedings of the 9th international conference on Intelligent user interfaces, pp. 101–108 (2004)Google Scholar
  18. 18.
    Lonczewski, F., Schreiber, S.: The fuse-system: an integrated user interface design environment. In: Proceedings of the Second International Workshop on Computer-Aided Design of User Interfaces 1996, pp. 37–56 (1996)Google Scholar
  19. 19.
    Luyten, K., Clerckx, T., Coninx, K., Vanderdonckt, J.: Derivation of a dialog model from a task model by activity chain extraction. In: Jorge, J.A., Jardim Nunes, N., Falcão e Cunha, J. (eds.) DSV-IS 2003. LNCS, vol. 2844, pp. 203–217. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  20. 20.
    Luyten, K., Vermeulen, J., Coninx, K.: Constraint adaptability of multidevice user interfaces. In: Workshop on The Many Faces of Consistency, CHI 2006 workshop (April 2006)Google Scholar
  21. 21.
    Manolescu, I., Brambilla, M., Ceri, S., Comai, S., Fraternali, P.: Model-driven design and deployment of service-enabled web applications. ACM Trans. Inter. Tech. 5(3), 439–479 (2005)CrossRefGoogle Scholar
  22. 22.
    Paterno, F.: Model-Based Design and Evaluation of Interactive Applications. Springer, London (1999)zbMATHGoogle Scholar
  23. 23.
    Ponnekanti, S., Lee, B., Fox, A., Hanrahan, P., Winograd, T.: Icrafter: A service framework for ubiquitous computing environments. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201. Springer, Heidelberg (2001)Google Scholar
  24. 24.
    Sinnig, D., Gaffar, A., Reichart, D., Seffah, A., Forbrig, P.: Patterns in model-based engineering. In: Proceedings of Fourth International Conference on Computer-Aided Design of User Interfaces, pp. 195–208 (2004)Google Scholar
  25. 25.
    Lohmann, S., Kaltz, J.W., Ziegler, J.: Dynamic generation of context-adaptive web user interfaces through model interpretation. In: Proceedings of Model Driven Design of Advanced User Interfaces 2006 (October 2006)Google Scholar
  26. 26.
    Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36(7), 75–84 (1993)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Jo Vermeulen
    • 1
  • Yves Vandriessche
    • 1
  • Tim Clerckx
    • 1
  • Kris Luyten
    • 1
  • Karin Coninx
    • 1
  1. 1.Expertise Centre for Digital Media – IBBTHasselt University – transnationale Universiteit LimburgDiepenbeekBelgium

Personalised recommendations