Skip to main content
SpringerLink
Log in

UI2Ont—A Formal Ontology on User Interfaces and Interactions

  • Chapter
Semantic Models for Adaptive Interactive Systems

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

Formal models of user interfaces are widely popular in the literature, and various user interface description languages exist. For several use cases, the use of ontologies as models for user interfaces has been discussed, leveraging the advantages of a machine-interpretable semantics of user interface components. However, a comprehensive ontology of user interfaces and interactions is not available. In this chapter, we discuss the UI 2 Ont ontology, an ontology of user interfaces and interactions, which reuses many concepts defined in different user interface description languages and grounds them in the formal top level ontology DOLCE. We discuss the rationales of developing the ontology, give an overview of its basic concepts, and show its application in a framework for application integration on the user interface level.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.ke.tu-darmstadt.de/resources/ui2-ontology.

  2. 2.

    The fourth level, the final user interface level, consists of the interface as such, i.e., binary code, and therefore usually does not involve any model.

  3. 3.

    Image sources: http://www.flickr.com/photos/anachrocomputer/2574918867/, http://zetcode.com/tutorials/javaswttutorial/widgets/, accessed April 20th, 2011.

References

  • Aßmann, U., Zschaler, S., & Wagner, G. (2006). Ontologies, meta-models, and the model-driven paradigm. In Ontologies for software engineering and software technology (pp. 249–273). Chap. 9.

    Chapter  Google Scholar 

  • Atkinson, C., Gutheil, M., & Kiko, K. (2006). On the relationship of ontologies and models. In S. Brockmans, J. Jung & Y. Sure (Eds.), LNI: Vol. 96. Workshop on meta-modelling (WoMM) (pp. 47–60). Bonn: GI.

    Google Scholar 

  • Babitski, G., Probst, F., Hoffmann, J., & Oberle, D. (2009). Ontology design for information integration in catastrophy management. In Proceedings of the 4th international workshop on applications of semantic technologies (AST’09).

    Google Scholar 

  • Babitski, G., Bergweiler, S., Grebner, O., Oberle, D., Paulheim, H., & Probst, F. (2011). SoKNOS—using semantic technologies in disaster management software. In The semantic web: research and applications (ESWC 2011), Part II (pp. 183–197).

    Google Scholar 

  • Bottazzi, E., Catenacci, C., Gangemi, A., & Lehmann, J. (2006). From collective intentionality to intentional collectives: an ontological perspective. Cognitive Systems Research, 7(2–3), 192–208.

    Article  Google Scholar 

  • Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., & Vanderdonckt, J. (2003). A unifying reference framework for multi-target user interfaces. Interacting With Computers, 15(3), 289–308.

    Article  Google Scholar 

  • Coutaz, J., Lachenal, C., & Dupuy-Chessa, S. (2003). Ontology for multi-surface interaction. In Proceedings of IFIP INTERACT03: human–computer interaction (pp. 447–454). IFIP Technical Committee No 13 on Human-Computer Interaction.

    Google Scholar 

  • Fernández, M., Gómez-Pérez, A., & Juristo, N. (1997). METHONTOLOGY: from ontological art towards ontological engineering. In Proceedings of the AAAI97 spring symposium (pp. 33–40).

    Google Scholar 

  • Foundation for Intelligent Physical Agents (2002). FIPA device ontology specification. http://www.fipa.org/specs/fipa00091/index.html.

  • Fowler, M. (2003). Patterns of enterprise application architecture. Reading: Addison-Wesley.

    Google Scholar 

  • Gangemi, A., & Mika, P. (2003). Understanding the semantic web through descriptions and situations. In LNCS: Vol. 2888. On the move to meaningful internet systems 2003: CoopIS, DOA, and ODBASE (pp. 689–706). Berlin: Springer.

    Chapter  Google Scholar 

  • Gangemi, A., Borgo, S., Catenacci, C., & Lehmann, J. (2005). Task taxonomies for knowledge content. http://www.loa-cnr.it/Papers/D07_v21a.pdf.

  • Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge Acquisition, 5(2), 199–220.

    Article  Google Scholar 

  • Gruber, T. R. (1995). Toward principles for the design of ontologies used for knowledge sharing. International Journal of Human-Computer Studies, 43(5–6), 907–928.

    Article  Google Scholar 

  • Guarino, N., & Welty, C. A. (2009). An overview of OntoClean. In Handbook on ontologies (pp. 201–220). Chap. 10.

    Chapter  Google Scholar 

  • Guerrero-Garcia, J., Gonzalez-Calleros, J. M., Vanderdonckt, J., & Munoz-Arteaga, J. (2009). A theoretical survey of user interface description languages: preliminary results. In LA-WEB ’09: Proceedings of the 2009 Latin American web congress (LA-WEB 2009) (pp. 36–43). Los Alamitos: IEEE Comput. Soc.

    Chapter  Google Scholar 

  • Happel, H.-J., Korthaus, A., Seedorf, S., & Tomczyk, P. (2006). KOntoR: an ontology-enabled approach to software reuse. In K. Zhang, G. Spanoudakis & G. Visaggio (Eds.), Proceedings of the eighteenth international conference on software engineering & knowledge engineering (SEKE) (pp. 349–354).

    Google Scholar 

  • Henninger, S., Keshk, M., & Kinworthy, R. (2003). Capturing and disseminating usability patterns with semantic web technology. In CHI 2003 workshop: concepts and perspectives on HCI patterns.

    Google Scholar 

  • Jordà, S., Geiger, G., Alonso, M., & Kaltenbrunner, M. (2007). The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proceedings of the 1st international conference on tangible and embedded interaction (pp. 139–146). New York: ACM.

    Chapter  Google Scholar 

  • Kohlhase, A., & Kohlhase, M. (2009). Semantic transparency in user assistance systems. In Proceedings of the 27th annual ACM international conference on design of communication. Special interest group on design of communication (SIGDOC-09), Bloomingtion, IN, United States (pp. 89–96). New York: ACM Special Interest Group for Design of Communication, ACM.

    Google Scholar 

  • Laszlo Systems (2006). OpenLaszlo—an open architecture framework for advanced Ajax applications. http://www.openlaszlo.org/whitepaper/LaszloWhitePaper.pdf.

  • Liu, B., Chen, H., & He, W. (2005). Deriving user interface from ontologies: a model-based approach. In ICTAI ’05: Proceedings of the 17th IEEE international conference on tools with artificial intelligence (pp. 254–259). Los Alamitos: IEEE Comput. Soc.

    Google Scholar 

  • Masolo, C., Borgo, S., Gangemi, A., Guarino, N., & Oltramari, A. (2003). WonderWeb deliverable D18—ontology library (final). http://wonderweb.semanticweb.org/deliverables/documents/D18.pdf.

  • Mozilla (2011). XUL. https://developer.mozilla.org/en/XUL.

  • Myers, B. A., & Rosson, M. B. (1992). Survey on user interface programming. In CHI ’92: Proceedings of the SIGCHI conference on human factors in computing systems (pp. 195–202). New York: ACM.

    Chapter  Google Scholar 

  • OASIS (2009). User Interface Markup Language (UIML) version 4.0. http://docs.oasis-open.org/uiml/v4.0/uiml-4.0.html.

  • Oberle, D., Grimm, S., & Staab, S. (2009). An ontology for software. In Handbook on ontologies (pp. 383–402). Chap. 18.

    Chapter  Google Scholar 

  • Paternò, F., Santoro, C., & Spano, L. D. (2008). XML languages for user interface models—deliverable D2.1 of the ServFace project. http://www.servface.org/index.php?option=com_docman&task=doc_download&gid=5&Itemid=61.

  • Paternò, F., Santoro, C., & Spano, L. D. (2009). MARIA: a universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments. ACM Transactions on Computer-Human Interaction, 16(4), 1–30.

    Article  Google Scholar 

  • Paternò, F., Santoro, C., Mäntyjärvi, J., Mori, G., & Sansone, S. (2008). Authoring pervasive multimodal user interfaces. International Journal on Web Engineering & Technology, 4(2), 235–261.

    Article  Google Scholar 

  • Paulheim, H. (2010). Efficient semantic event processing: lessons learned in user interface integration. In The semantic web: research and applications (ESWC 2010), Part II (pp. 60–74).

    Chapter  Google Scholar 

  • Paulheim, H. (2011). Ontology-based application integration. Berlin: Springer.

    Book  Google Scholar 

  • Paulheim, H., & Erdogan, A. (2010). Seamless integration of heterogeneous UI components. In Proceedings of the 2nd ACM SIGCHI symposium on engineering interactive computing systems (EICS 2010) (pp. 303–308).

    Chapter  Google Scholar 

  • Paulheim, H., & Probst, F. (2010a). Application integration on the user interface level: an ontology-based approach. Data & Knowledge Engineering Journal, 69(11), 1103–1116.

    Article  Google Scholar 

  • Paulheim, H., & Probst, F. (2010b). Ontology-enhanced user interfaces: a survey. International Journal on Semantic Web and Information Systems, 6(2), 36–59.

    Article  Google Scholar 

  • Paulheim, H., & Probst, F. (2011). A formal ontology on user interfaces—yet another user interface description language? In Proceedings of the second workshop on semantic models for adaptive interactive systems (SEMAIS).

    Google Scholar 

  • Paulheim, H., Döweling, S., Tso-Sutter, K., Probst, F., & Ziegert, T. (2009). Improving usability of integrated emergency response systems: the SoKNOS approach. In LNI: Vol. 154. Proceedings “39. Jahrestagung der Gesellschaft für Informatik e.V. (GI)—Informatik 2009” (pp. 1435–1449).

    Google Scholar 

  • Paulheim, H., Plendl, R., Probst, F., & Oberle, D. (2011). Mapping pragmatic class models to reference ontologies. In The 2011 IEEE 27th international conference on data engineering workshops—2nd international workshop on data engineering meets the semantic web (DESWeb) (pp. 200–205).

    Chapter  Google Scholar 

  • Rauschmayer, A. (2005). Semantic-web-backed GUI applications. In Proceedings of the ISWC 2005 workshop on end user semantic web interaction.

    Google Scholar 

  • RedWhale Software (2000). The XIML specification. In XIML Starter Kit version 1. http://www.ximl.org/download/step1.asp.

  • Ruiz, F., & Hilera, J. R. (2006). Using ontologies in software engineering and technology. In Ontologies for software engineering and software technology (pp. 49–102). Chap. 2.

    Chapter  Google Scholar 

  • Schmidt, B., Paulheim, H., Stoitsev, T., & Mühlhäuser, M. (2011). Towards a formalization of individual work execution at computer workplaces. In LNCS: Vol. 6828. 19th international conference on conceptual structures (ICCS 2011) (pp. 270–283).

    Google Scholar 

  • Simon, R., Kapsch, M. J., & Wegscheider, F. (2004). A generic UIML vocabulary for device- and modality independent user interfaces. In WWW ALT ’04: Proceedings of the 13th international world wide web conference on alternate track papers & posters (pp. 434–435). New York: ACM.

    Chapter  Google Scholar 

  • Souchon, N., & Vanderdonckt, J. (2003). A review of XML-compliant user interface description languages. In LNCS: Vol. 2844. Interactive systems. Design, specification, and verification (pp. 377–391). Berlin: Springer.

    Chapter  Google Scholar 

  • Spyns, P., Meersmanand, R., & Jarrar, M. (2002). Data modelling versus ontology engineering. SIGMOD Record, 31(4), 12–17.

    Article  Google Scholar 

  • Studer, R., Grimm, S., & Abecker, A. (Eds.) (2007). Semantic web services—concepts, technologies and applications. Berlin: Springer.

    Google Scholar 

  • Uschold, M., & Grüninger, M. (1996). Ontologies: principles, methods and applications. Knowledge Engineering Review, 11, 93–136.

    Article  Google Scholar 

  • Uschold, M., & King, M. (1995). Towards a methodology for building ontologies. In Workshop on basic ontological issues in knowledge sharing.

    Google Scholar 

  • UsiXML Consortium (2007). USer interface extensible markup language, v1.8, reference manual. http://www.usixml.org/index.php?mod=download&file=usixml-doc/UsiXML_v1.8.0-Documentation.pdf.

  • W3C (2004a). Composite capability/preference profiles (CC/PP): structure and vocabularies 1.0. http://www.w3.org/TR/CCPP-struct-vocab/.

  • W3C (2004b). SWRL: a semantic web rule language combining OWL and RuleML. http://www.w3.org/Submission/SWRL/.

  • W3C (2009). XForms 1.1. http://www.w3.org/TR/xforms/l.

  • W3C (2010). Delivery context ontology. http://www.w3.org/TR/dcontology/.

  • W3C (2011a). Accessible rich internet applications (WAI-ARIA) 1.0. http://www.w3.org/TR/wai-aria/.

  • W3C (2011b). HTML5—a vocabulary and associated APIs for HTML and XHTML. http://www.w3.org/TR/html5/.

Download references

Author information

Authors and Affiliations

  1. University of Mannheim, Mannheim, Germany

    Heiko Paulheim

  2. SAP Research, Darmstadt, Germany

    Florian Probst

Authors
  1. Heiko Paulheim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Florian Probst
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heiko Paulheim .

Editor information

Editors and Affiliations

  1. Interactive Systems Group, University of Duisburg-Essen, Forsthausweg 2, Duisburg, 47057, Germany

    Tim Hussein

  2. Data and Web Science Group, University of Mannheim, Bissmarkstr., Mannheim, 68159, Germany

    Heiko Paulheim

  3. Faculty of Technology, Policy & Manageme, Delft University of Technology, Jaffalaan 5, Delft, 2628BX, Zuid-Holland, Netherlands

    Stephan Lukosch

  4. Interactive Systems Group, University of Duisburg-Essen, Forsthausweg 2, Duisburg, 47057, Germany

    Jürgen Ziegler

  5. Grenoble Informatics Laboratory, Grenoble Institute of Technology, Rue des Mathématiques 41, Grenoble, 38041, France

    Gaëlle Calvary

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Paulheim, H., Probst, F. (2013). UI2Ont—A Formal Ontology on User Interfaces and Interactions. In: Hussein, T., Paulheim, H., Lukosch, S., Ziegler, J., Calvary, G. (eds) Semantic Models for Adaptive Interactive Systems. Human–Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-4471-5301-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-5301-6_1

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-5300-9

  • Online ISBN: 978-1-4471-5301-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation