Ontology-Based Model of User Activity Data for Cyber-Physical Systems

  • Tatiana ShulgaEmail author
  • Alexander Sytnik
  • Nikita Danilov
  • Denis Palashevskii
Part of the Studies in Systems, Decision and Control book series (SSDC, volume 259)


The chapter focuses on the issue of modeling of user interaction with the graphical interface of cyber-physical systems. The primary subject of the presented study is users activity data, that is the user’s actions with system graphical interface and their characteristics. This data is collected during the process of software testing or experimental operation. An overview of existing ontologies of domain «Information Systems Graphic Interface» is given. We propose an open model of user activity data in the form of ontology based on the OWL 2 DL language. The main classes, properties, and axioms of this model are covered in the report. This model differs from the other existing ontologies in that it is focused on user activity data rather than the interface and its elements. In addition, it is based on description logic SHOIQ (D), which makes it possible to draw logical conclusions in the process of analysis by experts of the system usability. We also present the structure of software developed for user activity data collection which allows filling the ontology with specific data on the user experience with the interface. As an example, we describe possible tasks where the model and collected data can be used.


User activity data User interface Usability OWL ontology Description logics 


  1. 1.
    ISO 9241-11:2018. Ergonomics of human-system interaction—Part 11: usability: definitions and concepts. Accessed 05 Apr. 2019
  2. 2.
    Cuomo, D.L., Bowen C.D.: Stages of user activity model as a basis for user-system interface evaluations. Proc. Hum. Factors Soc. 2, 1254–1258 (1992)CrossRefGoogle Scholar
  3. 3.
    Yang, D., Zhang, D., Zheng, V.W., Yu, Z.: Modeling user activity preference by leveraging user spatial temporal characteristics in LBSNs. IEEE Trans. Syst. Man Cybern. Syst. 45(1), 129–142 (2015)CrossRefGoogle Scholar
  4. 4.
    Woerndl, W., Manhardt, A., Schulze, F., Prinz, V.: Logging user activities and sensor data on mobile devices. In: Atzmueller, M., Hotho, A., Strohmaier, M., Chin, A. (eds.) Analysis of Social Media and Ubiquitous Data. MUSE 2010, MSM 2010. Lecture Notes in Computer Science, vol. 6904. Springer, Berlin, Heidelberg (2011)Google Scholar
  5. 5.
    Paulheim, Heiko, Probst, Florian: Ontology-enhanced user interfaces: a survey. Int. J. Semantic Web Inf. Syst. 6, 36–59 (2010). Scholar
  6. 6.
    Vocabularies. W3C. Accessed 05 Apr. 2019
  7. 7.
    Muñoz, I., Zambrana, M.R.: Applying ontologies to terminology: advantages and disadvantages. Hermes J. Lang. Commun. Bus. 51, 65–77 (2013). Scholar
  8. 8.
    Munir, K., Sheraz Anjum, M.: The use of ontologies for effective knowledge modelling and information retrieval. Appl. Comput. Inf. 14(2), 116–126 (2018). ISSN 2210-8327. Scholar
  9. 9.
    Berners-Lee, T.: A user interface ontology (ui). Linked Open Vocabularies (2014). Accessed 05 Apr. 2019
  10. 10.
    Gribova, V., Tarasov, A.: The ontology model of the “Graphical User Interface” domain. Informatika i sistemy upravlenija 1(9), 80–90 (2005)Google Scholar
  11. 11.
    Blandford, A., Green, T.: OSM: an ontology-based approach to usability evaluation. In: Proceedings of Workshop on Representations. Queen Mary & Westfield College (1998)Google Scholar
  12. 12.
    Chen, X., Kim, T.W., Chen, J., Xue, B., Jeong, W.: Ontology-Based representations of user activity and flexible space information: towards an automated space-use analysis in buildings. Adv. Civil Eng. 2019, 1–15 (2019). Scholar
  13. 13.
    Shahzad, S.K., Granitzer, M., Helic, D.: Ontological model driven GUI development: User Interface Ontology approach. In: 2011 6th International Conference on Computer Sciences and Convergence Information Technology (ICCIT), Seogwipo, pp. 214–218 (2011)Google Scholar
  14. 14.
    Sytnik, A.A., Shulga, T.E., Danilov, N.A.: Ontology of the “Software Usability” domain. Proc. Inst. Syst. Program. RAS 30(2), 195–214 (2018)CrossRefGoogle Scholar
  15. 15.
    Shulga, T., Danilov, N.: The complex of problem-oriented programs for analyzing data activity of software users. Certificate of legal registration of computer program No. 2018662773 of 15 Oct 2018Google Scholar
  16. 16.
    Danilov, N., Shulga, T., Frolova, N., Melnikova, N., Vagarina, N., Pchelintseva, E.: Software usability evaluation based on the user pinpoint activity heat map. Adv. Intell. Syst. Comput. 465, 217–225 (2016)Google Scholar
  17. 17.
    Sytnik, A., Shulga, T., Danilov, N., Gvozdjuk, I.: Mathematical model of software user activity. Programmnye produkty i sistemy 31(1), 79–84 (2018)Google Scholar
  18. 18.
    Danilov, N.A., Shulga, T.E., Sytnik, A.A.: Repetitive event patterns search in user activity data. In: Proceedings of the 2018 IEEE Northwest Russia Conference on Mathematical Methods in Engineering and Technology (MMET NW), 10–14 Sept 2018, pp. 92–94. Saint Petersburg Electrotechnical University “LETI”, St. Petersburg, Russia (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Yuri Gagarin Saratov State Technical University of SaratovSaratovRussia

Personalised recommendations