Abstract
Automated systems for assisting persons to achieve their everyday tasks are gaining popularity, both in the application domains for supporting healthy persons, as well as for assisting people with impairments. The development of such assistive systems is a challenging task associated with a lot of time and effort and often requires the involvement of domain experts. To address this problem, different works have investigated the automated knowledge extraction and model generation for behaviour interpretation and assistance. Existing works, however, usually concentrate on one source of data for the task of automated knowledge generation, which could potentially result in simpler models that are unable to adequately support the person. To address this problem, in this work we present the BehavE methodology, which proposes the extraction of knowledge from different types of sources and its consolidation into a unified semantic model that is used for behaviour interpretation and generation of assistance strategies.
This work is part of the BehavE project, funded by the German Research Foundation, grant number YO 226/3-1.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Planning Domain Definition Language.
References
Beard, J.R., et al.: The world report on ageing and health: a policy framework for healthy ageing. Lancet 387(10033), 2145–2154 (2016)
Benotti, L., Lau, T., Villalba, M.: Interpreting natural language instructions using language, vision, and behavior. ACM Trans. Interact. Intell. Syst. (TiiS) 4(3), 1–22 (2014)
Culmone, R., Giuliodori, P., Quadrini, M.: Human activity recognition using a semantic ontology-based framework. Int. J. Adv. Intell. Syst. 8(2), 159–168 (2015)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Farrell, J., Lausen, H.: Semantic annotations for WSDL and XML schema. IEEE Internet Comput. 11(6), 60–67 (2007). W3C recommendation 28
Goldwasser, D., Roth, D.: Learning from natural instructions. Mach. Learn. 94(2), 205–232 (2014)
Hooda, D., Rani, R.: Ontology driven human activity recognition in heterogeneous sensor measurements. J. Ambient. Intell. Humaniz. Comput. 11(12), 5947–5960 (2020). https://doi.org/10.1007/s12652-020-01835-0
Kirste, T.: A reference model for situation-aware assistance. In: Proceedings of Mensch & Computer, Bad Honneff, Germany (2001)
Krüger, F., Nyolt, M., Yordanova, K., Hein, A., Kirste, T.: Computational state space models for activity and intention recognition. A feasibility study. PLoS ONE 9(11), e109381 (2014). https://doi.org/10.1371/journal.pone.0109381
Krüger, F., Yordanova, K., Burghardt, C., Kirste, T.: Towards creating assistive software by employing human behavior models. J. Ambient Intell. Smart Environ. 4(3), 209–226 (2012)
Lindsay, A., Read, J., Ferreira, J., Hayton, T., Porteous, J., Gregory, P.: Framer: planning models from natural language action descriptions. In: 27th International Conference on Automated Planning and Scheduling (2017)
Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)
Okeyo, G., Chen, L., Wang, H., Sterritt, R.: Ontology-based learning framework for activity assistance in an adaptive smart home. In: Chen, L., Nugent, C., Biswas, J., Hoey, J. (eds.) Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, vol. 4, pp. 237–263. Springer, Heidelberg (2011). https://doi.org/10.2991/978-94-91216-05-3_11
Safyan, M., Qayyum, Z.U., Sarwar, S., Iqbal, M., Castro, R.G., Al-Dulaimi, A.: Ontology evolution for personalised and adaptive activity recognition. IET Wirel. Sensor Syst. 9(4), 193–200 (2019)
Serna, A., Pigot, H., Rialle, V.: Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes. User Model. User-Adap. Inter. 17(4), 415–438 (2007)
Sil, A., Yates, A.: Extracting strips representations of actions and events. In: Proceedings of the International Conference Recent Advances in Natural Language Processing, vol. 2011, pp. 1–8 (2011)
Ye, J., Dobson, S., McKeever, S.: Situation identification techniques in pervasive computing: a review. Pervasive Mob. Comput. 8(1), 36–66 (2012)
Ye, J., Stevenson, G., Dobson, S.: USMART: an unsupervised semantic mining activity recognition technique. ACM Trans. Interact. Intell. Syst. 4(4), 1–27 (2014). https://doi.org/10.1145/2662870
Yordanova, K.: From textual instructions to sensor-based recognition of user behaviour. In: Companion Publication of the 21st International Conference on Intelligent User Interfaces, pp. 67–73 (2016)
Yordanova, K.: Extracting planning operators from instructional texts for behaviour interpretation. In: Trollmann, F., Turhan, A.-Y. (eds.) KI 2018. LNCS (LNAI), vol. 11117, pp. 215–228. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00111-7_19
Yordanova, K.: Towards automated generation of semantic annotation for activity recognition problems. In: 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), pp. 1–6 (2020). https://doi.org/10.1109/PerComWorkshops48775.2020.9156147
Yordanova, K., Bader, S., Heine, C., Teipel, S., Kirste, T.: Towards a situation model for assessing challenging behaviour of people with dementia. In: Proceedings of the 3rd International Workshop on Sensor-Based Activity Recognition and Interaction, pp. 1–6 (2016)
Yordanova, K., Hein, A., Kirste, T.: Kitchen task assessment dataset for measuring errors due to cognitive impairments. In: 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), pp. 1–6. IEEE (2020)
Yordanova, K.Y.: Ontologies to support patients with dementia. In: Wolkenhauer, O. (ed.) Systems Medicine, pp. 396–405. Academic Press, Oxford (2021). https://doi.org/10.1016/B978-0-12-801238-3.11473-4. http://www.sciencedirect.com/science/article/pii/B9780128012383114734
Zhang, S., McCullagh, P., Nugent, C., Zheng, H.: An ontology-based context-aware approach for behaviour analysis. In: Chen, L., Nugent, C., Biswas, J., Hoey, J. (eds.) Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, vol. 4, pp. 127–148. Springer, Heidelberg (2011). https://doi.org/10.2991/978-94-91216-05-3_6
Zhang, Z., Webster, P., Uren, V., Varga, A., Fabio, C.: Automatically extracting procedural knowledge from instructional texts using natural language processing. In: 8th International Conference on Language Resources and Evaluation, pp. 520–527 (2012)
Zhou, L., Xu, C., Corso, J.J.: Towards automatic learning of procedures from web instructional videos. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Stoev, T., Yordanova, K. (2021). BehavE: Behaviour Understanding Through Automated Generation of Situation Models. In: Edelkamp, S., Möller, R., Rueckert, E. (eds) KI 2021: Advances in Artificial Intelligence. KI 2021. Lecture Notes in Computer Science(), vol 12873. Springer, Cham. https://doi.org/10.1007/978-3-030-87626-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-87626-5_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87625-8
Online ISBN: 978-3-030-87626-5
eBook Packages: Computer ScienceComputer Science (R0)