Personal and Ubiquitous Computing

, Volume 19, Issue 2, pp 271–285 | Cite as

Hierarchical activity recognition for dementia care using Markov Logic Network

  • K. S. GayathriEmail author
  • Susan Elias
  • Balaraman Ravindran
Original Article


Statistics reveal that globally, the aging population in different stages of dementia are struggling to cope with daily activities and are progressively becoming dependent on care takers thereby making dementia care a challenging social problem. Healthcare systems in smart environments that aim to address this growing social need require the support of technology to recognize and respond in an ubiquitous manner. To incorporate an efficient activity recognition and abnormality detection system in smart environments, the routine activities of the occupant are modeled and any deviation from the activity model is recognized as abnormality. Recognition systems are generally designed using machine learning strategies and in this paper a novel hybrid, data and knowledge-driven approach is introduced. Markov Logic Network (MLN) used in our design is a suitable approach for activity recognition as it integrates common sense knowledge with a probabilistic model that augments the recognition ability of the system. The proposed activity recognition system for dementia care uses a hierarchical approach to detect abnormality in occupant behavior using MLN. The abnormality in the context of dementia care is identified in terms of factors associated with the activity such as objects, location, time and duration. The task of recognition is done in a hierarchical manner based on the priority of the factor that is associated with each layer. The motivation for designing a hierarchical approach was to enable each layer to commence its computation after inferring from the lower layers that the ongoing activity was normal with regard to the associated factors. This hierarchical feature enables quick decisions, as factors that require immediate attention are processed first at the lowest layer. Experimental results indicate that the hierarchical approach has higher accuracy in recognition and efficient response time when compared to the existing approaches.


Dementia care Smart environment Activity recognition Abnormality detection Hybrid approach Markov Logic Network Hierarchical activity recognition 


  1. 1.
    Wimo A, Prince M (2010) World alzheimer report 2010: the global economic impact on dementia. Alzheimer Disease international, LondonGoogle Scholar
  2. 2.
    Amoretti M, Copelli S, Wientapper F, Furfari F, Lenzi S, Chessa S (2013) Sensor data fusion for activity monitoring in the personal ambient assisted living project. J Ambient Intell Humaniz Comput 4(1):67–84CrossRefGoogle Scholar
  3. 3.
    Graham N, Warner J (2009) Understanding alzheimers disease and other dementias. British Medical Association, Family Doctor Books, Poole, Dorset, UKGoogle Scholar
  4. 4.
    Augusto JC, Nakashima H, Aghajan H (2010) Ambient intelligence and smart environments: a state of the art. In: Handbook of ambient intelligence and smart environments, pp 3–31. doi: 10.1007/978-0-387-93808-0_1
  5. 5.
    Chen L, Hoey J, Nugent CD, Cook DJ (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern C 42(6):790–808CrossRefGoogle Scholar
  6. 6.
    Cook DJ, Augusto JC, Jakkula VR (2009) Ambient intelligence: technologies, applications, and opportunities. Pervasive Mob Comput 5(4):277–298CrossRefGoogle Scholar
  7. 7.
    Cook DJ, Das SK (2007) How smart are our environments? An updated look at the state of the art. Pervasive Mob Comput 3(2):53–73CrossRefGoogle Scholar
  8. 8.
    Alam MR, Reaz MBI, Ali MAM (2012) A review of smart homes—past, present, and future. IEEE Trans Syst Man Cybern C 42(6):1190–1203CrossRefGoogle Scholar
  9. 9.
    Cook DJ (2012) Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 27(1):32–38CrossRefGoogle Scholar
  10. 10.
    Atallah L, Yang G-Z (2009) The use of pervasive sensing for behaviour profiling—a survey. Pervasive Mob Comput 5(5):447–464CrossRefGoogle Scholar
  11. 11.
    Aztiria A, Izaguirre A, Augusto JC (2010) Learning patterns in ambient intelligence environments: a survey. Artif Intell Rev 34(1):35–51CrossRefGoogle Scholar
  12. 12.
    Rashidi P, Cook DJ (2009) Keeping the resident in the loop: adapting the smart home to the user. IEEE Trans Syst Man Cybern A 39(5):949–959CrossRefGoogle Scholar
  13. 13.
    Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23(4):527–539CrossRefGoogle Scholar
  14. 14.
    Chen L, Nugent CD, Wang H (2012) A knowledge-driven approach to activity recognition in smart homes. IEEE Trans Knowl Data Eng 24(6):961–974CrossRefGoogle Scholar
  15. 15.
    Riboni D, Bettini C (2011) Cosar: hybrid reasoning for context-aware activity recognition. Pers Ubiquitous Comput 15(3):271–289CrossRefGoogle Scholar
  16. 16.
    Okeyo G, Chen L, Wang H, Sterritt R (2012) A hybrid ontological and temporal approach for composite activity modelling. In TrustCom, pp 1763–1770Google Scholar
  17. 17.
    Natarajan S, Bui HH,Tadepalli P, Kersting K, Wong W-K (2008) Logical hierarchical hidden markov models for modeling user activities. In: Zelezn F, Lavrac N (eds) ILP, volume 5194 of Lecture Notes in Computer Science. Springer, pp 192–209Google Scholar
  18. 18.
    Chahuara P, Fleury A, Portet F, Vacher M (2012) Using markov logic network for on-line activity recognition from non-visual home automation sensors. In: Patern F, de Ruyter Boris E. R., Markopoulos P, Santoro C, van Loenen E, Luyten K (eds) Ambient intelligence, volume 7683 of Lecture Notes in Computer Science, Springer, Berlin, pp 177–192Google Scholar
  19. 19.
    Richardson M, Domingos P (2006) Markov logic networks. Mach Learn 62(1–2):107–136CrossRefGoogle Scholar
  20. 20.
    Tran SD, Davis LS (2008) Event modeling and recognition using markov logic networks. In: Proceedings of the 10th European conference on computer vision: part II, ECCV ’08. Springer, Berlin, pp 610–623Google Scholar
  21. 21.
    Helaoui R, Niepert M, Stuckenschmidt H (2010) A statistical–relational activity recognition framework for ambient assisted living systems. In: Augusto JC, Corchado JM, Novais P, Analide C (eds) ISAm I, volume 72 of Advances in Soft Computing. Springer, Berlin, pp 247–254Google Scholar
  22. 22.
    Helaoui R, Niepert M, Stuckenschmidt H (2011) Recognizing interleaved and concurrent activities: a statistical–relational approach. In PerCom, IEEE, pp 1–9Google Scholar
  23. 23.
    Tran AC, Marsland S, Dietrich J, Guesgen HW, Lyons P (2010) Use cases for abnormal behaviour detection in smart homes. In: Lee Y, Zenn Bien Z, Mokhtari M, Jeong Tai K, Mignon P, Jongbae K, Heyoung L, Ismail K (eds) ICOST, Lecture notes in computer science, vol 6159. Springer, pp 144–151. doi: 10.1007/978-3-642-13778-5_18
  24. 24.
    Gayathri KS, Elias S, Shivashankar S (2014) An ontology and pattern clustering approach for activity recognition in smart environments. Volume 258 of Advances in Intelligent Systems and Computing, Springer, Berlin, pp 833–843Google Scholar
  25. 25.
  26. 26.
  27. 27.
    Ordóñez FC, de Toledo P, Sanchis A (2013) Activity recognition using hybrid generative/discriminative models on home environments using binary sensors. Sensors 13(5):5460–5477. doi: 10.3390/s130505460
  28. 28.
    Sow DM, Turaga DS, Schmidt M (2013) Mining of sensor data in healthcare: a survey. In: Aggarwal CC (ed) Managing and mining sensor data. Springer, Berlin, pp 459–504Google Scholar
  29. 29.
    Kim E, Helal S, Cook D (2010) Human activity recognition and pattern discovery. IEEE Pervasive Comput 9(1):48–53CrossRefGoogle Scholar
  30. 30.
    Singla G, Cook DJ, Schmitter-Edgecombe M (2010) Recognizing independent and joint activities among multiple residents in smart environments. J Ambient Intell Humaniz Comput 1(1):57–63CrossRefGoogle Scholar
  31. 31.

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  • K. S. Gayathri
    • 1
    Email author
  • Susan Elias
    • 1
  • Balaraman Ravindran
    • 2
  1. 1.Sri Venkateswara College of EngineeringPennalur, Sriperumbudur TalukIndia
  2. 2.Indian Institute of Technology MadrasChennaiIndia

Personalised recommendations