FAME-ADL: a data-driven fuzzy approach for monitoring the ADLs of elderly people using Kinect depth maps

  • Hossein Pazhoumand-DarEmail author
Original Research


This paper presents a novel unsupervised fuzzy approach to monitoring the activities of daily living (ADLs) of elderly people living alone. Kinect sensors are employed in functional areas of the monitored environment to capture unlabelled training depth maps from the occupant’s ADLs. This training dataset is processed in order to extract a set of ADL attributes, including the occupant’s location and 3D posture. A novel data-driven technique is presented to define fuzzy sets over ADL attributes, and membership functions are learned based on the attribute data distribution. These fuzzy sets are used to transform the attributes’ values into fuzzy labels in order to linguistically describe the occupant’s behaviour patterns. A set of fuzzy rules is generated to model the frequency of behaviour patterns using a novel data-driven technique. Abnormal behaviours in subsequent data are detected as unusual behaviours that last for longer than a learned duration. The proposed monitoring approach was evaluated using a dataset collected from a real-life setting. The fuzzy rule set obtained from the output of the proposed membership function generation technique was found to improve monitoring of the elderly because it could accurately classify more testing scenarios of normal and abnormal behaviours when compared to the rule sets obtained using other techniques. Compared to the output of other parameterising techniques, this fuzzy rule set had fewer rules and greater tolerance of fine variations in activities. The experimental results also showed that the adopted fuzzy approach for monitoring ADLs outperformed existing camera-based approaches in terms of its classification accuracy for testing scenarios of normal and abnormal behaviours.


Behaviour monitoring Kinect camera Fuzzy logic Activities of daily living Abnormality detection 



  1. Alwan M, Kell S, Dalal S, Turner B, Mack D, Felder R (2003) In-home monitoring system and objective ADL assessment: validation study. In: Paper presented at the international conference on independence, aging and disability, Washington, DCGoogle Scholar
  2. Banerjee T, Keller JM, Skubic M, Stone EE (2014) Day or night activity recognition from video using fuzzy clustering techniques. IEEE Trans Fuzzy Syst 42:483–493. CrossRefGoogle Scholar
  3. Banerjee T, Keller JM, Popescu M, Skubic M (2015) Recognizing complex instrumental activities of daily living using scene information and fuzzy logic computer. Vision Image Understand 140:68–82CrossRefGoogle Scholar
  4. Bennett TR, Wu J, Kehtarnavaz N, Jafari R (2016) Inertial measurement unit-based wearable computers for assisted living applications: a signal processing perspective. IEEE Signal Process Magn 33:28–35CrossRefGoogle Scholar
  5. Bian ZP, Hou J, Chau LP, Magnenat-Thalmann N (2015) Fall detection based on body part tracking using a depth camera. IEEE J Biomed Health Inf 19:430–439. CrossRefGoogle Scholar
  6. Bourke AK, Lyons GM (2008) A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. Med Eng Phys 30:84–90CrossRefGoogle Scholar
  7. Brulin D, Benezeth Y, Courtial E (2012) Posture recognition based on fuzzy logic for home monitoring of the elderly. IEEE Trans Inf Technol Biomed 16:974–982. CrossRefGoogle Scholar
  8. Claes V, Devriendt E, Tournoy J, Milisen K (2015) Attitudes and perceptions of adults of 60 years and older towards in-home monitoring of the activities of daily living with contactless sensors: an explorative study. Int J Nurs Stud 52:134–148CrossRefGoogle Scholar
  9. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24:603–619. CrossRefGoogle Scholar
  10. Doctor F, Iqbal R, Naguib RN (2014) A fuzzy ambient intelligent agents approach for monitoring disease progression of dementia patients. J Ambient Intell Hum Comput 5:147–158CrossRefGoogle Scholar
  11. Dubey R, Ni B, Moulin P (2012) A depth camera based fall recognition system for the elderly. In: Campilho A, Kamel M (eds) Image analysis and recognition, vol 7325. Springer, New York, pp 106–113.
  12. Enno-Edzard S, Thomas F, Marco E, Melina F, Andreas H (2013) Modeling individual healthy behavior using home automation sensor data: Results from a field trial. J Ambient Intell Smart Environ 5:503–523Google Scholar
  13. Gasser T, Kneip A, Köhler W (1991) A flexible and fast method for automatic smoothing. J Am Stat Assoc 86:643–652MathSciNetCrossRefzbMATHGoogle Scholar
  14. Hsueh Y-L, Lin N-H, Chang C-C, Chen OT-C, Lie W-N (2015) Abnormal event detection using Bayesian networks at a smart home. In: 8th international conference on ubi-media computing (UMEDIA), pp 273–277.
  15. Kepski M, Kwolek B, Austvoll I (2012) Fuzzy inference-based reliable fall detection using Kinect and accelerometer. In: Artificial intelligence and soft computing, pp 266–273.
  16. Kinect for Windows SDK 2.0 (2017) Accessed 15 June 2017
  17. Kwolek B, Kepski M (2016) Fuzzy inference-based fall detection using kinect and body-worn accelerometer. Appl Soft Comput 40:305–318CrossRefGoogle Scholar
  18. Labonnote N, Høyland K (2017) Smart home technologies that support independent living: challenges and opportunities for the building industry—a systematic mapping study. Intell Buildings Int 9:40–63. CrossRefGoogle Scholar
  19. Li Q, Stankovic JA, Hanson MA, Barth AT, Lach J, Zhou G (2009) Accurate, fast fall detection using gyroscopes and accelerometer-derived posture information. In: 6th International workshop on wearable and implantable body sensor networks, pp 138–143.
  20. Liu SH, Cheng W-C (2012) Fall detection with the support vector machine during scripted and continuous unscripted activities. Sensors 12:12301–12316CrossRefGoogle Scholar
  21. Lustrek M, Gjoreski H, Gonzalez Vega N, Kozina S, Cvetkovic B, Mirchevska V, Gams M (2015) Fall detection using location sensors and accelerometers. IEEE Pervasive Comput 14:72–79. CrossRefGoogle Scholar
  22. Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7:1–13. CrossRefzbMATHGoogle Scholar
  23. Pazhoumand-Dar H (2017) Fuzzy association rule mining for recognising daily activities using Kinect sensors and a single power meter. J Ambient Intell Hum Comput. Google Scholar
  24. Pierleoni P, Belli A, Palma L, Pellegrini M, Pernini L, Valenti S (2015) A high reliability wearable device for elderly fall detection. IEEE Sens J 15:4544–4553. CrossRefGoogle Scholar
  25. Planinc R, Kampel M (2012) Robust fall detection by combining 3D data and fuzzy logic. In: Computer Vision-ACCV 2012 Workshops, pp 121–132Google Scholar
  26. Planinc R, Kampel M (2013) Introducing the use of depth data for fall detection. Personal Ubiquit Comput 17:1063–1072CrossRefGoogle Scholar
  27. Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23:527–539. CrossRefGoogle Scholar
  28. Ravishankar VK, Burleson W, Mahoney D (2015) Smart home strategies for user-centered functional assessment of older. Adult Int J Autom Smart Technol 5:233–242CrossRefGoogle Scholar
  29. Rob K (2013) Collaboration, expertise produce enhanced sensing in Xbox one. Accessed 27 Nov 2015
  30. Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circ Syst Video Technol 21:611–622. CrossRefGoogle Scholar
  31. Seki H (2009) Fuzzy inference based non-daily behavior pattern detection for elderly people monitoring system. In: Annual international conference of the IEEE engineering in medicine and biology society, pp 6187–6192.
  32. Stone EE, Skubic M (2015) Fall detection in homes of older adults using the Microsoft Kinect. IEEE J Biomed Health Inf 19:290–301. CrossRefGoogle Scholar
  33. Tajbakhsh A, Rahmati M, Mirzaei A (2009) Intrusion detection using fuzzy association rules. Appl Soft Comput 9:462–469CrossRefGoogle Scholar
  34. Vildjiounaite E, Mäkelä S-M, Keränen T, Kyllönen V, Huotari V, Järvinen S, Gimel’farb G (2017) Unsupervised illness recognition via in-home monitoring by depth cameras. Pervasive Mobile Comput 38:166–187. CrossRefGoogle Scholar
  35. Wang C, Pastore F, Goknil A, Briand L, Iqbal Z (2015) Automatic generation of system test cases from use case specifications. In: The 2015 international symposium on software testing and analysis, pp 385–396.
  36. World Health Organization (2016) Ageing. Accessed 13 April 13 2016
  37. Yang L, Ren Y, Zhang W (2016) 3D depth image analysis for indoor fall detection of elderly people digital. Commun Netw 2:24–34Google Scholar
  38. Zambanini S, Machajdik J, Kampel M (2010a) Detecting falls at homes using a network of low-resolution cameras. In: Proceedings of the 10th IEEE international conference on information technology and applications in biomedicine, 3–5 Nov 2010, pp 1–4.
  39. Zambanini S, Machajdik J, Kampel M (2010b) Early versus late fusion in a multiple camera network for fall detection. In: 34th annual workshop of the Austrian association for pattern recognition (AAPR), pp 15–22Google Scholar
  40. Zhang C, Tian Y, Capezuti E (2012) Privacy preserving automatic fall detection for elderly using RGBD cameras. Springer, New YorkCrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of ScienceEdith Cowan UniversityJoondalupAustralia

Personalised recommendations