Skip to main content
SpringerLink
Log in

FAME-ADL: a data-driven fuzzy approach for monitoring the ADLs of elderly people using Kinect depth maps

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

This paper presents a novel unsupervised fuzzy approach to monitoring the activities of daily living (ADLs) of elderly people living alone. Kinect sensors are employed in functional areas of the monitored environment to capture unlabelled training depth maps from the occupant’s ADLs. This training dataset is processed in order to extract a set of ADL attributes, including the occupant’s location and 3D posture. A novel data-driven technique is presented to define fuzzy sets over ADL attributes, and membership functions are learned based on the attribute data distribution. These fuzzy sets are used to transform the attributes’ values into fuzzy labels in order to linguistically describe the occupant’s behaviour patterns. A set of fuzzy rules is generated to model the frequency of behaviour patterns using a novel data-driven technique. Abnormal behaviours in subsequent data are detected as unusual behaviours that last for longer than a learned duration. The proposed monitoring approach was evaluated using a dataset collected from a real-life setting. The fuzzy rule set obtained from the output of the proposed membership function generation technique was found to improve monitoring of the elderly because it could accurately classify more testing scenarios of normal and abnormal behaviours when compared to the rule sets obtained using other techniques. Compared to the output of other parameterising techniques, this fuzzy rule set had fewer rules and greater tolerance of fine variations in activities. The experimental results also showed that the adopted fuzzy approach for monitoring ADLs outperformed existing camera-based approaches in terms of its classification accuracy for testing scenarios of normal and abnormal behaviours.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  • Alwan M, Kell S, Dalal S, Turner B, Mack D, Felder R (2003) In-home monitoring system and objective ADL assessment: validation study. In: Paper presented at the international conference on independence, aging and disability, Washington, DC

  • Banerjee T, Keller JM, Skubic M, Stone EE (2014) Day or night activity recognition from video using fuzzy clustering techniques. IEEE Trans Fuzzy Syst 42:483–493. https://doi.org/10.1109/TFUZZ.2013.2260756

    Article  Google Scholar 

  • Banerjee T, Keller JM, Popescu M, Skubic M (2015) Recognizing complex instrumental activities of daily living using scene information and fuzzy logic computer. Vision Image Understand 140:68–82

    Article  Google Scholar 

  • Bennett TR, Wu J, Kehtarnavaz N, Jafari R (2016) Inertial measurement unit-based wearable computers for assisted living applications: a signal processing perspective. IEEE Signal Process Magn 33:28–35

    Article  Google Scholar 

  • Bian ZP, Hou J, Chau LP, Magnenat-Thalmann N (2015) Fall detection based on body part tracking using a depth camera. IEEE J Biomed Health Inf 19:430–439. https://doi.org/10.1109/JBHI.2014.2319372

    Article  Google Scholar 

  • Bourke AK, Lyons GM (2008) A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. Med Eng Phys 30:84–90

    Article  Google Scholar 

  • Brulin D, Benezeth Y, Courtial E (2012) Posture recognition based on fuzzy logic for home monitoring of the elderly. IEEE Trans Inf Technol Biomed 16:974–982. https://doi.org/10.1109/TITB.2012.2208757

    Article  Google Scholar 

  • Claes V, Devriendt E, Tournoy J, Milisen K (2015) Attitudes and perceptions of adults of 60 years and older towards in-home monitoring of the activities of daily living with contactless sensors: an explorative study. Int J Nurs Stud 52:134–148

    Article  Google Scholar 

  • Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24:603–619. https://doi.org/10.1109/34.1000236

    Article  Google Scholar 

  • Doctor F, Iqbal R, Naguib RN (2014) A fuzzy ambient intelligent agents approach for monitoring disease progression of dementia patients. J Ambient Intell Hum Comput 5:147–158

    Article  Google Scholar 

  • Dubey R, Ni B, Moulin P (2012) A depth camera based fall recognition system for the elderly. In: Campilho A, Kamel M (eds) Image analysis and recognition, vol 7325. Springer, New York, pp 106–113. https://doi.org/10.1007/978-3-642-31298-4_13

  • Enno-Edzard S, Thomas F, Marco E, Melina F, Andreas H (2013) Modeling individual healthy behavior using home automation sensor data: Results from a field trial. J Ambient Intell Smart Environ 5:503–523

    Google Scholar 

  • Gasser T, Kneip A, Köhler W (1991) A flexible and fast method for automatic smoothing. J Am Stat Assoc 86:643–652

    Article  MathSciNet  MATH  Google Scholar 

  • Hsueh Y-L, Lin N-H, Chang C-C, Chen OT-C, Lie W-N (2015) Abnormal event detection using Bayesian networks at a smart home. In: 8th international conference on ubi-media computing (UMEDIA), pp 273–277. https://doi.org/10.1109/UMEDIA.2015.7297468

  • Kepski M, Kwolek B, Austvoll I (2012) Fuzzy inference-based reliable fall detection using Kinect and accelerometer. In: Artificial intelligence and soft computing, pp 266–273. https://doi.org/10.1007/978-3-642-29347-4_31

  • Kinect for Windows SDK 2.0 (2017) http://www.microsoft.com/en-au/download/details.aspx?id=44561. Accessed 15 June 2017

  • Kwolek B, Kepski M (2016) Fuzzy inference-based fall detection using kinect and body-worn accelerometer. Appl Soft Comput 40:305–318

    Article  Google Scholar 

  • Labonnote N, Høyland K (2017) Smart home technologies that support independent living: challenges and opportunities for the building industry—a systematic mapping study. Intell Buildings Int 9:40–63. https://doi.org/10.1080/17508975.2015.1048767

    Article  Google Scholar 

  • Li Q, Stankovic JA, Hanson MA, Barth AT, Lach J, Zhou G (2009) Accurate, fast fall detection using gyroscopes and accelerometer-derived posture information. In: 6th International workshop on wearable and implantable body sensor networks, pp 138–143. https://doi.org/10.1145/2559636.2559790

  • Liu SH, Cheng W-C (2012) Fall detection with the support vector machine during scripted and continuous unscripted activities. Sensors 12:12301–12316

    Article  Google Scholar 

  • Lustrek M, Gjoreski H, Gonzalez Vega N, Kozina S, Cvetkovic B, Mirchevska V, Gams M (2015) Fall detection using location sensors and accelerometers. IEEE Pervasive Comput 14:72–79. https://doi.org/10.1109/MPRV.2015.84

    Article  Google Scholar 

  • Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7:1–13. https://doi.org/10.1016/S0020-7373(75)80002-2

    Article  MATH  Google Scholar 

  • Pazhoumand-Dar H (2017) Fuzzy association rule mining for recognising daily activities using Kinect sensors and a single power meter. J Ambient Intell Hum Comput. https://doi.org/10.1007/s12652-017-0571-8

    Google Scholar 

  • Pierleoni P, Belli A, Palma L, Pellegrini M, Pernini L, Valenti S (2015) A high reliability wearable device for elderly fall detection. IEEE Sens J 15:4544–4553. https://doi.org/10.1109/JSEN.2015.2423562

    Article  Google Scholar 

  • Planinc R, Kampel M (2012) Robust fall detection by combining 3D data and fuzzy logic. In: Computer Vision-ACCV 2012 Workshops, pp 121–132

  • Planinc R, Kampel M (2013) Introducing the use of depth data for fall detection. Personal Ubiquit Comput 17:1063–1072

    Article  Google Scholar 

  • Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23:527–539. https://doi.org/10.1109/TKDE.2010.148

    Article  Google Scholar 

  • Ravishankar VK, Burleson W, Mahoney D (2015) Smart home strategies for user-centered functional assessment of older. Adult Int J Autom Smart Technol 5:233–242

    Article  Google Scholar 

  • Rob K (2013) Collaboration, expertise produce enhanced sensing in Xbox one. http://blogs.microsoft.com/blog/2013/10/02/collaboration-expertise-produce-enhanced-sensing-in-xbox-one/. Accessed 27 Nov 2015

  • Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circ Syst Video Technol 21:611–622. https://doi.org/10.1109/TCSVT.2011.2129370

    Article  Google Scholar 

  • Seki H (2009) Fuzzy inference based non-daily behavior pattern detection for elderly people monitoring system. In: Annual international conference of the IEEE engineering in medicine and biology society, pp 6187–6192. https://doi.org/10.1109/IEMBS.2009.5334614

  • Stone EE, Skubic M (2015) Fall detection in homes of older adults using the Microsoft Kinect. IEEE J Biomed Health Inf 19:290–301. https://doi.org/10.1109/JBHI.2014.2312180

    Article  Google Scholar 

  • Tajbakhsh A, Rahmati M, Mirzaei A (2009) Intrusion detection using fuzzy association rules. Appl Soft Comput 9:462–469

    Article  Google Scholar 

  • Vildjiounaite E, Mäkelä S-M, Keränen T, Kyllönen V, Huotari V, Järvinen S, Gimel’farb G (2017) Unsupervised illness recognition via in-home monitoring by depth cameras. Pervasive Mobile Comput 38:166–187. https://doi.org/10.1016/j.pmcj.2016.07.004

    Article  Google Scholar 

  • Wang C, Pastore F, Goknil A, Briand L, Iqbal Z (2015) Automatic generation of system test cases from use case specifications. In: The 2015 international symposium on software testing and analysis, pp 385–396. https://doi.org/10.1145/2771783.2771812

  • World Health Organization (2016) Ageing. http://www.who.int/topics/ageing/en/. Accessed 13 April 13 2016

  • Yang L, Ren Y, Zhang W (2016) 3D depth image analysis for indoor fall detection of elderly people digital. Commun Netw 2:24–34

    Google Scholar 

  • Zambanini S, Machajdik J, Kampel M (2010a) Detecting falls at homes using a network of low-resolution cameras. In: Proceedings of the 10th IEEE international conference on information technology and applications in biomedicine, 3–5 Nov 2010, pp 1–4. https://doi.org/10.1109/ITAB.2010.5687729

  • Zambanini S, Machajdik J, Kampel M (2010b) Early versus late fusion in a multiple camera network for fall detection. In: 34th annual workshop of the Austrian association for pattern recognition (AAPR), pp 15–22

  • Zhang C, Tian Y, Capezuti E (2012) Privacy preserving automatic fall detection for elderly using RGBD cameras. Springer, New York

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Science, Edith Cowan University, 270 Joondalup Drive, Joondalup, WA, 6027, Australia

    Hossein Pazhoumand-Dar

Authors
  1. Hossein Pazhoumand-Dar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hossein Pazhoumand-Dar.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pazhoumand-Dar, H. FAME-ADL: a data-driven fuzzy approach for monitoring the ADLs of elderly people using Kinect depth maps. J Ambient Intell Human Comput 10, 2781–2803 (2019). https://doi.org/10.1007/s12652-018-0990-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-018-0990-1

Keywords

Search

Navigation