Multimedia Tools and Applications

, Volume 76, Issue 1, pp 489–521 | Cite as

Activity tracking and monitoring of patients with alzheimer’s disease

  • Kam-Yiu LamEmail author
  • Nelson Wai-Hung Tsang
  • Song Han
  • Wenlong Zhang
  • Joseph Kee-Yin Ng
  • Ajit Nath


In this paper, by applying motion detection and machine learning technologies, we have designed and developed an activity tracking and monitoring system, called SmartMind, to help Alzheimer’s Disease (AD) patients to live independently within their living rooms while providing emergency assistances and supports when necessary. Allowing AD patients to handle their daily activities not only can release the burdens on their families and caregivers, it is also highly important to help them regain confidence towards a healthy life. The daily activities of a patient captured from SmartMind can also serve as an important indicator to describe his/her normal living habit (NLH). By checking NLH, the patient’s current health status can be estimated on a daily basis. In the testing experiments of SmartMind, we have demonstrated the accuracy of SmartMind in activity detection and investigated its performance when different machine learning algorithms were adopted for posture detection. The performance results indicate that both support vector machine (SVM) and naive bayes (NB) can achieve an accuracy of higher than 97 % while the random forrests (RF) only gives an accuracy of around 73 %.


Motion detection Pervasive computing Health informatics Context-aware computing Dementia 


  1. 1.
    Alzheimer’s Society (2014)
  2. 2.
    Bardram JE, Frost M, Szántó K, Faurholt-Jepsen M, Vinberg M, Kessing LV (2013) Designing mobile health technology for bipolar disorder: a field trial of the monarca system. In: SIGCHI Conference on Human Factors in Computing Systems, pp 2627–2636Google Scholar
  3. 3.
    Bian Z-P, Hou J, Chau L-P, Magnenat-Thalmann N (2014) Fall detection based on body part tracking using a depth camera. IEEE J Biomed Health Inf 19(2)Google Scholar
  4. 4.
    Bianchi F, Redmond S, Narayanan M, Cerutti S, Lovell N (2010) Barometric pressure and triaxial accelerometry-based falls event detection. IEEE Trans Neural Syst Rehabil Eng 18(6):619– 627CrossRefGoogle Scholar
  5. 5.
    Breiman L (2001) Random forests. Mach Learn 45(1):5–32CrossRefzbMATHGoogle Scholar
  6. 6.
    Browning RC, Baker EA, Herron JA, Kram R (2006) Effects of obesity and sex on the energetic cost and preferred speed of walking. J Appl Physiol 100(2):390–398CrossRefGoogle Scholar
  7. 7.
    Chang C-C, Lin C-J Libsvm – a library for support vector machines.
  8. 8.
    Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297zbMATHGoogle Scholar
  9. 9.
    Cottone P, Maida B, Morana M (2014) User activity recognition via kinect in an ambient intelligence scenario. In: International Conference on Appplied Computing, Computer Science and Computer Engineering, pp 49–54Google Scholar
  10. 10.
    Dawadi PN, Cook DJ, Schmitter-Edgecombe M (2013) Automated cognitive health assessment using smart home monitoring of complex tasks. IEEE Trans Syst, Man Cybern: Syst 43(6):1302– 1313CrossRefGoogle Scholar
  11. 11.
    De Ipina KL, Alonso J, Travieso C, Egiraun H, Ecay M, Ezeiza A, Barroso N, Martinez-Lage P (2013) Automatic analysis of emotional response based on non-linear speech modeling oriented to alzheimer disease diagnosis. In: 2013 IEEE 17th International Conference on Intelligent Engineering Systems (INES), pp 61–64Google Scholar
  12. 12.
    De Urturi Breton ZS, Zapirain BG, Zorrilla AM (2012) Kimentia: Kinect based tool to help cognitive stimulation for individuals with dementia. In: IEEE International Conference on e-Health Networking, Applications and Services, pp 325–328Google Scholar
  13. 13.
    Diaz-Ramirez A, Murrieta FN, Atempa JA, Bonino FA (2013) Non-intrusive tracking of patients with dementia using a wireless sensor network. In: IEEE International Conference on Distributed Computing in Sensor Systems, pp 460–465Google Scholar
  14. 14.
    Dickerson RF, Gorlin EI, Stankovic JA (2011) Empath: a continuous remote emotional health monitoring system for depressive illness. In: Wireless Health, p 5Google Scholar
  15. 15.
    Fosty B, Crispim-Junior CF, Badie J, Bremond F, Thonnat M (2013) Event recgnition system for older people monitoring using rgb-d camera. In: Workshop on Assistance and Service Robotics in a Human Environment, Tokyo, JapanGoogle Scholar
  16. 16.
    Gaggioli A, Pioggia G, Tartarisco G, Baldus G, Corda D, Cipresso P, Riva G (2013) A mobile data collection platform for mental health research. Person Ubiquit Comput 17(2):241–251CrossRefGoogle Scholar
  17. 17.
    Hong Kong Hospital Authority (2014) Smart patient website - dementia, hospital authority.
  18. 18.
    Jaiantilal A Random forest (regression, classification and clustering) implementation for matlab.
  19. 19.
    Khan W, Xiang Y, Aalsalem M, Arshad Q (2013) Mobile phone sensing systems: A survey. IEEE Commun Surv Tutorials 15(1):402–427CrossRefGoogle Scholar
  20. 20.
    Lai C-F, Chang S-Y, Chao H-C, Huang Y-M (2011) Detection of cognitive injured body region using multiple triaxial accelerometers for elderly falling. IEEE Sensors J 11(3):763–770CrossRefGoogle Scholar
  21. 21.
    Lane N, Miluzzo E, Lu H, Peebles D, Choudhury T, Campbell A (2010) A survey of mobile phone sensing. IEEE Commun Mag 48(9):140–150CrossRefGoogle Scholar
  22. 22.
    Lin Q, Zhang D, Huang X, Ni H, Zhou X (2012) Detecting wandering behavior based on gps traces for elders with dementia. In: 2012 12th International Conference on Control Automation Robotics Vision (ICARCV), pp 672–677Google Scholar
  23. 23.
    Low L-S, Maddage M, Lech M, Sheeber L, Allen N (2011) Detection of clinical depression in adolescent’s speech during family interactions. IEEE Trans Biomed Eng 58(3):574–586CrossRefGoogle Scholar
  24. 24.
    Ma Y, Xu B, Bai Y, Sun G, Zhu R (2012) Daily mood assessment based on mobile phone sensing. In: International Conference on Wearable and Implantable Body Sensor Networks, pp 142–147Google Scholar
  25. 25.
    Mace NL, Rabins PV (2012) The 36-Hour Day: A Family Guide to Caring for People Who Have Alzheimer Disease, Related Dementias, and Memory Loss. Grand Central Life & Style, 5th edn.Google Scholar
  26. 26.
    Microsoft Crop (2014) Kinect for windows.
  27. 27.
    Mubashir M, Shao L, Seed L (2013) A survey on fall detection: Principles and approaches. Neurocomputing 100:144–152CrossRefGoogle Scholar
  28. 28.
    Naranjo-Hernandez D, Roa LM, Reina-Tosina J, Estudillo-Valderrama MA (2012) Som: A smart sensor for human activity monitoring and assisted healthy ageing. IEEE Trans Biomed Eng 59(11-2):3177–3184CrossRefGoogle Scholar
  29. 29.
    Navarro RF, Rodrígues MD, Favela J (2014) Intervention tailoring in augmented cognition systems for elders with dementia. IEEE J Biomed Health Inf 18 (1):361–367CrossRefGoogle Scholar
  30. 30.
    Newport MT (2013) Alzheimers Disease: What If There Was a Cure? Basic Health Publications, 2nd edn.Google Scholar
  31. 31.
    Norvig SJRP (2003) Artificial intelligence : a modern approach. Pearson EducationGoogle Scholar
  32. 32.
    Nyan M, Tay FE, Murugasu E (2008) A wearable system for pre-impact fall detection. J Biomech 41:34753481Google Scholar
  33. 33.
    Opperman C, Hancke G (2011) A generic NFC-enabled measurement system for remote monitoring and control of client-side equipment. In: Workshop on Near Field Communication, pp 44–49Google Scholar
  34. 34.
    Poh M-Z, Kim K, Goessling A, Swenson N, Picard R (2012) Cardiovascular monitoring using earphones and a mobile device. IEEE Pervasive Comput 11(4):18–26CrossRefGoogle Scholar
  35. 35.
    Rantz MJ, Banerjee TS, Cattoor E, Scott SD, Skubic M, Popescu M (2014) Automated fall detection with quality improvment rewind to reduce falls in hospital. J Gerontol Nurs 40(1):13–17CrossRefGoogle Scholar
  36. 36.
    Roark B, Mitchell M, Hosom J-P, Hollongshead K, Kaye J (2011) Spoken lanugage derived measures for detecting mild cognitive impairment. IEEE Trans Audio, Speech Lang Process 19(7):2081– 2090CrossRefGoogle Scholar
  37. 37.
    Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circ Syst Video Technol 21(5):611–622CrossRefGoogle Scholar
  38. 38.
    Scarff SK, Zultner AK (2012) Dementia: The Journey Ahead - A Practical Guide for In-Home Caregivers, 1st edn. Langdon Street PressGoogle Scholar
  39. 39.
    Scully C, Lee J, Meyer J, Gorbach A, Granquist-Fraser D, Mendelson Y, Chon K (2012) Physiological parameter monitoring from optical recordings with a mobile phone. IEEE Trans Biomed Eng 59(2):303–306CrossRefGoogle Scholar
  40. 40.
    Shi G, Chan CS, Li WJ, Leung K-S, Zou Y, Jin Y (2009) Mobile human airbag system for fall protection using mems sensors and embedded svm classifier. IEEE Sensors J 9(5):495–503CrossRefGoogle Scholar
  41. 41.
    Simplicio MA, Iwaya LH, Barros BM, Carvalho T. CMB, Näslund M (2015) SecourHealth: a delay-tolerant security framework for mobile health data collection. IEEE J Biomed Health Inf 19(2):761–772CrossRefGoogle Scholar
  42. 42.
    Stone E, Skubic M (2011) Evaluation of an inexpensive depth camera for in-home gait assessment. J Ambient Intell Smart Environ 3(4):349–361Google Scholar
  43. 43.
    Taub DM, Leeb SB, Lupton EC, Hinman RT, Zeisel J, Blackler S (2011) The escort system: a safety monitor for people living with alzheimers disease. Pervasive Computing, pp 68–76Google Scholar
  44. 44.
    Xiao Z, Fu B, Xiao Y, Chen CP, Liang W (2013) A review of geni authentication and access control mechanisms. Int J Secur Netw 8(1):40–60CrossRefGoogle Scholar
  45. 45.
    Zmily A, Abu-Saymeh D (2013) Alzheimers disease rehabilitation using smartphones to improve patients quality of life. In: 7th International Conference on Pervasive Computing Technologies for Healthcare and WorkshopsGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Kam-Yiu Lam
    • 1
    Email author
  • Nelson Wai-Hung Tsang
    • 1
  • Song Han
    • 2
  • Wenlong Zhang
    • 3
  • Joseph Kee-Yin Ng
    • 4
  • Ajit Nath
    • 1
  1. 1.Department of Computer ScienceCity University of Hong KongKowloon TongHong Kong
  2. 2.Department of Computer Science and EngineeringUniversity of ConnecticutConnecticutUSA
  3. 3.Polytechnic School, Ira A. Fulton Schools of EngineeringArizona State UniversityArizonaUSA
  4. 4.Department of ComputingBaptist University of Hong KongKowloon TongHong Kong

Personalised recommendations