Detection of aberrant behaviour in home environments from video sequence

  • Zdenka Uhríková
  • Chris D. Nugent
  • David Craig
  • Václav Hlaváč
Article

Abstract

We introduce an application for the detection of aberrant behaviour within home based environments, with a focus on repetitive actions, which may be present in instance of persons suffering from dementia. Video based analysis has been used to detect the motion of a person within a given scene in addition to tracking them over the time. Detection of repetitive actions has been based on the analysis of a person’s trajectory using the principles of signal correlation. Along with the ability to detect repetitive motion the developed approach also has the ability to measure the amount of activity/inactivity within the scene during a given period of time. Our results showed that the developed approach had the ability to detect all patterns in the data set examined with an average accuracy of 96.67%. This work has therefore validated the proposed concept of video based analysis for the detection of repetitive activities.

Keywords

Aberrant behaviour Dementia Video processing 

References

  1. 1.
    Cook DJ, Das SK (2007) How smart are our environments? An updated look at the state of the art. Pervasive Mob Comput 3(2):53–73CrossRefGoogle Scholar
  2. 2.
    Rantz MJ, Skubic M, Miller SJ, Krampe J (2008) Using technology to enhance aging in place. In: Proceedings of the 6th international conference on smart homes and health telematics, pp 169–176Google Scholar
  3. 3.
    Nugent CD, Moelaert F, Davies R, Donnelly M, Savenstedt S, Meiland F, Droes R-M, Hettinga M, Craig D, Mulvenna M, Bengstsson JE (2008) Evaluation of mobile and home based cognitive prosthetics. In: Proceedings of the 6th international conference on smart homes and health telematics, pp 18–25Google Scholar
  4. 4.
    Craig D, Mirakhur A, Hart DJ, McIlroy SP, Passmore AP (2005) Cross-sectional study of neuropsychiatric symptoms in 435 patients with Alzheimer disease. Am J Geriatr Psychiatry 13(6):460–468Google Scholar
  5. 5.
    Cullen B, Coen RF, Lynch CA, Cunningham CJ, Coakley D, Robertson IH, Lawlor BA (2005) Repetitive behaviour in Alzheimers disease: description, correlates and functions. Int J Geriatr Psychiatry 20:686–693CrossRefGoogle Scholar
  6. 6.
    Alzheimer’s Society (2008) Unusual behaviour. http://alzheimers.org.uk/factsheet/525
  7. 7.
    Alzheimer’s Association (2009) 2009 Alzheimer’s disease facts and figures. Alzheimers Dement 5:234–270CrossRefGoogle Scholar
  8. 8.
    Wimoa A, Winblada B, Jönssonb L (2007) An estimate of the total worldwide societal costs of dementia in 2005. Alzheimers Dement 3(2):81–91CrossRefGoogle Scholar
  9. 9.
    Zuidema SU, Derksen E, Verhey FRJ, Koopmans RTCM (2007) Prevalence of neuropsychiatric symptoms in a large sample of Dutch nursing home patients with dementia. Int J Geriatr Psychiatry 22(7):632–638CrossRefGoogle Scholar
  10. 10.
    Lauriks S, Reinersmann A, Vanderroest H, Meiland F, Davies R, Moelaert F, Mulvenna M, Nugent C, Droes R (2007) Review of ict-based services for identified unmet needs in people with dementia. Ageing Research Reviews 6(3):223–246CrossRefGoogle Scholar
  11. 11.
    Nugent CD, Finlay DD, Davies R, Mulvenna MD, Wallace J, Paggetti C, Tamburini E (2007) The next generation of mobile medication management solutions. IJEH 3(1):7–31CrossRefGoogle Scholar
  12. 12.
    Robinson L, Hutchings D, Corner L, Beyer F, Dickinson H, Vanoli A, Finch T, Hughes J, Ballard C, May C, Bond J (2006) A systematic literature review of the effectiveness of non-pharmacological interventions to prevent wandering in dementia and evaluation of the ethical implications and acceptability of their use. Health Technol Assess 10(26):9–108Google Scholar
  13. 13.
    Miskelly F (2005) Electronic tracking of patients with dementia and wandering using mobile phone technology. Age Ageing 34(5):497–499CrossRefGoogle Scholar
  14. 14.
    Hoey J, von Bertoldi A, Poupart P, Mihailidis A (2007) Assisting persons with dementia during handwashing using a partially observable markov decision process. In: Proceedings of the 5th international conference on computer vision systemsGoogle Scholar
  15. 15.
    Zheng H, Black ND, Harris ND (2005) Position-sensing technologies for movement analysis in stroke rehabilitation. Med Biol Eng Comput 43(4):413–420CrossRefGoogle Scholar
  16. 16.
    Philipose M, Fishkin KP, Perkowitz M, Patterson DJ, Fox D, Kautz H, Hahnel D (2004) Inferring activities from interactions with objects. IEEE Pervasive Computing 3(4):50–57CrossRefGoogle Scholar
  17. 17.
    Poland MP, Gueldenring D, Nugent CD, Wang H, Chen L (2009) Spatiotemporal data acquisition modalities for smart home inhabitant movement behavioural analysis. In: Proceedings of the 7th international conference on smart homes and health telematics, pp 294–298Google Scholar
  18. 18.
    Murakita T, Ikeda T, Ishiguro H (2004) Human tracking using floor sensors based on the markov chain monte carlo method. In: Proceedings of the 17th international conference on pattern recognition, pp 917–920Google Scholar
  19. 19.
    Anderson D, Luke RH, Keller JM, Skubic M, Rantz M, Aud M (2009) Linguistic summarization of video for fall detection using voxel person and fuzzy logic. Comput Vis Image Underst 113:80–89CrossRefGoogle Scholar
  20. 20.
    Scott GJ, Keller JM, Skubic M, Luke RH III (2007) Face recognition for homeland security: a computational intelligence approach. In: Proceedings of the 18th IASTED international conference: modelling and simulation, pp 471–476Google Scholar
  21. 21.
    Zhou Z, Chen X, Chung Y-C, He Z, Han TX, Keller JM (2008) Activity analysis, summarization, and visualization for indoor human activity monitoring. IEEE Trans Circuits Syst Video Technol 18(11):1489–1498CrossRefGoogle Scholar
  22. 22.
    Toyama K, Krumm J, Brumitt B, Meyers B (1999) Wallflower: principles and practice of background maintenance. In: The Proceedings of the seventh IEEE international conference on computer vision, pp 255–261Google Scholar
  23. 23.
    McKenna SJ, Jabri S, Duric Z, Rosenfeld A, Wechsler H (2000) Tracking groups of people. Comput Vis Image Underst 80(1):45–56Google Scholar
  24. 24.
    Power PW, Schoonees JA (2002) Understanding background mixture models for foreground segmentation. In: Proceedings image and vision computing New Zealand, pp 267–271Google Scholar
  25. 25.
    Bobick AF, Davis JW (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Anal Mach Intell 23(3):257–267CrossRefGoogle Scholar
  26. 26.
    Krumm J, Harris S, Meyers B, Brumitt B, Hale M, Shafer S (2000) Multi-camera multi-person tracking for easyliving. In: Proceedings of the international workshop on visual surveillance, pp 3–10Google Scholar
  27. 27.
    Piccardi M (2004) Background subtraction techniques: a review. In: IEEE international conference on systems, man and cybernetics, pp 3099–3104Google Scholar
  28. 28.
    Nugent CD, Mulvenna MD, Hong X, Devlin S (2009) Experiences in the development of a smart lab. Int J Biomed Eng Technol 2(3):319–331CrossRefGoogle Scholar

Copyright information

© Institut Télécom and Springer-Verlag 2010

Authors and Affiliations

  • Zdenka Uhríková
    • 1
  • Chris D. Nugent
    • 2
  • David Craig
    • 3
  • Václav Hlaváč
    • 1
  1. 1.Czech Technical University in PraguePragueCzech Republic
  2. 2.School of Computing and MathematicsUniversity of UlsterJordanstownUK
  3. 3.Belfast City HospitalQueen’s University of BelfastBelfastUK

Personalised recommendations