Abstract
According to the World Health Organization and the US Department of Health, older adults are one of the most rapidly expanding population segments of many developed countries. As a result, significant research in the area of assistive technologies for the elderly has been undertaken to help manage this growing demographic segment. Our contribution to this effort is based on leveraging environmental sensors to track occupants for extended durations in their homes in order to extract and track various behavioral patterns in order to identify atypical activities. To aid in our detection of behavioral patterns, we extract additional intermediate indicators of mobility and behavior such as estimates of an occupant’s position as well as other parameters such as guest visitations. In our initial research, we did not associate these instances of atypical behaviors with any specific health events. Our primary goal was to see if it was possible to detect atypical behaviors using only the limited data that can be extracted using passive infrared sensors. We compared the days when atypical patterns were detected with the similar analysis of a human annotated activity log and determined that there is a strong correlation between patterns extracted from our derived behavioral indicators and those from the annotated activities. We also compared our systems result’s across multiple datasets to verify that our approach could be applied to different sensor configurations and occupants.
Similar content being viewed by others
References
Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022. http://dl.acm.org/citation.cfm?id=944919.944937
Brooks R, Ramanathan P, Sayeed A (2003) Distributed target classification and tracking in sensor networks. Proc IEEE 91(8):1163–1171. doi:10.1109/JPROC.2003.814923
Brun L, Saggese A, Vento M (2014) Dynamic scene understanding for behavior analysis based on string kernels. IEEE Trans Circuits Syst Video Technol, (99): 1–1. doi:10.1109/TCSVT.2014.2302521
Cardile F, Iannizzotto G, La Rosa F (2010) A vision-based system for elderly patients monitoring. In: Human system interactions (HSI), 2010 3rd Conference on, pp 195–202. doi:10.1109/HSI.2010.5514566
Castanedo F, Aghajan H, Kleihorst R (2011) Modeling and discovering occupancy patterns in sensor networks using latent dirichlet allocation. In: Proceedings of the 4th international conference on Interplay between natural and artificial computation, Volume Part I, Springer, Berlin, Heidelberg, IWINAC’11, pp 481–490, http://dl.acm.org/citation.cfm?id=2009405.2009455
Castanedo F, López-de Ipina D, Aghajan H, Kleihorst R (2011) Building an occupancy model from sensor networks in office environments. In: Distributed smart cameras (ICDSC), 2011 Fifth ACM/IEEE International Conference on, IEEE, pp 1–6
for Community Living A (2012) A profile of older Americans. http://www.aoa.gov/Aging_Statistics/Profile/2011/4.aspx
Cook D (2012) Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 27(1):32–38. doi:10.1109/MIS.2010.112
Damerau FJ (1964) A technique for computer detection and correction of spelling errors. Commun ACM 7(3):171–176. doi:10.1145/363958.363994
De D, Song WZ, Xu M, Wang CL, Cook D, Huo X (2012) Findinghumo: real-time tracking of motion trajectories from anonymous binary sensing in smart environments. In: Distributed Computing Systems (ICDCS), 2012 IEEE 32nd International Conference on, pp 163–172. doi:10.1109/ICDCS.2012.76
Farrahi K, Gatica-Perez D (2008) What did you do today?: discovering daily routines from large-scale mobile data. In: Proceedings of the 16th ACM international conference on Multimedia, ACM, New York, NY, USA, MM ’08, pp 849–852. doi:10.1145/1459359.1459503
Farrahi K, Gatica-Perez D (2011) Discovering routines from large-scale human locations using probabilistic topic models. ACM Trans Intell Syst Technol 2(1):3:1–3:27. doi:10.1145/1889681.1889684
Fiore L, Somasundaram G, Drenner A, Papanikolopoulos N (2008) Optimal camera placement with adaptation to dynamic scenes. In: Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp 956–961. doi:10.1109/ROBOT.2008.4543328
Fox D, Thrun S, Dellaert F, Burgard W (2000) Particle filters for mobile robot localization. In: Doucet A, de Freitas N, Gordon N (eds) Sequential Monte Carlo methods in practice, Springer, New York, to appear
Franco C, Demongeot J, Villemazet C, Vuillerme N (2010) Behavioral telemonitoring of the elderly at home: detection of nycthemeral rhythms drifts from location data. In: Advanced Information Networking and Applications Workshops (WAINA), 2010 IEEE 24th International Conference on, pp 759–766. doi:10.1109/WAINA.2010.81
Gómez-Conde I, Olivieri D, Vila X, Rodriguez-Liñares L (2010) Smart telecare video monitoring for anomalous event detection. In: Information Systems and Technologies (CISTI), 2010 5th Iberian Conference on, pp 1–6
Gonzalez-Barbosa JJ, Garcia-Ramirez T, Salas J, Hurtado-Ramos JB, Rico-Jimenez JdJ (2009) Optimal camera placement for total coverage. In: Robotics and Automation, 2009. ICRA ’09. IEEE International Conference on, pp 844–848. doi:10.1109/ROBOT.2009.5152761
Hashimoto H, Matsunaga T, Tsuboi T, Ohyama Y, She J, Amano N, Yokota S, Kobayashi H (2007) Comfortable life space for elderly— sing supporting systems based on technology . In: SICE, 2007 Annual Conference, pp 3037–3042. doi:10.1109/SICE.2007.4421511
Heinrich S, Rapp K, Rissmann U, Becker C, Knig HH (2010) Cost of falls in old age: a systematic review. Osteoporosis International 21, pp 891–902. doi:10.1007/s00198-009-1100-1
Jain G, Cook D, Jakkula V (2006) Monitoring health by detecting drifts and outliers for a smart environment inhabitant. Conference on smart homes and health. http://www.eecs.wsu.edu/ cook/pubs/icost06.pdf
Jakkula VR, Cook DJ (2011) Detecting anomalous sensor events in smart home data for enhancing the living experience. In: Artificial Intelligence and Smarter Living, AAAI, AAAI Workshops, vol WS-11-07. http://www.aaai.org/ocs/index.php/WS/AAAIW11/paper/viewFile/3889/4212
Kalra L, Zhao X, Soto AJ, Milios EE (2012) A two-stage corrective markov model for activities of daily living detection. In: ISAm I’12, pp 171–179
Karras P, Mamoulis N (2006) Detecting the direction of motion in a binary sensor network. In: Sensor networks, ubiquitous, and trustworthy computing, 2006. IEEE International Conference on, vol 1, p 8. doi:10.1109/SUTC.2006.1636208
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Neural networks, 1995. Proceedings, IEEE International Conference on, vol 4, pp 1942–1948 vol 4. doi:10.1109/ICNN.1995.488968
Levenshtein VI (1966) Binary codes capable of correcting deletions, insertions, and reversals. Tech, Rep 8
Lotfi A, Langensiepen C, Mahmoud S, Akhlaghinia M (2012) Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour. J Ambient Intell Hum Comput 3(3):205–218. doi:10.1007/s12652-010-0043-x
Lymberopoulos D, Bamis A, Savvides A (2008) Extracting spatiotemporal human activity patterns in assisted living using a home sensor network. In: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments, ACM, New York, NY, USA, PETRA ’08, pp 29:1–29:8. doi:10.1145/1389586.1389621
Mahmoud S, Lotfi A, Langensiepen C (2011) Behavioural pattern identification in a smart home using binary similarity and dissimilarity measures. In: Intelligent environments (IE), 2011 7th international conference on, pp 55–60. doi:10.1109/IE.2011.53
Mahmoud SM, Lotfi A, Langensiepen C (2011) Abnormal behaviours identification for an elder’s life activities using dissimilarity measurements. In: Proceedings of the 4th international conference on pervasive Technologies Related to Assistive Environments, ACM, New York, NY, USA, PETRA ’11, pp 25:1–25:5. doi:10.1145/2141622.2141653
Mori T, Fujii A, Shimosaka M, Noguchi H, Sato T (2007) Typical behavior patterns extraction and anomaly detection algorithm based on accumulated home sensor data. In: Future Generation Communication and Networking (FGCN 2007), vol 2, pp 12–18. doi:10.1109/FGCN.2007.226
Morris B, Trivedi M (2011) Trajectory learning for activity understanding: unsupervised, multilevel, and long-term adaptive approach. IEEE Trans Pattern Anal Mach Intell 33(11):2287–2301. doi:10.1109/TPAMI.2011.64
Morsly Y, Aouf N, Djouadi M, Richardson M (2012) Particle swarm optimization inspired probability algorithm for optimal camera network placement. IEEE Sens J 12(5):1402–1412. doi:10.1109/JSEN.2011.2170833
Niebles JC, Wang H, Fei-fei L (2006) Unsupervised learning of human action categories using spatial-temporal words. In:Proceedings of BMVC
Novak M, Binas M, Jakab F (2012) Unobtrusive anomaly detection in presence of elderly in a smart-home environment. ELEKTRO 2012:341–344. doi:10.1109/ELEKTRO.2012.6225617
O’Brien A, Mac Ruairi R (2009) Survey of assistive technology devices and applications for aging in place. In: Advances in human-oriented and personalized mechanisms, technologies, and services, 2009. CENTRIC ’09. Second International Conference on, pp 7–12. doi:10.1109/CENTRIC.2009.9
O’Brien A, McDaid K, Loane J, Doyle J, O’Mullane B (2012) Visualisation of movement of older adults within their homes based on pir sensor data. In: Pervasive computing technologies for healthcare (PervasiveHealth), 2012 6th international conference on, pp 252–259
WH Organization (2012) What are the public health implications of global ageing? http://www.who.int/features/qa/42/en/index.html
Ozertem U, Erdogmus D (2007) Information regularized maximum likelihood for binary motion sensors. In: Acoustics, speech and signal processing, 2007. ICASSP 2007. IEEE International Conference on, vol 2, pp II-1021 -II-1024. doi:10.1109/ICASSP.2007.366412
Pollack ME (2005) Intelligent technology for an aging population: the use of ai to assist elders with cognitive impairment. AI Mag 26(2):9–24. http://www.aaai.org/ojs/index.php/aimagazine/article/view/1810
Rashidi P, Cook DJ (2010) Mining and monitoring patterns of daily routines for assisted living in real world settings. In: Proceedings of the 1st ACM international health informatics symposium, ACM, New York, NY, USA, IHI ’10, pp 336–345. doi:10.1145/1882992.1883040
Rashidi P, Cook DJ, Holder LB, Schmitter-Edgecombe M (2011) Discovering activities to recognize and track in a smart environment. IEEE Trans Knowl Data Eng 23(4):527–539. doi:10.1109/TKDE.2010.148
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circuits Syst Video Technol 21(5):611–622. doi:10.1109/TCSVT.2011.2129370
Shin JH, Lee B, Park KS (2011) Detection of abnormal living patterns for elderly living alone using support vector data description. IEEE Trans Inf Technol Biomed 15(3):438–448. doi:10.1109/TITB.2011.2113352
Smith TF, Waterman MS (1981) Identification of common molecular subsequences. J Mole Biol 147(1):195–197. http://view.ncbi.nlm.nih.gov/pubmed/7265238
Thrun S, Fox D, Burgard W, Dellaert F (2000) Robust monte carlo localization for mobile robots. Artif Intell 128(1–2):99–141
Thrun S, Burgard W, Fox D (2005) Probabilistic robotics (Intelligent Robotics and Autonomous Agents). MIT Press, Cambridge
Tran B (2002) Home care technologies for promoting successful aging in elderly populations. In: Engineering in Medicine and Biology, 2002. 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society EMBS/BMES Conference, 2002. Proceedings of the Second Joint, vol 3, pp 1898–1899. doi:10.1109/IEMBS.2002.1053083
Virone G, Alwan M, Dalal S, Kell S, Turner B, Stankovic J, Felder R (2008) Behavioral patterns of older adults in assisted living. IEEE Trans Inf Technol Biomed 12(3):387–398. doi:10.1109/TITB.2007.904157
Wang L, Wang Z, He Z, Gao X (2010) Research of physical condition monitoring system for the elderly based on zigbee wireless network technology. In: E-Health Networking, Digital Ecosystems and Technologies (EDT), 2010 International Conference on, vol 1, pp 32–35. doi:10.1109/EDT.2010.5496570
Yildiz E, Akkaya K, Sisikoglu E, Sir M (2014) Optimal camera placement for providing angular coverage in wireless video sensor networks. IEEE Trans Comput 63(7):1812–1825. doi:10.1109/TC.2013.45
Yin J, Yang Q, Pan J (2008) Sensor-based abnormal human-activity detection. IEEE Trans Knowl Data Eng 20(8):1082–1090. doi:10.1109/TKDE.2007.1042
Zhao J, Haws D, Yoshida R, Cheung S (2011) Approximate techniques in solving optimal camera placement problems. In: Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pp 1705–1712. doi:10.1109/ICCVW.2011.6130455
Acknowledgments
We would like to thank WSU’s CASAS project for both gathering and allowing other research institutions to use their Smart Home datasets.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wong, K.BY., Zhang, T. & Aghajan, H. Extracting patterns of behavior from a network of binary sensors. J Ambient Intell Human Comput 6, 83–105 (2015). https://doi.org/10.1007/s12652-014-0246-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-014-0246-7