Abstract
The advances of wearable sensors and wireless networks offer many opportunities to recognize human activities from sensor readings in pervasive computing. Existing work so far focus mainly on recognizing activities of a single user in a home environment. However, there are typically multiple inhabitants in a real home and they often perform activities together. In this paper, we investigate the problem of recognizing multi-user activities using wearable sensors in a home setting. We develop a multi-modal, wearable sensor platform to collect sensor data for multiple users, and study two temporal probabilistic models—Coupled Hidden Markov Model (CHMM) and Factorial Conditional Random Field (FCRF)—to model interacting processes in a sensor-based, multi-user scenario. We conduct a real-world trace collection done by two subjects over two weeks, and evaluate these two models through our experimental studies. Our experimental results show that we achieve an accuracy of 96.41% with CHMM and an accuracy of 87.93% with FCRF, respectively, for recognizing multi-user activities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Y. Yacoob and M. J. Black, Parameterized modeling and recognition of activities, In Proc. of Computer Vision and Image Understanding, pp. 73: 232–247, (1999).
D. Moore, I. Essa, and M. Hayes, Exploiting human actions and object context for recognition tasks, In Proc. of Int’l Conf. on Computer Vision (ICCV’99), pp. 1: 80–86, (1999).
Y. A. Ivanov and A. F. Bobick, Recognition of visual activities and interactions by stochastic parsing, In IEEE Trans. Pattern Recognition and Machine Intelligence, pp. 22(8): 852–872, (2000).
S. Katz, A. B. Ford, R. W. Moskowitz, B. A. Jackson, and M. W. Jaffe, Studies of illness in the aged, the index of adl: A standardized measure of biological and psychological function, In J. American Medical Association, pp. 914–919 (September, 1963).
M. Pollack, L. Brown, D. Colbry, C. McCarthy, C. Orosz, B. Peintner, S. Ramakrishnan, and I. Tsamardinos, Autominder: An intelligent cognitive orthotic system for people with memory impairment, In Robotics and Autonomous Systems, pp. 44: 273–282, (2003).
D. J. Patterson, L. Liao, D. Fox, and H. A. Kautz, Inferring high-level behavior from low-level sensors, In Proc. of Int’l Conf. on Ubiquitous Computing (Ubicomp’03), pp. 2864: 73–89, Seattle, Washington (October, 2003).
L. Bao and S. S. Intille, Activity recognition from user-annotated acceleration data, In Proc. of PERVASIVE 2004, pp. 3001: 1–17, Vienna, Austria (April, 2004).
E. M. Tapia, S. S. Intille, and K. Larson, Activity recognition in the home using simple and ubiquitous sensors, In Proc. of PERVASIVE 2004, pp. 3001: 158–175, Vienna Austria (April, 2004).
B. Logan, J. Healey, M. Philipose, E. Munguia-Tapia, and S. Intille, A long-term evaluation of sensing modalities for activity recognition, In Proc. of Int’l Conf. on Ubiquitous Computing (Ubicomp’07), pp. 4717: 483–500, Austria (September, 2007).
D. J. Patterson, D. Fox, H. Kautz, and M. Philipose, Fine-grained activity recognition by aggregating abstract object usage, In Proc. IEEE Int’l Symp. Wearable Computers, pp. 44–51, Osaka (October, 2005).
J. Lester, T. Choudhury, and G. Borriello, A practical approach to recognizing physical activities, In Proc. of PERVASIVE 2006, pp. 3968: 1–16, Dublin, Ireland (October, 2006).
J. A.Ward, P. Lukowicz, G. Troester, and T. Starner, Activity recognition of assembly tasks using body-worn microphones and accelerometers, In IEEE Trans. Pattern Analysis and Machine Intelligence, pp. 28(10): 1553–1567 (October, 2006).
M. Philipose, K. P. Fishkin, M. Perkowitz, D. J. Patterson, D. Fox, H. Kautz, and D. Hähnel, Inferring activities from interactions with objects, In IEEE Pervasive Computing, pp. 3(4): 50–57 (October, 2004).
R. Hamid, S. Maddi, A. Johnson, A. Bobick, I. Essa, and C. Isbell, A novel sequence representation for unsupervised analysis of human activities, In J. Artificial Intelligence, pp. 173(14): 1221–1244, (2008).
T. L. M. van Kasteren, A. K. Noulas, G. Englebienne, and B. Kröse, Accurate activity recognition in a home setting, In Proc. of Int’l Conf. on Ubiquitous Computing (Ubicomp’08), pp. 1–9, Seoul, Korea (September, 2008).
T. Huynh, U. Blanke, and B. Schiele, Scalable recognition of daily activities from wearable sensors, In Proc. Int’l Symp. Location and Context-Awareness (LoCA), pp. 50–67, Germany (September, 2007).
D. Wyatt, M. Philipose, and T. Choudhury, Unsupervised activity recognition using automatically mined common sense, In Proc. of the 20th national Conf. on Artificial intelligence (AAAI’05), pp. 1: 21–27, Pittsburgh (July, 2005).
T. Gu, L. Wang, Z. Wu, X. Tao, and J. Lu, A pattern mining approach to sensor-based hu man activity recognition, In IEEE Transactions on Knowledge and Data Engineering (TKDE), (23 Sept., 2010).
P. P. Palmes, H. K. Pung, T. Gu, W. Xue, and S. Chen, Object relevance weight pattern mining for activity recognition and segmentation, In Elsevier Journal of Pervasive and Mobile Computing (PMC), pp. 6(1): 43–57 (Feburary, 2010).
T. Gu, S. Chen, X. Tao, and J. Lu, An unsupervised approach to activity recognition and segmentation based on object-use fingerprints, In Elsevier Journal of Data & Knowledge Engineering (DKE), pp. 69(6): 533–544 (June, 2010).
D. L. Vail, M. M. Veloso, and J. D. Lafferty, Conditional random fields for activity recognition, In Proc. of Int’l Conf. on Autonomous Agents and Multi-agent Systems (AAMAS), pp. 1–8, (2007).
T. Y. Wu, C. C. Lian, and J. Y. Hsu, Joint recognition of multiple concurrent activities using factorial conditional random fields, In Proc. AAAI Workshop Plan, Activity, and Intent Recognition, California (July, 2007).
S. Gong and T. Xiang, Recognition of group activities using dynamic probabilistic networks, In Proc. of the 9th Int’l Conf. on Computer Vision (ICCV’03), pp. 742–749, Nice, France (October, 2003).
N. Nguyen, H. Bui, and S. Venkatesh, Recognising behaviour of multpile people with hierarchical probabilistic and statistical data association, In Proc of the 17th British Machine Vision Conference (BMVC’06), pp. 1239–1248, Edinburgh, Scotland (September, 2006).
S. Park and M. M. Trivedi, Multi-person interaction and activity analysis: A synergistic trackand body- level analysis framework, In Machine Vision and Applications: Special Issue on Novel Concepts and Challenges for the Generation of Video Surveillance Systems, pp. 18(3): 151–166. Springer Verlag Inc., (2007).
Y. Du, F. Chen, W. Xu, and Y. Li, Recognizing interaction activities using dynamic bayesian network, In Proc. of Int’l Conf. on Pattern Recognition (ICPR’06), pp. 1: 618–621, Hong Kong, China (August, 2006).
D. Wyatt, T. Choudhury, J. Bilmes, and H. Kautz, A privacy sensitive approach to modeling multi-person conversations, In Proc. of Int’l Joint Conf. On Artificial Intelligence (IJCAI’07), pp. 1769–1775, India (January, 2007).
T. Choudhury and S. Basu, Modeling conversational dynamics as a mixed-memory markov process, In Advances in Neural Information Processing Systems (NIPS’04), pp. 281–288, Cambridge, MA, (2005). MIT Press.
C. chun Lian and J. Y. jen Hsu, Chatting activity recognition in social occasions using factorial conditional random fields with iterative classification, In Proceedings of the Twenty-Third AAAI Conf. on Artificial Intelligence (2008), pp. 1814–1815, Chicago, Illinois, (2008).
N. Oliver, B. Rosario, and A. Pentland, Statistical modeling of human interactions, In CVPR Workshop on Interpretation of Visual Motion, pp. 39–46, (1998).
N. Oliver, B. Rosario, and A. Pentland, A bayesian computer vision system for modeling human interactions, In IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 22: 831–843, (2000).
N. Oliver, A. Gargb, and E. Horvitz, Layered representations for learning and inferring office activity from multiple sensory channels, In Computer Vision and Image Understanding, pp. 96: 163–180, (November 2004).
D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, and G. Lathoud, Modeling individual and group actions in meetings: A two-layer hmm framework, In Proc. of Computer Vision and Pattern Recognition Workshop (CVPRW’04), p. 7: 117, Washington, DC, USA, (2004).
Z. Lin and L. Fu, Multi-user preference model and service provision in a smart home environment, In Proc. of IEEE Int’l Conf. on Automation Science and Engineering (CASE’07), pp. 759–764 (September, 2007).
P. Rashidi, G. Youngblood, D. Cook, and S. Das, Inhabitant guidance of smart environments, In Proc. of the Int’l Conf. on Human-Computer Interaction, pp. 910–919, (2007).
G. Singla, D. Cook, and M. Schmitter-Edgecombe, Recognizing independent and joint activities among multiple residents in smart environments, In J. Ambient Intelligence and Humanized Computing, pp. 1: 57–63. Springer, (2009).
T. Gu, L.Wang, Z.Wu, X. Tao, and J. Lu, Mining emerging patterns for recognizing activities of multiple users in pervasive computing, In Proc. of the 6th Int’l Conf. on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous ‘09), pp. 1–10, Toronto, Canada (July 13-16, 2009).
U. Fayyad and K. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, In Proc. Int’l Joint Conf. on Artificial Intelligence, pp. 1022–1027, San Francisco, (1993).
M. Brand, Coupled hidden markov models for modeling interacting processes, In Technical Report, pp. 1721: 30–42 (November, 1997).
M. Brand, Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data, In J. Machine Learning Research, pp. 8: 693–723, (2007).
A. Ng and M. Jordan, On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes, In Advances in Neural Information Processing Systems, p. 10(1.46): 6208, (2002).
A. K. McCallum, Mallet: A machine learning for language toolkit, http://mallet.cs. umass.edu/, (2002).
D. Wilson and C. Atkeson, Simultaneous tracking and activity recognition (star) using many anonymous, binary sensors, In Proc. Int’l Conf. Pervasive, pp. 62–79, Germany, (2005).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Atlantis Press
About this chapter
Cite this chapter
Wang, L., Gu, T., Tao, X., Chen, H., Lu, J. (2011). Multi-User Activity Recognition in a Smart Home. In: Chen, L., Nugent, C., Biswas, J., Hoey, J. (eds) Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, vol 4. Atlantis Press. https://doi.org/10.2991/978-94-91216-05-3_3
Download citation
DOI: https://doi.org/10.2991/978-94-91216-05-3_3
Published:
Publisher Name: Atlantis Press
Print ISBN: 978-90-78677-42-0
Online ISBN: 978-94-91216-05-3
eBook Packages: Computer ScienceComputer Science (R0)
