Online Guest Detection in a Smart Home Using Pervasive Sensors and Probabilistic Reasoning

  • Jennifer RenouxEmail author
  • Uwe Köckemann
  • Amy Loutfi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11249)


Smart home environments equipped with distributed sensor networks are capable of helping people by providing services related to health, emergency detection or daily routine management. A backbone to these systems relies often on the system’s ability to track and detect activities performed by the users in their home. Despite the continuous progress in the area of activity recognition in smart homes, many systems make a strong underlying assumption that the number of occupants in the home at any given moment of time is always known. Estimating the number of persons in a Smart Home at each time step remains a challenge nowadays. Indeed, unlike most (crowd) counting solution which are based on computer vision techniques, the sensors considered in a Smart Home are often very simple and do not offer individually a good overview of the situation. The data gathered needs therefore to be fused in order to infer useful information. This paper aims at addressing this challenge and presents a probabilistic approach able to estimate the number of persons in the environment at each time step. This approach works in two steps: first, an estimate of the number of persons present in the environment is done using a Constraint Satisfaction Problem solver, based on the topology of the sensor network and the sensor activation pattern at this time point. Then, a Hidden Markov Model refines this estimate by considering the uncertainty related to the sensors. Using both simulated and real data, our method has been tested and validated on two smart homes of different sizes and configuration and demonstrates the ability to accurately estimate the number of inhabitants.


  1. 1.
    Alemdar, H., Ertan, H., Incel, O.D., Ersoy, C.: ARAS human activity datasets in multiple homes with multiple residents. In: Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth 2013, pp. 232–235. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium (2013)Google Scholar
  2. 2.
    Alirezaie, M., et al.: An ontology-based context-aware system for smart homes: E-care@ home. Sensors 17(7), 1586 (2017)CrossRefGoogle Scholar
  3. 3.
    Benmansour, A., Bouchachia, A., Feham, M.: Multioccupant activity recognition in pervasive smart home environments. ACM Comput. Surv. (CSUR) 48(3), 34 (2016)CrossRefGoogle Scholar
  4. 4.
    Choi, W., Savarese, S.: A unified framework for multi-target tracking and collective activity recognition. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7575, pp. 215–230. Springer, Heidelberg (2012). Scholar
  5. 5.
    Dechter, R.: Constraint Processing. Elsevier Morgan Kaufmann (2003)Google Scholar
  6. 6.
    Fujii, S., Taniguchi, Y., Hasegawa, G., Matsuoka, M.: Pedestrian counting with grid-based binary sensors based on Monte Carlo method. SpringerPlus 3(1), 299 (2014)CrossRefGoogle Scholar
  7. 7.
    Gales, M., Young, S., et al.: The application of hidden Markov models in speech recognition. Found. Trends\({\textregistered }\) Signal Process. 1(3), 195–304 (2008)CrossRefGoogle Scholar
  8. 8.
    Ibrahim, M.S., Muralidharan, S., Deng, Z., Vahdat, A., Mori, G.: A hierarchical deep temporal model for group activity recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1971–1980 (2016)Google Scholar
  9. 9.
    Noor, M.H.M., Salcic, Z., Kevin, I., Wang, K.: Ontology-based sensor fusion activity recognition. J. Ambient. Intell. Humanized Comput., 1–15 (2018)Google Scholar
  10. 10.
    Plötz, T., Fink, G.A.: Markov models for offline handwriting recognition: a survey. Int. J. Doc. Anal. Recognit. (IJDAR) 12(4), 269 (Oct 2009)CrossRefGoogle Scholar
  11. 11.
    Prathiba, G.T., Dhas, Y.P.: Literature survey for people counting and human detection. IOSR J. Eng. (IOSRJEN) 3(1), 05–10 (2013)CrossRefGoogle Scholar
  12. 12.
    Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)CrossRefGoogle Scholar
  13. 13.
    Renoux, J., Alirezaie, M., Karlsson, L., Köckemann, U., Pecora, F., Loutfi, A.: Context recognition in multiple occupants situations: detecting the number of agents in a smart home environment with simple sensors. In: Knowledge-Based Techniques for Problem Solving and Reasoning (KnowProS 2017) (2017)Google Scholar
  14. 14.
    Teixeira, T., Dublon, G., Savvides, A.: A survey of human-sensing: Methods for detecting presence, count, location, track, and identity. ACM Comput. Surv. 5(1), 59–69 (2010)Google Scholar
  15. 15.
    Vera, P., Monjaraz, S., Salas, J.: Counting pedestrians with a zenithal arrangement of depth cameras. Mach. Vis. Appl. 27(2), 303–315 (2016)CrossRefGoogle Scholar
  16. 16.
    Wang, L., Gu, T., Tao, X., Chen, H., Lu, J.: Recognizing multi-user activities using wearable sensors in a smart home. Pervasive Mob. Comput. 7(3), 287–298 (2011). Scholar
  17. 17.
    Wilson, C., Hargreaves, T., Hauxwell-Baldwin, R.: Smart homes and their users: a systematic analysis and key challenges. Pers. Ubiquitous Comput. 19(2), 463–476 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Center for Applied Autonomous Sensor SystemsÖrebro UniversityÖrebroSweden

Personalised recommendations