Skip to main content
SpringerLink
Log in

Sensor data fusion for activity monitoring in the PERSONA ambient assisted living project

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

User activity monitoring is a major problem in ambient assisted living, since it requires to infer new knowledge from collected and fused sensor data while dealing with highly dynamic environments, where devices continuously change their availability and (or) physical location. In the context of the European project PERSONA, we have developed an activity monitoring sub-system characterized by high modularity, little invasiveness of the environment and good responsiveness. In this paper we first illustrate the functional architecture of the proposed solution from a general point of view, discussing the motivations of the design. Then we describe in details the software components—sensor abstraction and integration layer, human posture classification, activity monitor—and the resulting activity monitoring application, presenting also a performance evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. More precisely, a TOF camera emits sinusoidal light impulses and measures the phase shift of the returning light for each pixel.

  2. Locality preserving projections by He and Niyogi (2003) and its variants were originally formulated for manifold learning tasks (see the works by Wang and Suter 2006, 2007 for related applications in the context of human monitoring). However, in a recent publication (Wientapper et al. 2009) we showed how LPP may also be used as a classification algorithm, and we revealed its strong connections to LDA.

  3. Parts of the dataset and videos can be downloaded from http://www-past.igd.fraunhofer.de/~fowienta/HumanPosture/index.html.

References

  • Amoretti M, Wientapper F, Furfari F, Lenzi S, Chessa S (2009) Sensor data fusion for activity monitoring in ambient assisted living environments. In: Proceedings of the 1st International Conference on Sensor Systems and Software (S-CUBE). Springer, Pisa

  • Azizyan M, Constandache I, Choudhury RR (2009) Surroundsense: mobile phone localization via ambience fingerprinting. In: Proceedings of the 15th annual international conference on mobile computing and networking (MobiCom09), ACM, Beijing, China

  • Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Pervasive computing. Springer, Berlin, pp 1–17

  • Barger T, Brown D, Alwan M (2005) Health-status monitoring through analysis of behavioral patterns. IEEE Trans Syst Man Cybern Part A Syst Hum 35(1):22–27

    Article  Google Scholar 

  • Baronti P, Pillai P, Chook VWC, Chessa S, Gotta A, Hu YF (2007) Wireless sensor networks: a survey on the state of the art and the 802.15.4 and ZigBee standards. Comput Commun 30(7):1655–1695. doi:10.1016/j.comcom.2006.12.020

    Google Scholar 

  • Bauer G, Lukowicz P (2008) Developing a sub room level indoor location system for wide scale deployment in assisted living systems. In: Proceedings of the 11th international conference on computers helping people with special needs. Springer, Vienna

  • Belhumeur P, Hespanha J, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720. doi:10.1109/34.598228

    Google Scholar 

  • Bieber G, Hoffmeyer A, Gutzeit E, Peter C, Urban B (2009) Activity monitoring by fusion of optical and mechanical tracking technologies for user behavior analysis. In: Proceedings of the 2nd international conference on PErvasive technologies related to assistive environments, ACM

  • Bobick A (1997) Movement, activity and action: the role of knowledge in the perception of motion. Phil Trans R Soc Lond 352:1257–1265

    Article  Google Scholar 

  • Bolla R, Rapuzzi R, Repetto M, Barsocchi P, Chessa S, Lenzi S (2009) Automatic multimedia session migration by means of a context-aware mobility framework. In: Proceedings of the 6th international conference on mobile technology, applications, and systems (mobility conference), pp 1–7

  • Bouckaert R (2008) Bayesian network classifiers in Weka, v.3.5.8.

  • Chen R, Hou Y, Huang Z, He J (2009) Modeling the ambient intelligence application system: Concept, software, data, and network. IEEE Trans Syst Man Cybern Part C Appl Rev 39(3):299–314

    Article  Google Scholar 

  • CNR-ISTI, ITACA-TSB (2011) ZB4OSGi. http://zb4osgi.aaloa.org/

  • Cozman FG (1998) The interchange format for bayesian networks. http://www.cs.cmu.edu/~fgcozman/research/interchangeformat/

  • Cucchiara R, Grana C, Prati A, Vezzani R (2005a) Probabilistic posture classification for human-behavior analysis. IEEE Trans Syst Man Cybern Part A 35(1):42–54. doi:10.1109/TSMCA.2004.838501

    Google Scholar 

  • Cucchiara R, Prati A, Vezzani R (2005b) Posture classification in a multi-camera indoor environment. In: Proceedings of the IEEE international conference on image processing (ICIP), vol 1, pp 11–14. doi:10.1109/ICIP.2005.1529853

  • Cucchiara R, Prati A, Vezzani R (2007) A multi-camera vision system for fall detection and alarm generation. Exp Syst 24:334–345. doi:10.1111/j.1468-0394.2007.00438.x

    Google Scholar 

  • Fides-Valero Á, Freddi M, Furfari F, Tazari MR (2008) The PERSONA framework for supporting context-awareness in open distributed systems. In: Proceedings of the european conference on ambient intelligence (AmI08), LNCS, vol 5355, pp 91–108

  • Frank E, Hall M, Trigg L (2008) Weka 3: data mining software in Java. http://www.cs.waikato.ac.nz/ml/weka/

  • Girolami M, Lenzi S, Furfari F, Chessa S (2008) SAIL: a sensor abstraction and integration layer for context aware architectures. In: Proceedings of the 34th EUROMICRO conference on software engineering and advanced applications (SEAA 2008), IEEE, Parma, Italy, pp 374–381

  • He X, Niyogi P (2003) Locality preserving projections. In: Advances in neural information processing systems, vol 16. MIT Press, Cambridge

  • Heckerman D (1999) A tutorial on learning with Bayesian networks, chapt. 11. MIT Press, Cambridge

  • Huynh T, Fritz M, Schiele B (2008) Discovery of activity patterns using topic models. In: Proceedings of the 10th international conference on ubiquitous computing (Ubi-Comp)

  • IST Advisory Group EC (2011) Scenarios for ambient intelligence in 2010

  • Jensen F (2001) Bayesian networks and decision graphs. Springer, Berlin

  • Kotsiantis S (2007) Supervised machine learning: a review of classification techniques. Informatica 31:249–268

    Google Scholar 

  • Lu H, Pan W, Lane ND, Choudhury T, Campbell AT (2009) Soundsense: scalable sound sensing for people-centric applications on mobile phones. In: Proceedings of the 7th annual international conference on mobile systems, applications and services (MobiSys09), ACM

  • Madden M (2003) The performance of bayesian network classifiers constructed using different techniques. In: Workshop on probabilistic graphical models for classification. Proceedings of the european conference on machine learning

  • MESA Imaging (2009) http://www.mesa-imaging.ch/

  • Moeslund TB, Hilton A, Krueger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104(2):90–126. doi:10.1016/j.cviu.2006.08.002

  • Molla MM, Ahamed SI (2006) A survey of middleware for sensor network and challenges. In: Proceedings of the international conference on parallel processing workshop (ICPP 2006)

  • Norsys (2009) Netica-j: Java version of the netica api. http://www.norsys.com/netica-j.html

  • OASIS (2011) Oasis project home page. http://www.oasis-project.eu

  • Padovitz A, Loke S, Zaslavsky A (2008) Multiple-agent perspectives in reasoning about situations for context-aware pervasive computing systems. IEEE Trans Syst Man Cybern Part A Syst Hum 38(4):729–742

    Article  Google Scholar 

  • Pallikonda M, Radhakrishnan S, Subbaraj P (2009) Elderly patient monitoring system using a wireless sensor network. Telemed e-Health 15(1):73–79

    Article  Google Scholar 

  • Pellegrini S, Iocchi L (2008) Human posture tracking and classification through stereo vision and 3d model matching. J Image Video Process 8(2):1–12. doi:10.1155/2008/476151

    Google Scholar 

  • PERSONA (2010) PERSONA project web site. http://www.aal-persona.org

  • Piccardi M (2004) Background subtraction techniques: a review. In: Proceedings of the IEEE international conference on systems, man and cybernetics, pp 3099–3104

  • Pioggia G, Ricci G, Bonfiglio S, Bekiaris E, Siciliano G, De Rossi D (2009) An ontology-driven multisensorial platform to enable unobtrusive human monitoring and independent living. In: Proceedings of the 9th international conference on intelligent systems design and applications

  • Poppe R (2007) Vision-based human motion analysis: an overview. Comput Vis Image Underst 108(1–2):4–18. doi:10.1016/j.cviu.2006.10.016

    Google Scholar 

  • Porikli F, Tuzel O (2005) Bayesian background modeling for foreground detection. In: Proceedings of the 3rd ACM international workshop on videosurveillance & sensor networks (VSSN), New York, NY, USA, pp 55–58. doi:10.1145/1099396.1099407

  • Ramos C, Augusto JC, Shapiro D (2008) Ambient intelligence—the next step for artificial intelligence. IEEE Intell Syst 23(2):15–18

    Article  Google Scholar 

  • Rumelhart DE, Hinton GE, Williams RJ (1997) Learning dynamic bayesian networks. In: Adaptive processing of temporal information. Lecture notes in artificial intelligence. Springer, Berlin, pp 168–197

  • SOPRANO (2011) Soprano project home page. http://www.soprano-ip.org

  • Turk M, Pentland A (1991) Face recognition using eigenfaces. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 586–591. doi:10.1109/CVPR.1991.139758

  • Virone G, Sixsmith A (2008) Monitoring activity patterns and trends of older adults. In: 30th annual international IEEE EMBS conference

  • W3C (2009) OWL. http://www.w3.org/tr/owl-features/

  • Wang H, Chen S, Hu Z, Zheng W (2008) Locality-preserved maximum information projection. IEEE Trans Neural Netw 19(4):571–585. doi:10.1109/TNN.2007.910733

    Google Scholar 

  • Wang L, Suter D (2006) Analyzing human movements from silhouettes using manifold learning. In: Proceedings of the IEEE international conference on video and signal based surveillance (AVSS), pp 1–7. doi:10.1109/AVSS.2006.25

  • Wang L, Suter D (2007) Learning and matching of dynamic shape manifolds for human action recognition. IEEE Trans Image Process 16(6):1646–1661. doi:10.1109/TIP.2007.896661

    Google Scholar 

  • Wartena F, Muskens J, Schmitt L, Petkovic M (2010) Continua: the reference architecture of a personal telehealth ecosystem. In: WASP (Healthcom accompaining workshop)

  • Wientapper F, Ahrens K, Wuest H, Bockholt U (2009) Linear-projection-based classification of human postures in time-of-flight data. In: Proceedings of the IEEE international conference on systems, man and cybernetics, pp 559–564. doi:10.1109/ICSMC.2009.5346892

  • Wood A, Virone G, Doan T, Cao Q, Selavo L, Wu Y, Fang L, He Z, Lin S, Stankovic J (2006) Alarm-net: wireless sensor networks for assisted-living and residential monitoring. Tech. Rep. CS-2006-13, Wireless Sensor Network Research Group, Department of Computer Science, University of Virginia

  • Zhou F, Jiao J, Chen S, Zhang D (2010) A case-driven ambient intelligence system for elderly in-home assistance applications. IEEE Trans Syst Man Cybern Part C Appl Rev 99:1–11. doi:10.1109/TSMCC.2010.2052456

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. R&S INFO, Parma, Italy

    Michele Amoretti & Sergio Copelli

  2. Fraunhofer IGD, Darmstadt, Germany

    Folker Wientapper

  3. CNR-ISTI, Pisa, Italy

    Francesco Furfari, Stefano Lenzi & Stefano Chessa

  4. Computer Science Department, University of Pisa, Pisa, Italy

    Stefano Chessa

Authors
  1. Michele Amoretti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergio Copelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Folker Wientapper
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Francesco Furfari
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stefano Lenzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stefano Chessa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michele Amoretti.

Additional information

This work has been partially funded by the EU IST Project PERSONA (FP6 contract N.045459).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Amoretti, M., Copelli, S., Wientapper, F. et al. Sensor data fusion for activity monitoring in the PERSONA ambient assisted living project. J Ambient Intell Human Comput 4, 67–84 (2013). https://doi.org/10.1007/s12652-011-0095-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-011-0095-6

Keywords

Search

Navigation