Annotating Sensor Data to Identify Activities of Daily Living

  • Mark Donnelly
  • Tommaso Magherini
  • Chris Nugent
  • Federico Cruciani
  • Cristiano Paggetti
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6719)


DANTE is an application, which supports the annotation of ADLs captured using a pair of stereo cameras. DANTE is able to interpret the position and orientation of any object that is tagged with a special marker. Offline, users navigate frame-by-frame through captured scenes to annotate onset/completion of object interactions. The main utility is supporting the development of large annotated datasets, which is essential for the development and evaluation of context-aware models to interpret and monitor occupant behaviour within smart environments. DANTE only records scenes during which ‘tagged’ objects are interacted with therefore significantly reducing the amount of redundant footage recorded. The current study has extended the concepts of DANTE and has used it to support the annotation of additional sensor platforms. Results demonstrated both the capability of DANTE to support annotation of other platforms along with reducing the amount of time previously required to manually annotate such data by more than 45%.


Data Acquisition Multi sensor systems Video Recording Optical Tracking Data Annotation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Intille, S., Nawyn, J., Logan, B., Abowd, G.: Developing shared home behaviour datasets to advance HCI and Ubiquitous compuitng research. In: Proceedings oh the 27 Annual Conference Extended Abstracts and Human Factors in Computing Systems, CHI 2009, Boston, MA, USA, April 04-09, pp. 4763–4766. ACM, New York (2009)Google Scholar
  2. 2.
    Cook, D., Schmitter-Edgecombe, M., Crandall, A., Sanders, C., Thomas, B.: Collecting and disseminating smart homes sensor data in the CASAS project. In: Proceedings of the CHI Workshop on Developing Shared Home Behavior Datasets to Advance HCI and Ubiquitous Computing Research (2009)Google Scholar
  3. 3.
    Coyle, L., Ye, J., McKeever, S., Knox, S., Stabeler, M., Dobson, S., Nixon, P.: Gathering Datasets for Activity Identification. In: Workshop on Developing Shared Home Behaviour Datasets to advance HCI and Ubiquitous Computing Research at CHI 2009 (2009)Google Scholar
  4. 4.
    Logan, B., Healey, J., Philipose, M., Tapia, E.M., Intille, S.S.: A long-term evaluation of sensing modalities for activity recognition. In: Krumm, J., Abowd, G.D., Seneviratne, A., Strang, T. (eds.) UbiComp 2007. LNCS, vol. 4717, pp. 483–500. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  5. 5.
    van Kasteren, T., Noulas, A., Englebienne, G., Krose, B.: Accurate activity recognition in a home setting. In: Proceedings of the 10th International Conference on Ubiquitous Computing, pp. 1–9. ACM, New York (2008)Google Scholar
  6. 6.
    Wren, C., Munguia-Tapia, E.: Toward scalable activity recognition for sensor networks. In: Proceedings of the Workshop on Location and Context-Awareness, pp. 218–235 (2006)Google Scholar
  7. 7.
    Munguia-Tapia, E., Intille, S.S., Larson, K.: Activity recognition in the home using simple and ubiquitous sensors. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 158–175. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    van Kasteren, T.L.M., Krose, B.J.A.: A sensing and annotation system for recording datasets from mutliple homes. In: Proceedings of the 27 Annual Conference Extended Abstracts and Human Factors in Computing Systems, CHI 2009, Boston, MA, USA, April 04-09, pp. 4763–4766. ACM, New York (2009)Google Scholar
  9. 9.
    Cruciani, F., Donnelly, M.P., Nugent, C.D., Parente, G., Paggetti, C.: DANTE: a video based annotation tool for smart environments. In: Proceedings of the 2nd International ICST Conference on Sensor Systems and Software (2010)Google Scholar
  10. 10.
    Claron Technology Inc., Micron Tracker (2009), (accessed: January 14, 2011)
  11. 11.
    Nugent, C.D., Mulvenna, M.D., Hong, X., Devlin, S.: Experiences in the development of a Smart Lab. International Journal of Biomedical Engineering and Technology 2(4), 319–331 (2009)CrossRefGoogle Scholar
  12. 12.
    Sun Microsystem Laboratories, Sun SPOT World, (accessed: January 14, 2011)
  13. 13.
    Tynetec, (accessed: February 1, 2011)

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Mark Donnelly
    • 1
  • Tommaso Magherini
    • 1
  • Chris Nugent
    • 1
  • Federico Cruciani
    • 2
  • Cristiano Paggetti
    • 2
  1. 1.Computer Science Research InstituteUniversity of UlsterNewtownabbeyNorthern Ireland
  2. 2.I+ s.r.l.FlorenceItaly

Personalised recommendations