Using Cooperative Artefacts as Basis for Activity Recognition

  • Martin Strohbach
  • Gerd Kortuem
  • Hans-Werner Gellersen
  • Christian Kray
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3295)


Ambient intelligent applications require applications to recognise user activity calmly in the background, typically by instrumentation of environments. In contrast, we propose the concept of Cooperative Artefacts (CAs) to instrument single artefacts that cooperate with each other to acquire knowledge about their situation in the world. CAs do not rely on external infrastructure as they implement their architectural components, i.e. perceptual intelligence, domain knowledge and a rule-based inference engine, on embedded devices. We describe the design and implementation of the CA concept on an embedded systems platform and present a case study that demonstrates the potential of the CA approach for activity recognition. In the case study we track surface-based activity of users by augmenting a table and household goods.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Addlesee, M., Curwen, R., Hodges, S., Newman, J., Steggles, P., Ward, A., Hopper, A.: Implementing a Sentient Computing System. IEEE Computer 34(5), 50–56 (2001)Google Scholar
  2. 2.
    Akyildiz, I.F., Su, W., Sankarasubramaniam, Y., Cayirci, E.: Wireless Sensor Networks: A Survey. Computer Networks 38(4), 393–422 (2002)CrossRefGoogle Scholar
  3. 3.
    Antifakos, S., Michahelles, F., Schiele, B.: Proactive Instructions for Furniture Assembly. In: Proc. Ubicomp 2002, Gothenburg, Sweden (September 2002)Google Scholar
  4. 4.
    Basten, T., Geilen, M., de Groot, H. (eds.): Ambient Intelligence: Impact on Embedded System Design. Kluwer Academic Publishers, Boston (2003)zbMATHGoogle Scholar
  5. 5.
    Beigl, M., Gellersen, H., Schmidt, A.: Mediacups: Experience with Design and Use of Computer-Augmented Everyday Artefacts. Computer Networks 35(4) ( March 2001)Google Scholar
  6. 6.
    Brumitt, B., Meyers, B., Krumm, J., Kern, A., Shafer, S.: EasyLiving: Technologies for Intelligent Environments. In: Thomas, P., Gellersen, H.-W. (eds.) HUC 2000. LNCS, vol. 1927, p. 12. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  7. 7.
    Cooperstock, J.R., Fels, S.S., Buxton, W., Smith, K.C.: Reactive Environments: Throwing Away Your Keyboard and Mouse. Comm of the ACM 40(9) (September 1997)Google Scholar
  8. 8.
    Crabtree, A., Rodden, T., Hemmings, T., Benford, S.: Finding a Place for Ubicomp in the Home. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 208–226. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  9. 9.
    Decker, C., Beigl, M., Krohn, A., Robinson, P. and Kubach, U.: eSeal - A System for Enhanced Electronic Assertion of Authenticity and Integrity. In: Proc. Of Pervasive 2004, Vienna, Austria (April 2004) Google Scholar
  10. 10.
    Dey, A.K., Salber, D., Abowd, G.D.: A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Human-Computer Interaction (HCI) Journal 16(2-4), 97–166 (2001)CrossRefGoogle Scholar
  11. 11.
    DIY Smart-its Homepage,
  12. 12.
    Holmquist, L.E., Mattern, F., Schiele, B., Alahuhta, P., Beigl, M., Gellersen, H.-W.: Smart- Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts. In: Proc. Ubicomp 2001, Atlanta, USA (September 2001)Google Scholar
  13. 13.
    Holmquist, L.E., Antifakos, S., Schiele, B., Michahelles, F., Beigl, M., Gaye, L., Gellersen, H.-W., Schmidt, A., Strohbach, M.: Building Intelligent Environments with Smart-Its. In: SIGGRAPH, Emerging Technologies exhibition, San Diego USA (2003)Google Scholar
  14. 14.
    Horn, A.: On sentences which are true of direct unions of algebras. Journal of Symbolic Logic 16, 14–21 (1951)zbMATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Kidd, C., Orr, R., Abowd, G., Atkeson, C., Essa, I., MacIntyre, B., Mynatt, E., Starner, T., Newstetter, W.: The Aware Home: A Living Laboratory for Ubiquitous Computing Research. In: Proc. Cooperative Buildings, CoBuild 1999, Pittsburgh (October 1999) Google Scholar
  16. 16.
    Kindberg, T., et al.: People, Places, Things: Web Presence for the Real World. In: MONET, October 2002, vol. 7(5), Kluwer Publ., Dordrecht (2002)Google Scholar
  17. 17.
    Lamming, M., Bohm, D.: SPECs: Another Approach to Human Context and Activity Sensing Research. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 192–199. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  18. 18.
    Lampe, M., Strassner, M.: The Potential of RFID for Movable Asset Management. In: Workshop on Ubiquitous Commerce at Ubicomp 2003, Seattle (October 2003)Google Scholar
  19. 19.
    Lukowicz, P. et al.: Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers. In: Proc. Pervasive 2004, Vienna, Austria (2004) Google Scholar
  20. 20.
    Pentland, A.: Smart rooms. Scientific American 274, 54–62 (1996)CrossRefGoogle Scholar
  21. 21.
    Rekimoto, J., Ayatsuka, Y.: CyberCode: Designing Augmented Reality Environments with Visual Tags. In: Proc. Designing Augmented Reality Environments (DARE 2000) (2000) Google Scholar
  22. 22.
    Schilit, B., Adams, N., Want, R.: Context-aware computing applications. In: Proc. WMCSA 1994 (1994)Google Scholar
  23. 23.
    Schmidt, A., Aidoo, K.A., Takaluoma, A., Tuomela, U., Van Laerhoven, K., Van de Velde, W.: Advanced Interaction in Context. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, p. 89. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  24. 24.
    Schmidt, A., Strohbach, M., Van Laerhoven, K., Friday, A., Gellersen, H.-W.: Context Acquisition based on Load Sensing. In: Proc. of Ubicomp 2002, Gothenburg, Sweden (2002)Google Scholar
  25. 25.
    Schmidt, A., Strohbach, M., Van Laerhoven, K., Gellersen, H.-W.: Ubiquitous interaction - Using surfaces in everyday environments as pointing devices. In: Carbonell, N., Stephanidis, C. (eds.) UI4ALL 2002. LNCS, vol. 2615, pp. 263–279. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  26. 26.
    Siegemund, F., Flörkemeier, C.: Interaction in Pervasive Computing Settings using Bluetooth-enabled Active Tags and Passive RFID Technology together with Mobile Phones. In: Proc. IEEE PerCom 2003, March 2003, Fort Worth, USA (2003) Google Scholar
  27. 27.
    Starner, T., Schiele, B., Pentland, A.: Visual Context awareness in Wearable Computing. In: Proc. Intl. Symp. on Wearable Computing (ISWC 1998), Pittsburgh, pp. 50-57 (October 1998) Google Scholar
  28. 28.
    Strohbach, M., Gellersen, H.-W., Kortuem, G., Kray, C.: Cooperative Artefacts: Assessing Real World Situations with Embedded Technology. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, pp. 250–267. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  29. 29.
    Tapia, E. M., Intille, S., Larson, K.: Activity Recognition in the Home using Simple and Ubiquitous Sensors. In: Proc. Pervasive 2004, Vienna (April 2004) Google Scholar
  30. 30.
    Terada, T., Tsukamoto, M., Hayakawa, K., Yoshihisa, T., Kishino, Y., Kashitani, A. and Nishio, S.: Ubiquitous Chip: a Rule-based I/O Control Device for Ubiquitous Computing. In: Proc. of Pervasive 2004, Vienna (April 2004) Google Scholar
  31. 31.
    Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid Journal 1.01 (July 1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Martin Strohbach
    • 1
  • Gerd Kortuem
    • 1
  • Hans-Werner Gellersen
    • 1
  • Christian Kray
    • 1
  1. 1.Computing DepartmentLancaster UniversityLancaster

Personalised recommendations