Mobile Networks and Applications

, Volume 18, Issue 3, pp 326–340 | Cite as

Towards Collaborative Group Activity Recognition Using Mobile Devices

  • Dawud Gordon
  • Jan-Hendrik Hanne
  • Martin Berchtold
  • Ali Asghar Nazari Shirehjini
  • Michael Beigl
Article

Abstract

In this paper, we present a novel approach for distributed recognition of collaborative group activities using only mobile devices and their sensors. Information must be exchanged between nodes for effective group activity recognition (GAR). Here we investigated the effects of exchanging that information at different data abstraction levels with respect to recognition rates, power consumption, and wireless communication volumes. The goal is to identify the tradeoff between energy consumption and recognition accuracy for GAR problems. For the given set of activities, using locally extracted features for global, group activity recognition is advantageous as energy consumption was reduced by 10 % without experiencing any significant loss in recognition rates. Using locally classified single-user activities, however, caused a 47 % loss in recognition capabilities, making this approach unattractive. Local clustering proved to be effective for recognizing group activities, by greatly reducing power consumption while incurring a loss of only 2.8 % in recognition accuracy.

Keywords

Group activity recognition Context recognition Distributed systems Multi-user Wearable 

References

  1. 1.
    Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Pervasive, pp 1–17Google Scholar
  2. 2.
    Beigl M, Gellersen H-W, Schmidt A (2001) Mediacups: experience with design and use of computer-augmented everyday. Comput Netw 35:401–409CrossRefGoogle Scholar
  3. 3.
    Berchtold M, Budde M, Gordon D, Schmidtke H, Beigl M (2010) ActiServ: activity recognition service for mobile phones. In: ISWC’10: Proceedings of the 14th international symposium on wearable computers. IEEE Computer Society, Seoul, pp 83–90Google Scholar
  4. 4.
    Bishop CM (2006) Pattern ecognition and machine learning. Springer, 1st edn. Corr. 2nd printing edn, October 2006Google Scholar
  5. 5.
    Blanke U, Schiele B (2009) Daily routine recognition through activity spotting. In: Proceedings of the 4th international symposium on location and context awareness, LoCA ’09. Springer, Berlin, pp 192–206CrossRefGoogle Scholar
  6. 6.
    Blumer H (1951) Collective behavior. Irvington PublishersGoogle Scholar
  7. 7.
    Boin A, McConnell A (2007) Preparing for critical infrastructure breakdowns: the limits of crisis management and the need for resilience. JCCM 15(1):50–59Google Scholar
  8. 8.
    Chang M-C, Krahnstoever N, Lim S, Yu T (2010) Group level activity recognition in crowded environments across multiple cameras. In: IEEE conference on advanced video and signal based surveillance. IEEE Computer Society, Los AlamitosGoogle Scholar
  9. 9.
    Dong W, Lepri B, Cappelletti A, Pentland AS, Pianesi F, Zancanaro M (2007) Using the influence model to recognize functional roles in meetings. In: Proceedings of the 9th international conference on multimodal interfaces, ICMI ’07. ACM. New York, pp 271–278CrossRefGoogle Scholar
  10. 10.
    Dunkels A, Grönvall B, Voigt T (2004) Contiki—a lightweight and flexible operating system for tiny networked sensors. In: Proceedings of the 1st IEEE workshop on embedded networked sensors (Emnets-I). Tampa, Florida, USAGoogle Scholar
  11. 11.
    Gong S, Xiang T (2003) Recognition of group activities using dynamic probabilistic networks. In: Proceedings of the 9th IEEE international conference on computer vision, ICCV ’03, vol 2. IEEE Computer Society, Washington, DC, p 742CrossRefGoogle Scholar
  12. 12.
    Gordon D, Czerny J, Miyaki T, Beigl M (2012) Energy-efficient activity recognition using prediction. In: 16th international symposium on wearable computers (ISWC), pp 29–36Google Scholar
  13. 13.
    Gordon D, Hanne J-H, Berchtold M, Miyaki T, Beigl M (2011) Recognizing group activities using wearable sensors. In: 8th annual international mobile and ubiquitous systems: networking services, MobiQuitous. MobiQuitous ’11Google Scholar
  14. 14.
    Gordon D, Hanne J-H, Berchtold M, Miyaki T, Beigl M (2011) An experiment in hierarchical recognition of group activities using wearable sensors. In: Proceedings of the 7th conference on modeling and using context (CONTEXT). Springer, pp 108–114Google Scholar
  15. 15.
    Gordon D, Scholz M, Ding Y, Beigl M (2011) Global peer-to-peer classification in mobile ad-hoc networks: a requirements analysis. In: Proceedings of the 7th conference on Modeling and using context (CONTEXT). Springer, pp 108–114Google Scholar
  16. 16.
    Gu T, Wu Z, Wang L, Tao X, Lu J (2009) Mining emerging patterns for recognizing activities of multiple users in pervasive computing. In: The 6th annual international conference on mobile and ubiquitous systems, pp 1–10Google Scholar
  17. 17.
    Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. SIGKDD Explor Newsl 11:10–18CrossRefGoogle Scholar
  18. 18.
    Hsu JY-J, Lian C-C, Jih W-R (2011) Probabilistic models for concurrent chatting activity recognition. ACM Trans Intell Syst Technol 2:4:1–4:20Google Scholar
  19. 19.
    Hwang I, Jang H, Park T, Choi A, Lee Y, Hwang C, Choi Y, Nachman L, Song J (2012) Leveraging childrens behavioral distribution and singularities in new interactive environments: study in kindergarten field trips. In: 10th international conference on pervasive computingGoogle Scholar
  20. 20.
    Li R, Chellappa R, Zhou SK (2009) Learning multi-modal densities on discriminative temporal interaction manifold for group activity recognition. In: IEEE conference on computer vision and pattern recognition, CVPR 2009, pp 2450–2457Google Scholar
  21. 21.
    Loy CC, Xiang T, Gong S (2010) Time-delayed correlation analysis for multi-camera activity understanding. Int J Comput Vis 90(1):106–129CrossRefGoogle Scholar
  22. 22.
    Roggen D, Wirz M, Tröster G, Helbing D (2011) Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods. Networks 6(3):521–524MathSciNetGoogle Scholar
  23. 23.
    Schmidt A (2003) Ubiquitous computing—computing in context. PhD thesis, Lancaster UniversityGoogle Scholar
  24. 24.
    Scholl PM, Van Laerhoven K, Gordon D, Scholz M, Berning M (2012) Jnode: a sensor network platform that supports distributed inertial kinematic monitoring. In: 9th international conference on networked sensing systems (INSS)Google Scholar
  25. 25.
    Sigg S, Gordon D, von Zengen G, Beigl M, Haseloff S, David K (2011) Investigation of context prediction accuracy for different context abstraction levels. IEEE Trans Mob Comput 11(6):1047–1059CrossRefGoogle Scholar
  26. 26.
    Stäger M, Lukowicz P, Tröster G (2007) Power and accuracy trade-offs in sound-based context recognition systems. Pervasive Mobile Comput 3:300–327CrossRefGoogle Scholar
  27. 27.
    Sumpter DJT (2006) The principles of collective animal behaviour. Phil Trans R Soc B 361(1465):5–22CrossRefGoogle Scholar
  28. 28.
    Wang L, Gu T, Tao X, Chen H, Lu J (2011) Recognizing multi-user activities using wearable sensors in a smart home. Pervasive Mobile Comput 7(3):287–298CrossRefGoogle Scholar
  29. 29.
    Want R, Hopper A (1992) Active badges and personal interactive computing objects. IEEE Trans Consumer Electron 38(1):10–20CrossRefGoogle Scholar
  30. 30.
    Wirz M, Roggen D, Tröster G (2009) Decentralized detection of group formations from wearable acceleration sensors. In: IEEE on proceedings of the international conference on computational science and engineering, pp 952–959Google Scholar

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  • Dawud Gordon
    • 1
  • Jan-Hendrik Hanne
    • 2
  • Martin Berchtold
    • 3
  • Ali Asghar Nazari Shirehjini
    • 1
  • Michael Beigl
    • 1
  1. 1.Karlsruhe Institute of Technology (KIT)KarlsruheGermany
  2. 2.Technische Universität BraunschweigBraunschweigGermany
  3. 3.AGT Group GmbHDarmstadtGermany

Personalised recommendations