Skip to main content
SpringerLink
Log in

Automatic Behavior Understanding in Crisis Response Control Rooms

  • Conference paper
Ambient Intelligence (AmI 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7683))

Included in the following conference series:

Abstract

This paper addresses the problem of automatic behavior understanding in smart environments. Automatic behavior understanding is defined as the generation of semantic event descriptions from machine perception. Outputs from available perception modalities can be fused into a world model with a single spatiotemporal reference frame. The fused world model can then be used as input by a reasoning engine that generates semantic event descriptions. We use a newly developed annotation tool to generate hypothetical machine perception outputs instead. The applied reasoning engine is based on fuzzy metric temporal logic (FMTL) and situation graph trees (SGTs), promising and universally applicable tools for automatic behavior understanding. The presented case study is automatic behavior report generation for staff training purposes in crisis response control rooms. Various group formations and interaction patterns are deduced from person tracks, object information, and information about gestures, body pose, and speech activity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aggarwal, J.K., Ryoo, M.S.: Human Activity Analysis: A Review. Computing Surveys 43(3), 16:1–16:43 (2011)

    Article  Google Scholar 

  2. Ye, J., Dobson, S., McKeever, S.: Situation Identification Techniques in Pervasive Computing: A Review. Pervasive and Mobile Computing 8(1), 36–66 (2011)

    Article  Google Scholar 

  3. Turaga, P., Chellappa, R., Subrahmanian, V., Udrea, O.: Machine Recognition of Human Activities: A Survey. IEEE Transactions on Circuits and Systems for Video Technology 18(11), 1473–1488 (2008)

    Article  Google Scholar 

  4. Kosmopoulos, D.I., Doulamis, N.D., Voulodimos, A.S.: Bayesian Filter Based Behavior Recognition in Workflows Allowing for User Feedback. Computer Vision and Image Understanding 116(3), 422–434 (2012)

    Article  Google Scholar 

  5. Fischer, Y., Beyerer, J.: Defining Dynamic Bayesian Networks for Probabilistic Situation Assessment. In: Conference on Information Fusion, Internat, FUSION (2012)

    Google Scholar 

  6. Shi, Y., Huang, Y., Minnen, D., Bobick, A., Essa, I.: Propagation Networks for Recognition of Partially Ordered Sequential Action. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 862–869 (2004)

    Google Scholar 

  7. Aloimonos, Y., Guerra-Filho, G., Ogale, A.: The Language of Action: A New Tool for Human-Centric Interfaces. In: Human Centric Interfaces for Ambient Intelligence, pp. 95–131. Elsevier (2009)

    Google Scholar 

  8. Kitani, K.M., Sato, Y., Sugimoto, A.: Recovering the Basic Structure of Human Activities from Noisy Video-Based Symbol Strings. International Journal of Pattern Recognition and Artificial Intelligence 22, 1621–1646 (2008)

    Article  Google Scholar 

  9. Ivanov, Y., Bobick, A.: Recognition of Visual Activities and Interactions by Stochastic Parsing. IEEE Tran. on Pattern Analysis and Machine Intell. 22(8), 852–872 (2000)

    Article  Google Scholar 

  10. van Kasteren, T.L.M., Englebienne, G., Kröse, B.J.A.: Hierarchical Activity Recognition Using Automatically Clustered Actions. In: Keyson, D.V., Maher, M.L., Streitz, N., Cheok, A., Augusto, J.C., Wichert, R., Englebienne, G., Aghajan, H., Kröse, B.J.A. (eds.) AmI 2011. LNCS, vol. 7040, pp. 82–91. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  11. Filippaki, C., Antoniou, G., Tsamardinos, I.: Using Constraint Optimization for Conflict Resolution and Detail Control in Activity Recognition. In: Keyson, D.V., Maher, M.L., Streitz, N., Cheok, A., Augusto, J.C., Wichert, R., Englebienne, G., Aghajan, H., Kröse, B.J.A. (eds.) AmI 2011. LNCS, vol. 7040, pp. 51–60. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  12. Yao, B.Z., Yang, X., Lin, L., Lee, M.W., Zhu, S.C.: I2T: Image Parsing to Text Description. Proceedings of the IEEE 98(8), 1485–1508 (2010)

    Article  Google Scholar 

  13. Ryoo, M., Aggarwal, J.: Semantic Representation and Recognition of Continued and Recursive Human Activities. International Journal of Computer Vision 82, 1–24 (2009)

    Article  Google Scholar 

  14. Gupta, A., Srinivasan, P., Shi, J., Davis, L.: Understanding Videos, Constructing Plots, Learning a Visually Grounded Storyline Model from Annotated Videos. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2012–2019 (2009)

    Google Scholar 

  15. Sadilek, A., Kautz, H.: Location-Based Reasoning about Complex Multi-Agent Behavior. Journal of Artificial Intelligence Research 43, 87–133 (2012)

    MATH  Google Scholar 

  16. Morariu, V., Davis, L.: Multi-Agent Event Recognition in Structured Scenarios. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 3289–3296 (2011)

    Google Scholar 

  17. Kembhavi, A., Yeh, T., Davis, L.: Why Did the Person Cross the Road (There)? Scene Understanding Using Probabilistic Logic Models and Common Sense Reasoning. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part II. LNCS, vol. 6312, pp. 693–706. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  18. Bohlken, W., Neumann, B.: Generation of Rules from Ontologies for High-Level Scene Interpretation. In: Governatori, G., Hall, J., Paschke, A. (eds.) RuleML 2009. LNCS, vol. 5858, pp. 93–107. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  19. Augusto, J.C., Nugent, C.D. (eds.): Designing Smart Homes, The Role of Artificial Intelligence. Springer (2006)

    Google Scholar 

  20. Gottfried, B., Aghajan, H. (eds.): Behaviour Monitoring and Interpretation, Smart Environments. IOS Press (2009)

    Google Scholar 

  21. Gong, S., Xiang, T.: Visual Analysis of Behaviour, From Pixels to Semantics. Springer (2011)

    Google Scholar 

  22. Ley, B., Pipek, V., Reuter, C., Wiedenhoefer, T.: Supporting Improvisation Work in Inter-Organizational Crisis Management. In: ACM Annual Conference on Human Factors in Computing Systems (CHI), pp. 1529–1538 (2012)

    Google Scholar 

  23. Toups, Z.O., Kerne, A., Hamilton, W.A., Shahzad, N.: Zero-Fidelity Simulation of Fire Emergency Response: Improving Team Coordination Learning. In: ACM Annual Conference on Human Factors in Computing Systems (CHI), pp. 1959–1968 (2011)

    Google Scholar 

  24. Nagel, H.H.: Steps Toward a Cognitive Vision System. AI Magazine 25(2), 31–50 (2004)

    MathSciNet  Google Scholar 

  25. Arens, M., Gerber, R., Nagel, H.H.: Conceptual Representations between Video Signals and Natural Language Descriptions. Image and Vision Computing 26(1), 53–66 (2008)

    Article  Google Scholar 

  26. Bellotto, N., Benfold, B., Harland, H., Nagel, H.H., Pirlo, N., Reid, I., Sommerlade, E., Zhao, C.: Cognitive Visual Tracking and Camera Control. Computer Vision and Image Understanding 116(3), 457–471 (2012); Special Issue on Semantic Understanding of Human Behaviors in Image Sequences

    Article  Google Scholar 

  27. Münch, D., IJsselmuiden, J., Grosselfinger, A.-K., Arens, M., Stiefelhagen, R.: Rule-Based High-Level Situation Recognition from Incomplete Tracking Data. In: Bikakis, A., Giurca, A. (eds.) RuleML 2012. LNCS, vol. 7438, pp. 317–324. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  28. Münch, D., Jüngling, K., Arens, M.: Towards a Multi-Purpose Monocular Vision-based High-Level Situation Awareness System. In: International Workshop on Behaviour Analysis and Video Understanding @ ICVS (2011)

    Google Scholar 

  29. González, J., Rowe, D., Varona, J., Roca, F.X.: Understanding Dynamic Scenes Based on Human Sequence Evaluation. Image and Vision Computing 27(10), 1433–1444 (2009); Special Sec. on Comp. Vis. Meth. for Ambient Intelligence

    Article  Google Scholar 

  30. Bellotto, N.: Robot Control Based on Qualitative Representation of Human Trajectories. In: AAAI Symposium on Designing Intelligent Robots: Reintegrating AI (2012)

    Google Scholar 

  31. Münch, D., IJsselmuiden, J., Arens, M., Stiefelhagen, R.: High-Level Situation Recognition Using Fuzzy Metric Temporal Logic, Case Studies in Surveillance and Smart Environments. In: 2nd IEEE Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (ARTEMIS) @ ICCV (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fraunhofer IOSB, Karlsruhe, Germany

    Joris Ijsselmuiden, Ann-Kristin Grosselfinger, David Münch, Michael Arens & Rainer Stiefelhagen

  2. Karlsruhe Institute of Technology, Karlsruhe, Germany

    Rainer Stiefelhagen

Authors
  1. Joris Ijsselmuiden
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ann-Kristin Grosselfinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David Münch
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Arens
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rainer Stiefelhagen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. HIIS Laboratory, CNR-ISTI, Via Moruzzi 1, 56124, Pisa, Italy

    Fabio Paternò  & Carmen Santoro  & 

  2. Philips Research Europe HTC 34, 5656 AE, Eindhoven, The Netherlands

    Boris de Ruyter  & Evert van Loenen  & 

  3. Department of Industrial Design, Eindhoven University of Technology, Den Dolech 2, 5600 MB, Eindhoven, The Netherlands

    Panos Markopoulos

  4. Expertise Centre for Digital Media, Hasselt University – tUL – IBBT, Wetenschapspark 2, B-3590, Diepenbeek, Belgium

    Kris Luyten

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ijsselmuiden, J., Grosselfinger, AK., Münch, D., Arens, M., Stiefelhagen, R. (2012). Automatic Behavior Understanding in Crisis Response Control Rooms. In: Paternò, F., de Ruyter, B., Markopoulos, P., Santoro, C., van Loenen, E., Luyten, K. (eds) Ambient Intelligence. AmI 2012. Lecture Notes in Computer Science, vol 7683. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34898-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34898-3_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34897-6

  • Online ISBN: 978-3-642-34898-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation