A Dialogue Interface for Investigating Human Activities in Surveillance Videos



In this paper we present a dialogue interface for investigating human activities in surveillance videos. The interface exploits the information computed by the recognition system to support users in the investigation process. The interaction dialogue is supported by a sketch language enabling users to easily specify various kinds of questions about both actions and states, and the nature of the response one wishes. The contribution of this research is twofold (1) proposing an intuitive interaction mechanism for surveillance video investigation, and (2) proposing a novel question–answering model to support users during the information-seeking process.


  1. 1.
    Christel, M. G., and Yan, R. Merging Storyboard Strategies and Automatic Retrieval for Improving Interactive Video Search, in Proceedings of CIVR 2007, 486–493.Google Scholar
  2. 2.
    Davidson, I., and Ward, M. A Particle Visualization Framework for Clustering and Anomaly Detection, in Proceedings of KDD Workshop on Visual Data Mining, 2001.Google Scholar
  3. 3.
    Deufemia, V., Giordano, M., Polese, G., Vacca, M. A Conceptual Approach for Active Surveillance of Indoor Environments, in Proceedings of DMS’07, 45–50.Google Scholar
  4. 4.
    Driver, J. L. (1984) Metaquestions, Nous 18, 299–309.Google Scholar
  5. 5.
    Fusier, F., Valentin, V., Brémond, F., Thonnat, M., Borg, M., Thirde, D., and Ferryman, J. (2007) Video Understanding for Complex Activity Recognition, Journal of Machine Vision and Application 18: 167–188.Google Scholar
  6. 6.
    Hu, W., Xie, D., Fu, Z., Zeng, W. and Maybank, S. (2007) Semantic-Based Surveillance Video Retrieval, IEEE Trans. on Image Processing 16(4):1168–1181.Google Scholar
  7. 7.
    Katz, B., Lin, J. J., Stauffer, C., Grimson, W. E. L. (2003) Answering Questions about Moving Objects in Surveillance Videos, in Proceedings of AAAI Spring Symposium on New Directions in Question Answering, 145–152.Google Scholar
  8. 8.
    Kim, K. Chalidabhongse, T. H. Harwood, D. and Davis, L. (2004) Background Modeling and Subtraction by Codebook Construction, in Proceedings of IEEE International Conference on Image Processing, 3061–3064.Google Scholar
  9. 9.
    Maybury, M. T. and Wahlster, W. (1998) Intelligent User Interface: An Introduction, Readings in Intelligent User Interfaces, 1–14, Morgan Kaufmann Press.Google Scholar
  10. 10.
    Salton, G., Fox, E. A., and Voorhees, E. (1985) Advanced Feedback Methods in Information Retrieval, Journal of the American Society for Information Science 36(3): 200–210.Google Scholar
  11. 11.
    Schank, R. C., and Abelson, R. (1977) Script Plans Goals and Understanding, Lawrence Erlbaum Associates.Google Scholar
  12. 12.
    Walton, D. (2000) The Place of Dialogue Theory in Logic, Computer Science and Communication Studies Synthese, 123: 327–346.Google Scholar
  13. 13.
    Wisniewski, A. (1995) The Posing of Questions, Logical Foundations of Erotetic Inferences, Kluwer.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • V. Deufemia
    • 1
  • M. Giordano
    • 1
  • G. Polese
    • 1
  • G. Tortora
    • 1
  1. 1.Dipartimento di Matematica e InformaticaUniversity of SalernoSalernoItaly

Personalised recommendations