Abstract
We address the problem of visual event recognition in surveillance where noise and missing observations are serious problems. Common sense domain knowledge is exploited to overcome them. The knowledge is represented as first-order logic production rules with associated weights to indicate their confidence. These rules are used in combination with a relaxed deduction algorithm to construct a network of grounded atoms, the Markov Logic Network. The network is used to perform probabilistic inference for input queries about events of interest. The system’s performance is demonstrated on a number of videos from a parking lot domain that contains complex interactions of people and vehicles.
This research was funded in part by the U.S. Government VACE program.
Chapter PDF
Similar content being viewed by others
References
Richardson, M., Domingos, P.: Markov Logic Networks. Machine Learning 62, 107–136 (2006)
Nevatia, R., Zhao, T., Hongeng, S.: Hierarchical language-based representation of events in video stream. In: Proc. of CVPRW on Event Mining, pp. 39–47. IEEE, Los Alamitos (2003)
Yamato, J., Ohya, J., Ishi, K.: Recognizing human action in time-sequential images using Hidden Markov models. In: Proc. CVPR 1992, pp. 379–385. IEEE, Los Alamitos (1992)
Rota, N., Thonnat, M.: Activity recognition from video sequences using declarative models. In: Proc. ECAI 2002, pp. 673–680 (2002)
Shet, V., Harwood, D., Davis, L.: Multivalued default logic for identity maintenance in visual surveillance. In: Proc. ECCV 2006. LNCS, vol. 4, pp. 119–132. Springer, Heidelberg (2006)
Shet, V., Neumann, J., Ramesh, V., Davis, L.: Bilattice-based logical reasoning for human detection. In: Proc. CVPR 2007, pp. 1–8. IEEE, Los Alamitos (2007)
Getoor, L., Taskar, B.: Intro. to Statistical Relational Learning. MIT Press, Cambridge (2007)
Liao, L., Fox, D., Kautz, H.: Location-based activity recognition using Relational Markov Networks. In: Proc. IJCAI 2005, pp. 773–778. Morgan Kaufmann, Inc., San Francisco (2005)
Pentney, W., Popescu, A., Wang, S., Kautz, H., Philipose, M.: Sensor-based understanding of daily life via large-scale use of common sense. In: Proc. AAAI 2006 (2006)
Biswas, R., Thrun, S., Fujimura, K.: Recognizing activities with multiple cues. In: IEEE Works. on Human Motion, pp. 255–270 (2007)
Bobick, A., Ivanov, Y.: Action recognition using probabilistic parsing. In: CVPR 1998, pp. 196–202 (1998)
Kok, S., Singla, P., Richardson, M., Domingos, P.: The Alchemy system for statistical relational AI. Tech Report - CS Dept., Univ. of Washington (2005)
Minker, J., Seipel, D.: Disjunctive logic programming: A survey and assessment. In: Computational Logic, London, UK, pp. 472–511. Springer, Heidelberg (2002)
Singla, P., Domingos, P.: Memory-efficient inference in relational domains. In: Proc. AAAI 2006, AAAI Press, Menlo Park (2006)
Singla, P., Domingos, P.: Entity resolution with Markov Logic. In: Proc. ICDM, pp. 572–582. IEEE, Los Alamitos (2006)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. CVPR 2005, vol. 2, pp. 886–893. IEEE, Los Alamitos (2005)
Liu, H.: The ConceptNet Project, http://web.media.mit.edu/~hugo/conceptnet/
Stork, D.: The OpenMind Initiative, http://www.openmind.org/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tran, S.D., Davis, L.S. (2008). Event Modeling and Recognition Using Markov Logic Networks. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5303. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88688-4_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-88688-4_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88685-3
Online ISBN: 978-3-540-88688-4
eBook Packages: Computer ScienceComputer Science (R0)