Ontology-Based Realtime Activity Monitoring Using Beam Search
In this contribution we present a realtime activity monitoring system, called SCENIOR (SCEne Interpretation with Ontology-based Rules) with several innovative features. Activity concepts are defined in an ontology using OWL, extended by SWRL rules for the temporal structure, and are automatically transformed into a high-level scene interpretation system based on JESS rules. Interpretation goals are transformed into hierarchical hypotheses structures associated with constraints and embedded in a probabilistic scene model. The incremental interpretation process is organised as a Beam Search with multiple parallel interpretation threads. At each step, a context-dependent probabilistic rating is computed for each partial interpretation reflecting the probability of that interpretation to reach completion. Low-rated threads are discarded depending on the beam width. Fully instantiated hypotheses may be used as input for higher-level hypotheses, thus realising a doubly hierarchical recognition process. Missing evidence may be "hallucinated" depending on the context. The system has been evaluated with real-life data of aircraft service activities.
KeywordsPartial Interpretation Markov Logic Network Primitive Event Scene Interpretation SWRL Rule
Unable to display preview. Download preview PDF.
- 2.Cohn, A.G., Magee, D., Galata, A., Hogg, D., Hazarika, S.: Towards an architecture for cognitive vision using qualitative spatio-temporal representations and abduction. In: Freksa, C., Brauer, W., Habel, C., Wender, K.F. (eds.) Spatial Cognition III. LNCS (LNAI), vol. 2685, pp. 232–248. Springer, Heidelberg (2003)CrossRefGoogle Scholar
- 5.Morariu, V.I., Davis, L.S.: Multi-agent event recognition in structured scenarios. In: CVPR 2011, IEEE Conference on Computer Vision and Pattern Recognition (2011)Google Scholar
- 6.Neumann, B.: Bayesian Compositional Hierarchies - A Probabilistic Structure for Scene Interpretation. TR FBI-HH-B-282/08, Univ. of Hamburg, Dep. of Informatics (2008)Google Scholar
- 8.Norvig, P.: Paradigms of Artificial Intelligence. Morgan Kaufmann, San Francisco (1992)Google Scholar