A Probabilistic Relational Model for Characterizing Situations in Dynamic Multi-Agent Systems
Artificial systems with a high degree of autonomy require reliable semantic information about the context they operate in. State interpretation, however, is a difficult task. Interpretations may depend on a history of states and there may be more than one valid interpretation. We propose a model for spatio-temporal situations using hidden Markov models based on relational state descriptions, which are extracted from the estimated state of an underlying dynamic system. Our model covers concurrent situations, scenarios with multiple agents, and situations of varying durations. To evaluate the practical usefulness of our model, we apply it to the concrete task of online traffic analysis.
KeywordsHide Markov Model Abstract State Situation Model Observation Sequence Relational Description
Unable to display preview. Download preview PDF.
- ANDERSON, C. R., DOMINGOS, P. and WELD, D. A. (2002): Relational Markov models and their application to adaptive web navigation. Proc. of the International Conference on Knowledge Discovery and Data Mining (KDD).Google Scholar
- COCORA, A., KERSTING, K., PLAGEMANN, C. and BURGARD, W. and DE RAEDT, L. (2006): Learning Relational Navigation Policies. Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).Google Scholar
- COLLETT, T., MACDONALD, B. and GERKEY, B. (2005): Player 2.0: Toward a Practi-cal Robot Programming Framework. In: Proceedings of the Australasian Conference on Robotics and Automation (ACRA 2005).Google Scholar
- DURBIN, R., EDDY, S., KROGH, A. and MITCHISON, G. (1998):Biological Sequence Anal-ysis. Cambridge University Press.Google Scholar
- FERN, A. and GIVAN, R. (2004): Relational sequential inference with reliable observations. Proc. of the International Conference on Machine Learning.Google Scholar
- JEFFREYS, H. (1961): Theory of Probability (3rd ed.). Oxford University Press.Google Scholar
- KERSTING, K., DE RAEDT, L. and RAIKO, T. (2006): Logical Hidden Markov Models. Journal of Artificial Intelligence Research.Google Scholar
- MANNING, C.D. and SCHÜTZE, H. (1999): Foundations of Statistical Natural Language Processing. The MIT Press.Google Scholar
- ESPIÉ, E. and GUIONNEAU, C. TORCS- The Open Racing Car Simulator. http://torcs.sourceforge.net