Abstract
Lifted inference approaches reduce computational work as inference is performed using representatives for sets of indistinguishable random variables, which allows for tractable inference w.r.t. domain sizes in dynamic probabilistic relational models. Unfortunately, maintaining a lifted representation is challenging in practically relevant application domains, as evidence often breaks symmetries making lifted techniques fall back on their ground counterparts. In existing approaches asymmetric evidence is counteracted by merging similar but distinguishable objects when moving forward in time. While undoing splits a posteriori is reasonable, we propose learning approximate model symmetries a priori to prevent unnecessary splits due to inaccuracy or one-time events. In particular, we propose a multivariate ordinal pattern symbolization approach followed by spectral clustering to determine sets of domain entities behaving approximately the same over time. By using object clusters, we avoid unnecessary splits by keeping entities together that tend to behave the same over time. Understanding symmetrical and asymmetrical entity behavior a priori allows for increasing accuracy in inference by means of inferred evidence for unobserved entities to better represent reality. Empirical results show that our approach reduces unnecessary splits, i.e., improves runtimes, while keeping accuracy in inference high.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
pronounced deeper models.
- 2.
- 3.
References
Bandt, C., Pompe, B.: Permutation entropy: a natural complexity measure for time series. Phys. Rev. Lett. 88(17) (2002). https://doi.org/10.1103/PhysRevLett.88.174102
Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton legacy library, Princeton University Press (2015). https://books.google.de/books?id=iwbWCgAAQBAJ
Bertozzi, A.L., Merkurjev, E.: Chapter 12 - Graph-based optimization approaches for machine learning, uncertainty quantification and networks. In: Kimmel, R., Tai, X.C. (eds.) Processing, Analyzing and Learning of Images, Shapes, and Forms: Part 2, Handbook of Numerical Analysis, vol. 20, pp. 503–531. Elsevier (2019). https://doi.org/10.1016/bs.hna.2019.04.001, https://www.sciencedirect.com/science/article/pii/S157086591930002X
Van den Broeck, G., Niepert, M.: Lifted probabilistic inference for asymmetric graphical models. In: Proceedings of the 29th Conference on Artificial Intelligence (AAAI) (2015)
Chiu, B., Keogh, E., Lonardi, S.: Probabilistic discovery of time series motifs. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD 2003, New York, NY, USA, pp. 493–498 (2003)
Finke, N., Gehrke, M., Braun, T., Potten, T., Möller, R.: Investigating matureness of probabilistic graphical models for dry-bulk shipping. In: Jaeger, M., Nielsen, T.D. (eds.) Proceedings of the 10th International Conference on Probabilistic Graphical Models. Proceedings of Machine Learning Research, vol. 138, pp. 197–208. PMLR, 23–25 September 2020
Gehrke, M., Braun, T., Möller, R.: Lifted dynamic junction tree algorithm. In: Chapman, P., Endres, D., Pernelle, N. (eds.) ICCS 2018. LNCS (LNAI), vol. 10872, pp. 55–69. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91379-7_5
Gehrke, M., Möller, R., Braun, T.: Taming reasoning in temporal probabilistic relational models. In: Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020) (2020). https://doi.org/10.3233/FAIA200395
Keller, K., Maksymenko, S., Stolz, I.: Entropy determination based on the ordinal structure of a dynamical system. Discrete Continuous Dyn. Syst. Ser. B 20(10), 3507–3524 (2015). https://doi.org/10.3934/dcdsb.2015.20.3507
Keller, K., Mangold, T., Stolz, I., Werner, J.: Permutation entropy: new ideas and challenges. Entropy 19(3), 134 (2017). https://doi.org/10.3390/e19030134
Kimmig, A., Mihalkova, L., Getoor, L.: Lifted graphical models: a survey. Mach. Learn. 99(1), 1–45 (2014). https://doi.org/10.1007/s10994-014-5443-2
Mohr, M., Wilhelm, F., Hartwig, M., Möller, R., Keller, K.: New approaches in ordinal pattern representations for multivariate time series. In: Proceedings of the 33rd International Florida Artificial Intelligence Research Society Conference (FLAIRS-33), pp. 124–129. AAAI Press (2020)
Myers, A., Khasawneh, F.A.: On the automatic parameter selection for permutation entropy. Chaos Interdiscip. Jo. Nonlinear Sci. 30(3), 033130 (2020). https://doi.org/10.1063/1.5111719, https://aip.scitation.org/doi/10.1063/1.5111719, publisher: American Institute of Physics
Niepert, M., Van den Broeck, G.: Tractability through exchangeability: a new perspective on efficient probabilistic inference. In: AAAI-14 Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp. 2467–2475. AAAI Press (2014)
Piek, A.B., Stolz, I., Keller, K.: Algorithmics, possibilities and limits of ordinal pattern based entropies. Entropy 21(6), 547 (2019). https://doi.org/10.3390/e21060547
Poole, D.: First-order probabilistic inference. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence, pp. 985–991. IJCAI Organization (2003)
Riedl, M., Müller, A., Wessel, N.: Practical considerations of permutation entropy: a tutorial review. Eur. Phys. J. Spec. Top. 222 (2013). https://doi.org/10.1140/epjst/e2013-01862-7
Singla, P., Nath, A., Domingos, P.: Approximate lifting techniques for belief propagation. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, pp. 2497–2504. AAAI 2014. AAAI Press (2014)
Stolz, I., Keller, K.: A general symbolic approach to Kolmogorov-Sinai entropy. Entropy 19(12), 675 (2017). https://doi.org/10.3390/e19120675
Venugopal, D., Gogate, V.: Evidence-based clustering for scalable inference in Markov logic. In: Calders, T., Esposito, F., Hüllermeier, E., Meo, R. (eds.) ECML PKDD 2014. LNCS (LNAI), vol. 8726, pp. 258–273. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44845-8_17
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix
Appendix
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Finke, N., Mohr, M. (2021). A Priori Approximation of Symmetries in Dynamic Probabilistic Relational Models. In: Edelkamp, S., Möller, R., Rueckert, E. (eds) KI 2021: Advances in Artificial Intelligence. KI 2021. Lecture Notes in Computer Science(), vol 12873. Springer, Cham. https://doi.org/10.1007/978-3-030-87626-5_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-87626-5_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87625-8
Online ISBN: 978-3-030-87626-5
eBook Packages: Computer ScienceComputer Science (R0)