DyBaNeM: Bayesian Episodic Memory Framework for Intelligent Virtual Agents

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8108)


Episodic Memory (EM) abilities are important for many types of intelligent virtual agents (IVAs). However, the few IVA–EM systems implemented to date utilize indexed logs of events as the underlying memory representation, which makes it hard to model some crucial facets of human memory, including hierarchical organization of episodes, reconstructive memory retrieval, and encoding of episodes with respect to previously learnt schemata. Here, we present a new general framework for EM modeling, DyBaNeM, which capitalizes on bayesian representation and, consequently, enables modeling these (and other) features easily. By means of a proof-of-concept implementation, we demonstrate that our approach to EM modeling is promising, at least for domains of moderate complexity.


Episodic Memory Dynamic Bayes Networks Dialog 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Anderson, J.: A Spreading Activation Theory of Memory. Journal of Verbal Learning and Verbal Behavior 22, 261–295 (1983)CrossRefGoogle Scholar
  2. 2.
    Bartlett, F.: Remembering: A Study in Experimental and Social Psychology. Cambridge University Press, Cambridge (1932)Google Scholar
  3. 3.
    Bickmore, T., Schulman, D., Yin, L.: Engagement vs. Deceit: Virtual Humans with Human Autobiographies. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 6–19. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  4. 4.
    Blaylock, N., Allen, J.: Fast Hierarchical Goal Schema Recognition. In: Proceedings of the National Conference on Artificial Intelligence (AAAI 2006), pp. 796–801 (2006)Google Scholar
  5. 5.
    Brom, C., Burkert, O., Kadlec, R.: Timing in Episodic Memory for Virtual Characters. In: Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games, pp. 305–312 (2010)Google Scholar
  6. 6.
    Brom, C., Pešková, K., Lukavský, J.: What Does Your Actor Remember? Towards Characters with a Full Episodic Memory. In: Cavazza, M., Donikian, S. (eds.) ICVS 2007. LNCS, vol. 4871, pp. 89–101. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    Bui, H.: A general model for online probabilistic plan recognition. In: International Joint Conference on Artificial Intelligence, pp. 1309–1318 (2003)Google Scholar
  8. 8.
    Deutsch, T., Gruber, A., Lang, R., Velik, R.: Episodic memory for autonomous agents. In: Human System Interactions (HSI 2008), pp. 621–626 (2008)Google Scholar
  9. 9.
    Dias, J., Ho, W.C., Vogt, T., Beeckman, N., Paiva, A., André, E.: I Know What I Did Last Summer: Autobiographic Memory in Synthetic Characters. In: Paiva, A., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 606–617. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    Dodd, W., Gutierrez, R.: The Role of Episodic Memory and Emotion in a Cognitive Robot. In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005, pp. 692–697 (2005)Google Scholar
  11. 11.
    Gallo, D.: Associative illusions of memory: False memory research in DRM and related tasks. Psychology Press (2006)Google Scholar
  12. 12.
    Gemrot, J., Kadlec, R., Bída, M., Burkert, O., Píbil, R., Havlíček, J., Zemčák, L., Šimlovič, J., Vansa, R., Štolba, M., Plch, T., Brom, C.: Pogamut 3 Can Assist Developers in Building AI (Not Only) for Their Videogame Agents. In: Dignum, F., Bradshaw, J., Silverman, B., van Doesburg, W. (eds.) Agents for Games and Simulations. LNCS, vol. 5920, pp. 1–15. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  13. 13.
    Ho, W.C., Dautenhahn, K., Nehaniv, C.: Computational Memory Architectures for Autobiographic Agents Interacting in a Complex Virtual Environment: A Working Model. Connection Science 20(1), 21–65 (2008)CrossRefGoogle Scholar
  14. 14.
    Itti, L., Baldi, P.: Bayesian surprise attracts human attention. Vision Research 49(10), 1295–1306 (2009)CrossRefGoogle Scholar
  15. 15.
    Kadlec, R., Brom, C.: DyBaNeM: Bayesian Framework for Episodic Memory Modelling. In: The 12th International Conference on Cognitive Modelling, ICCM (in press, 2013)Google Scholar
  16. 16.
    Kadlec, R., Brom, C.: Unifying episodic memory models for artificial agents with activity recognition problem and compression algorithms: review of recent work and prospects. Tech. rep. (2013)Google Scholar
  17. 17.
    Kadlec, R., Čermák, M., Behan, Z., Brom, C.: Generating Corpora of Activities of Daily Living and Towards Measuring the Corpora’s Complexity. In: Dignum, F., Brom, C., Hindriks, K., Beer, M., Richards, D. (eds.) CAVE 2012. LNCS, vol. 7764, pp. 149–166. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  18. 18.
    Koller, D., Friedman, N.: Probabilistic graphical models: principles and techniques. The MIT Press (2009)Google Scholar
  19. 19.
    Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 329–343. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  20. 20.
    Kullback, S.: Statistics and information theory (1959)Google Scholar
  21. 21.
    Lim, M.Y.: Memory models for intelligent social companions. In: Zacarias, M., de Oliveira, J.V. (eds.) Human-Computer Interaction. SCI, vol. 396, pp. 241–262. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  22. 22.
    Lim, M., Aylett, R., Enz, S., Ho, W.: Forgetting Through Generalisation — A Companion with Selective Memory. In: AAMAS 2011, pp. 1119–1120 (2011)Google Scholar
  23. 23.
    Nuxoll, A.M., Laird, J.E.: Enhancing intelligent agents with episodic memory. Cognitive Systems Research 17-18, 34–48 (2012)CrossRefGoogle Scholar
  24. 24.
    Rabe, F., Wachsmuth, I.: Cognitively Motivated Episodic Memory for a Virtual Guide. In: ICAART, pp. 524–527 (2012)Google Scholar
  25. 25.
    Schank, R.C.: Dynamic memory revisited. Cambridge University Press (1999)Google Scholar
  26. 26.
    Subagdja, B., Wang, W., Tan, A.H., Tan, Y.S., Teow, L.N.: Memory Formation, Consolidation, and Forgetting in Learning Agents. In: AAMAS 2012, pp. 1007–1014 (2012)Google Scholar
  27. 27.
    Tulving, E.: Elements of Episodic Memory. Clarendon Press, Oxford (1983)Google Scholar
  28. 28.
    Čermák, M., Kadlec, R., Brom, C.: Towards modeling false memory using virtual characters: a position paper. In: Symposium on Human Memory for Artificial Agents, AISB, pp. 25–29 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Faculty of Mathematics and PhysicsCharles University in PragueCzech Republic

Personalised recommendations