Abstract
Agent-based modeling is used to simulate human behaviors in different fields. The process of building believable models of human behavior requires that domain experts and Artificial Intelligence experts work closely together to build custom models for each domain, which requires significant effort. The aim of this study is to automate at least some parts of this process. We present an algorithm called 
, which produces an agent behavioral model from raw observational data. It calculates transition probabilities between actions and identifies decision points at which the agent requires additional information in order to choose the appropriate action. Our experiments using synthetically-generated data and real-world data from a hospital setting show that the 
algorithm can automatically produce an agent decision process. The agent’s underlying behavior can then be modified by domain experts, thus reducing the complexity of producing believable agent behavior from field data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bentivegna, D.C., Atkenson, C.G., Cheng, G.: Learning tasks from observation and practice. Robot. Auton. Syst. 47(2), 163–169 (2004)
Cook, D.J., Youngblood, M., Heierman III, E.O., Gopalratnam, K., Rao, S., Litvin, A., Khawaja, F.: Mavhome: an agent-based smart home. In: Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, pp. 521–524 (2003)
Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating RoboCup players. In: Proceedings of the 21st International Florida Artificial Intelligence Research Society Conference, pp. 251–256 (2008)
Gigerenzer, G., Gaissmaier, W.: Heuristic decision making. Annu. Rev. Psychol. 62, 451–482 (2011)
Guillory, A., Nguyen, H., Balch, T., Charles Lee Isbell, J.: Learning executable agent behaviors from observation. In: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 795–797. ACM (2006)
Guralnik, V., Haigh, K.Z.: Learning models of human behaviour with sequential patterns. In: Proceedings of the AAAI-02 Workshop “Automation as Caregiver”, pp. 24–30 (2002)
Huynh, N., Snyder, R., Vidal, J.M., Tavakoli, A.S., Cai, B.: Application of computer simulation modeling to medication administration process redesign. J. Healthcare Eng. 3(4), 649–662 (2012). http://jmvidal.cse.sc.edu/papers/huynh12c.pdf
Huynh, N., Snyder, R., Vidal, J.M., Tavakoli, A.S., Cai, B.: Application of computer simulation modeling to medication administration process redesign. In: Chyu, M.C. (ed.) Advances in Engineering for Healthcare Safety, pp. 129–142. Multi-Science Publishing, Brentwood (2013)
Kaiser, P., Lewis, M., Petrick, R.P.A., Asfour, T., Steedman, M.: Extracting common sense knowledge from text for robot planning. In: IEEE International Conference on Robotics and Automation (ICRA) (2014)
Leon, E., Clarke, G., Callaghan, V., Doctor, F.: Affect-aware behaviour modelling and control inside an intelligent environment. Perv. Mobile Comput. 6(5), 559–574 (2010)
Papadimitriou, C.H., Tsitsiklis, J.N.: The complexity of Markov decision processes. Math. Oper. Res. 12(3), 441–450 (1987)
Schrum, J., Karpov, I.V., Miikkulainen, R.: Ut\(^2\): human-like behavior via neuroevolution of combat behavior and replay of human traces. In: IEEE Conference on Computational Intelligence and Games, pp. 329–336 (2011)
Snyder, R., Huynh, N., Cai, B., Vidal, J., Bennett, K.: Effective healthcare process redesign through and interdisciplinary team approach. In: Studies in Healthcare Technology and Informatics, vol. 192. MEDINFO 2013 (2013), http://jmvidal.cse.sc.edu/papers/snyder13a.pdf
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Parsons, B., Vidal, J.M., Huynh, N., Snyder, R. (2015). Automatic Generation of Agent Behavior Models from Raw Observational Data. In: Grimaldo, F., Norling, E. (eds) Multi-Agent-Based Simulation XV. MABS 2014. Lecture Notes in Computer Science(), vol 9002. Springer, Cham. https://doi.org/10.1007/978-3-319-14627-0_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-14627-0_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14626-3
Online ISBN: 978-3-319-14627-0
eBook Packages: Computer ScienceComputer Science (R0)