Automatic Generation of Agent Behavior Models from Raw Observational Data

  • Bridgette Parsons
  • José M. Vidal
  • Nathan Huynh
  • Rita Snyder
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9002)


Agent-based modeling is used to simulate human behaviors in different fields. The process of building believable models of human behavior requires that domain experts and Artificial Intelligence experts work closely together to build custom models for each domain, which requires significant effort. The aim of this study is to automate at least some parts of this process. We present an algorithm called Open image in new window, which produces an agent behavioral model from raw observational data. It calculates transition probabilities between actions and identifies decision points at which the agent requires additional information in order to choose the appropriate action. Our experiments using synthetically-generated data and real-world data from a hospital setting show that the Open image in new window algorithm can automatically produce an agent decision process. The agent’s underlying behavior can then be modified by domain experts, thus reducing the complexity of producing believable agent behavior from field data.


  1. 1.
    Bentivegna, D.C., Atkenson, C.G., Cheng, G.: Learning tasks from observation and practice. Robot. Auton. Syst. 47(2), 163–169 (2004)CrossRefGoogle Scholar
  2. 2.
    Cook, D.J., Youngblood, M., Heierman III, E.O., Gopalratnam, K., Rao, S., Litvin, A., Khawaja, F.: Mavhome: an agent-based smart home. In: Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, pp. 521–524 (2003)Google Scholar
  3. 3.
    Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating RoboCup players. In: Proceedings of the 21st International Florida Artificial Intelligence Research Society Conference, pp. 251–256 (2008)Google Scholar
  4. 4.
    Gigerenzer, G., Gaissmaier, W.: Heuristic decision making. Annu. Rev. Psychol. 62, 451–482 (2011)CrossRefGoogle Scholar
  5. 5.
    Guillory, A., Nguyen, H., Balch, T., Charles Lee Isbell, J.: Learning executable agent behaviors from observation. In: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 795–797. ACM (2006)Google Scholar
  6. 6.
    Guralnik, V., Haigh, K.Z.: Learning models of human behaviour with sequential patterns. In: Proceedings of the AAAI-02 Workshop “Automation as Caregiver”, pp. 24–30 (2002)Google Scholar
  7. 7.
    Huynh, N., Snyder, R., Vidal, J.M., Tavakoli, A.S., Cai, B.: Application of computer simulation modeling to medication administration process redesign. J. Healthcare Eng. 3(4), 649–662 (2012). CrossRefGoogle Scholar
  8. 8.
    Huynh, N., Snyder, R., Vidal, J.M., Tavakoli, A.S., Cai, B.: Application of computer simulation modeling to medication administration process redesign. In: Chyu, M.C. (ed.) Advances in Engineering for Healthcare Safety, pp. 129–142. Multi-Science Publishing, Brentwood (2013)Google Scholar
  9. 9.
    Kaiser, P., Lewis, M., Petrick, R.P.A., Asfour, T., Steedman, M.: Extracting common sense knowledge from text for robot planning. In: IEEE International Conference on Robotics and Automation (ICRA) (2014)Google Scholar
  10. 10.
    Leon, E., Clarke, G., Callaghan, V., Doctor, F.: Affect-aware behaviour modelling and control inside an intelligent environment. Perv. Mobile Comput. 6(5), 559–574 (2010)CrossRefGoogle Scholar
  11. 11.
    Papadimitriou, C.H., Tsitsiklis, J.N.: The complexity of Markov decision processes. Math. Oper. Res. 12(3), 441–450 (1987)CrossRefMathSciNetMATHGoogle Scholar
  12. 12.
    Schrum, J., Karpov, I.V., Miikkulainen, R.: Ut\(^2\): human-like behavior via neuroevolution of combat behavior and replay of human traces. In: IEEE Conference on Computational Intelligence and Games, pp. 329–336 (2011)Google Scholar
  13. 13.
    Snyder, R., Huynh, N., Cai, B., Vidal, J., Bennett, K.: Effective healthcare process redesign through and interdisciplinary team approach. In: Studies in Healthcare Technology and Informatics, vol. 192. MEDINFO 2013 (2013),

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Bridgette Parsons
    • 1
  • José M. Vidal
    • 1
  • Nathan Huynh
    • 2
  • Rita Snyder
    • 3
  1. 1.Department of Computer Science and EngineeringUniversity of South CarolinaColumbiaUSA
  2. 2.Department of Civil and Environmental EngineeringUniversity of South CarolinaColumbiaUSA
  3. 3.College of Nursing’s Healthcare Process Redesign CenterUniversity of South CarolinaColumbiaUSA

Personalised recommendations