Goal-Driven Autonomy with Case-Based Reasoning

  • Héctor Muñoz-Avila
  • Ulit Jaidee
  • David W. Aha
  • Elizabeth Carter
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6176)


The vast majority of research on AI planning has focused on automated plan recognition, in which a planning agent is provided with a set of inputs that include an initial goal (or set of goals). In this context, the goal is presumed to be static; it never changes, and the agent is not provided with the ability to reason about whether it should change this goal. For some tasks in complex environments, this constraint is problematic; the agent will not be able to respond to opportunities or plan execution failures that would benefit from focusing on a different goal. Goal driven autonomy (GDA) is a reasoning framework that was recently introduced to address this limitation; GDA systems perform anytime reasoning about what goal(s) should be satisfied [4]. Although promising, there are natural roles that case-based reasoning (CBR) can serve in this framework, but no such demonstration exists. In this paper, we describe the GDA framework and describe an algorithm that uses CBR to support it. We also describe an empirical study with a multiagent gaming environment in which this CBR algorithm outperformed a rule-based variant of GDA as well as a non-GDA agent that is limited to dynamic replanning.


Plan Execution Plan Repair Opponent Team Hierarchical Task Network Hierarchical Task Network Plan 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    von Moltke, H.K.B.G.: Militarische werke. In: Hughes, D.J. (ed.) Moltke on the art of war: Selected writings. Presidio Press, Novato (1993)Google Scholar
  2. 2.
    Dearden, R., Meuleau, N., Ramakrishnan, S., Smith, D., Washington, R.: Incremental contingency planning. In: Pistore, M., Geffner, H., Smith, D. (eds.) Planning under Uncertainty and Incomplete Information: Papers from the ICAPS Workshop, Trento, Italy (2003)Google Scholar
  3. 3.
    Goldman, R., Boddy, M.: Expressive planning and explicit knowledge. In: Proceedings of the Third International Conference on Artificial Intelligence Planning Systems, pp. 110–117. AAAI Press, Edinburgh (1996)Google Scholar
  4. 4.
    Muñoz-Avila, H., Aha, D.W., Jaidee, U., Klenk, M., Molineaux, M.: Applying goal directed autonomy to a team shooter game. To appear in Proceedings of the Twenty-Third Florida Artificial Intelligence Research Society Conference. AAAI Press, Daytona Beach (2010)Google Scholar
  5. 5.
    Molineaux, M., Klenk, M., Aha, D.W.: Goal-driven autonomy in a Navy strategy simulation. To appear in Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, AAAI Press, Atlanta (2010)Google Scholar
  6. 6.
    López de Mantaras, R., McSherry, D., Bridge, D.G., Leake, D.B., Smyth, B., Craw, S., Faltings, B., Maher, M.L., Cox, M.T., Forbus, K.D., Keane, M., Aamodt, A., Watson, I.D.: Retrieval, reuse, revision and retention in case-based reasoning. Knowledge Engineering Review 20(3), 215–240 (2005)CrossRefGoogle Scholar
  7. 7.
    Auslander, B., Lee-Urban, S., Hogg, C., Munoz-Avila, H.: Recognizing the enemy: Combining reinforcement learning with strategy selection using case-based reasoning. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 59–73. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  8. 8.
    Nau, D.S.: Current trends in automated planning. AI Magazine 28(4), 43–58 (2007)Google Scholar
  9. 9.
    Nau, D., Cao, Y., Lotem, A., Muñoz-Avila, H.: SHOP: Simple hierarchical ordered planner. In: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, pp. 968–973. AAAI Press, Stockholm (1999)Google Scholar
  10. 10.
    Cox, M.T.: Perpetual self-aware cognitive agents. AI Magazine 28(1), 32–45 (2007)Google Scholar
  11. 11.
    Fox, M., Gerevini, A., Long, D., Serina, I.: Plan stability: Replanning versus plan repair. In: Proceedings of the Sixteenth International Conference on Automated Planning and Scheduling, pp. 212–221. AAAI Press, Cumbria (2006)Google Scholar
  12. 12.
    Warfield, I., Hogg, C., Lee-Urban, S., Munoz-Avila, H.: Adaptation of hierarchical task network plans. In: Proceedings of the Twentieth Flairs International Conference, pp. 429–434. AAAI Press, Key West (2007)Google Scholar
  13. 13.
    Hoang, H., Lee-Urban, S., Muñoz-Avila, H.: Hierarchical plan representations for encoding strategic game AI. In: Proceedings of the First Conference on Artificial Intelligence and Interactive Digital Entertainment, pp. 63–68. AAAI Press, Marina del Ray (2005)Google Scholar
  14. 14.
    Ayan, N.F., Kuter, U., Yaman, F., Hotride, G. R.: Hierarchical ordered task replanning in dynamic environments. In: Ingrand, F., Rajan, K. (eds.) Planning and Plan Execution for Real-World Systems – Principles and Practices for Planning in Execution: Papers from the ICAPS Workshop, Providence, RI (2007)Google Scholar
  15. 15.
    Myers, K.L.: CPEF: A continuous planning and execution framework. AI Magazine 20(4), 63–69 (1999)Google Scholar
  16. 16.
    Ghallab, M., Nau, D.S., Traverso, P.: Automated planning: Theory and practice. Morgan Kaufmann, San Mateo (2004)zbMATHGoogle Scholar
  17. 17.
    van den Briel, M., Sanchez Nigenda, R., Do, M.B., Kambhampati, S.: Effective approaches for partial satisfaction (over-subscription) planning. In: Proceedings of the Nineteenth National Conference on Artificial Intelligence, pp. 562–569. AAAI Press, San Jose (2004)Google Scholar
  18. 18.
    Coddington, A.M., Luck, M.: Towards motivation-based plan evaluation. In: Proceedings of the Sixteenth International FLAIRS Conference, pp. 298–302. AAAI Press, Miami Beach (2003)Google Scholar
  19. 19.
    Meneguzzi, F.R., Luck, M.: Motivations as an abstraction of meta-level reasoning. In: Burkhard, H.-D., Lindemann, G., Verbrugge, R., Varga, L.Z. (eds.) CEEMAS 2007. LNCS (LNAI), vol. 4696, pp. 204–214. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  20. 20.
    Bergmann, R.: Experience management: Foundations, development methodology, and internet-based applications. Springer, New York (2002)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Héctor Muñoz-Avila
    • 1
  • Ulit Jaidee
    • 1
  • David W. Aha
    • 2
  • Elizabeth Carter
    • 1
  1. 1.Department of Computer Science & EngineeringLehigh UniversityBethlehem
  2. 2.Naval Research Laboratory (Code 5514)Navy Center for Applied Research in Artificial IntelligenceWashington

Personalised recommendations