Planning as Inference in a Hierarchical Predictive Memory

  • Hansol Choi
  • Dae-Shik Kim
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8226)


In the predictive brain hypotheses, the functional mechanism of the brain is suggested to infer the cause of current states within the predictions by brains. Recently, there have been several approaches to explain the action generation within the predictive brain hypotheses: the brain predicts the animal’s own action, which the animal realizes to fulfill the prediction. In this study, we suggest a predictive brain models to produce the goal directed behaviors. We introduced the Planning as Inference (PAI) framework to a hierarchical predictive memory model. PAI is a computational framework for goal-directed behavior generation. PAI explains the decision of an action for a state in the probabilistic distribution. The distribution is inferred from the evidences of current state and the perspective evidence of goal achievement. We used a hierarchical predictive memory system to predict the agent’s self-action states. Following to the PAI, the predictions were inferred from the evidence of the ongoing state and the evidence from assumption of the goal achievement. The agents realizes the predicted actions to minimize prediction errors. We implemented our method in embodied robotics system and our model could generate structured spontaneous behavior and goal directed behaviors. Our result opens understanding for the goal-directed behavior in predictive brain hypotheses.


Planning as Inference Hierarchical Predictive Memory Hierarchical Temporal Memory Predictive Coding 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Knill, D.C., Pouget, A.: The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27, 712–719 (2004)CrossRefGoogle Scholar
  2. 2.
    Yuille, A., Kersten, D.: Vision as Bayesian inference: analysis by synthesis? Trends Cogn. Sci. 10, 301–308 (2006)CrossRefGoogle Scholar
  3. 3.
    Doya, K.: Bayesian brain: Probabilistic approaches to neural coding. MIT Press (2007)Google Scholar
  4. 4.
    Clark, A.: Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181–204 (2013)CrossRefGoogle Scholar
  5. 5.
    Lee, T.S., Mumford, D.: Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. 20, 1434–1448 (2003)CrossRefGoogle Scholar
  6. 6.
    Friston, K.: Hierarchical Models in the Brain. Plos Comput. Biol. 4, e1000211 (2008)Google Scholar
  7. 7.
    Friston, K., Kilner, J., Harrison, L.: A free energy principle for the brain. J. Physiol.-Paris 100, 70–87 (2006)CrossRefGoogle Scholar
  8. 8.
    Adams, R.A., Perrinet, L.U., Friston, K.: Smooth pursuit and visual occlusion: active inference and oculomotor control in schizophrenia. Plos One 7, e47502 (2012)Google Scholar
  9. 9.
    Friston, K., Mattout, J., Kilner, J.: Action understanding and active inference. Biol. Cybern. 104, 137–160 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Friston, K.J., Daunizeau, J., Kiebel, S.J.: Reinforcement Learning or Active Inference? Plos One 4, e6421 (2009)Google Scholar
  11. 11.
    Botvinick, M., Toussaint, M.: Planning as inference. Trends Cogn. Sci. 16, 485–488 (2012)CrossRefGoogle Scholar
  12. 12.
    Solway, A., Botvinick, M.M.: Goal-directed decision making as probabilistic inference: A computational framework and potential neural correlates. Psychol. Rev. 119, 120–154 (2012)CrossRefGoogle Scholar
  13. 13.
    George, D., Hawkins, J.: Towards a mathematical theory of cortical micro-circuits. Plos Comput. Biol. 5, e1000532 (2009)Google Scholar
  14. 14.
    Hawkins, J., George, D., Niemasik, J.: Sequence memory for prediction, inference and behaviour. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 364, 1203–1209 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Hansol Choi
    • 1
  • Dae-Shik Kim
    • 2
  1. 1.Information & Electronics Research InstituteKAISTDaejeonSouth Korea
  2. 2.Department of Electrical EngineeringKAISTDaejeonSouth Korea

Personalised recommendations