A Deep Active Inference Model of the Rubber-Hand Illusion

  • Thomas RoodEmail author
  • Marcel van Gerven
  • Pablo Lanillos
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1326)


Understanding how perception and action deal with sensorimotor conflicts, such as the rubber-hand illusion (RHI), is essential to understand how the body adapts to uncertain situations. Recent results in humans have shown that the RHI not only produces a change in the perceived arm location, but also causes involuntary forces. Here, we describe a deep active inference agent in a virtual environment, which we subjected to the RHI, that is able to account for these results. We show that our model, which deals with visual high-dimensional inputs, produces similar perceptual and force patterns to those found in humans.


Active inference Rubber-hand Illusion Free-energy optimization Deep learning 


  1. 1.
    Asai, T.: Illusory body-ownership entails automatic compensative movement: for the unified representation between body and action. Exp. Brain Res. 233(3), 777–785 (2014). Scholar
  2. 2.
    Botvinick, M., Cohen, J.: Rubber hands ‘feel’ touch that eyes see. Nature 391(6669), 756–756 (1998). Scholar
  3. 3.
    Botvinick, M., Toussaint, M.: Planning as inference. Trends Cogn. Sci. 16(10), 485–488 (2012)CrossRefGoogle Scholar
  4. 4.
    Buckley, C.L., Kim, C.S., McGregor, S., Seth, A.K.: The free energy principle for action and perception: a mathematical review. J. Math. Psychol. 81, 55–79 (2017)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Friston, K.: The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010). Scholar
  6. 6.
    Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., Penny, W.: Variational free energy and the laplace approximation. Neuroimage 34(1), 220–234 (2007)CrossRefGoogle Scholar
  7. 7.
    Friston, K.J., Daunizeau, J., Kilner, J., Kiebel, S.J.: Action and behavior: a free-energy formulation. Biol. Cybern. 102(3), 227–260 (2010). Scholar
  8. 8.
    Hinz, N.A., Lanillos, P., Mueller, H., Cheng, G.: Drifting perceptual patterns suggest prediction errors fusion rather than hypothesis selection: replicating the rubber-hand illusion on a robot. arXiv preprint arXiv:1806.06809 (2018)
  9. 9.
    Juliani, A., et al.: Unity: a general platform for intelligent agents (2018)Google Scholar
  10. 10.
    Kalckert, A., Ehrsson, H.H.: The onset time of the ownership sensation in the moving rubber hand illusion. Front. Psychol. 8, 344 (2017). Scholar
  11. 11.
    Kappen, H.J., Gómez, V., Opper, M.: Optimal control as a graphical model inference problem. Mach. Learn. 87(2), 159–182 (2012). Scholar
  12. 12.
    Kilteni, K., Maselli, A., Kording, K.P., Slater, M.: Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Front. Hum. Neurosci. 9, 141 (2015)CrossRefGoogle Scholar
  13. 13.
    Körding, K.P., Wolpert, D.M.: Bayesian integration in sensorimotor learning. Nature 427(6971), 244–247 (2004). Scholar
  14. 14.
    Lanillos, P., Cheng, G.: Adaptive robot body learning and estimation through predictive coding. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018), pp. 4083–4090. IEEE (2018)Google Scholar
  15. 15.
    Lanillos, P., Dean-Leon, E., Cheng, G.: Enactive self: a study of engineering perspectives to obtain the sensorimotor self through enaction. In: Joint IEEE International Conference on Developmental Learning and Epigenetic Robotics (2017)Google Scholar
  16. 16.
    Lanillos, P., Franklin, S., Franklin, D.W.: The predictive brain in action: involuntary actions reduce body prediction errors. bioRxiv (2020).
  17. 17.
    Oliver, G., Lanillos, P., Cheng, G.: Active inference body perception and action for humanoid robots. arXiv preprint arXiv:1906.03022 (2019)
  18. 18.
    Samad, M., Chung, A.J., Shams, L.: Perception of body ownership is driven by Bayesian sensory inference. PLoS ONE 10(2), e0117178–e0117178 (2015).,
  19. 19.
    Sancaktar, C., van Gerven, M., Lanillos, P.: End-to-end pixel-based deep active inference for body perception and action. arXiv preprint arXiv:2001.05847 (2020)

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Thomas Rood
    • 1
    Email author
  • Marcel van Gerven
    • 1
  • Pablo Lanillos
    • 1
  1. 1.Department of Artificial IntelligenceDonders Institute for Brain, Cognition and BehaviourNijmegenThe Netherlands

Personalised recommendations