Robots Meet IVAs: A Mind-Body Interface for Migrating Artificial Intelligent Agents

  • Michael Kriegel
  • Ruth Aylett
  • Pedro Cuba
  • Marco Vala
  • Ana Paiva
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6895)


We describe CMION, an open source architecture for coordinating the various sensors and effectors of an artificial intelligent agent with its mind, i.e. the high level decision making processes. The architecture was designed to work for virtual graphical agents, including those on mobile devices, as well as robots. Its built-in migration feature allows a character to move between these differing embodiments, inhabiting them in turn. We emphasize the importance of modularity for an architecture supporting migration and highlight design decisions promoting modularity in CMION. An applied example of the architecture’s use in a migration situation is given.


Multiagent System Intelligent Agent Social Robot World Model Execution Plan 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mindmakers - project psyclone,
  2. 2.
    Albus, J.S., Lumia, R., Fiala, J., Wavering, A.: NASA/NBS standard reference model for telerobot control system architecture (Nasrem). Technical Report 1235, Natl. Inst. Standards and Technology, Gaithersburg, Md (1989)Google Scholar
  3. 3.
    Aylett, R., Luck, M.: Applying artificial intelligence to virtual reality: Intelligent virtual environments. Applied Artificial Intelligence 14, 3–32 (2000)CrossRefGoogle Scholar
  4. 4.
    Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: Embodiment in conversational interfaces: Rea. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems: the CHI is the Limit, pp. 520–527 (1999), ACM ID: 303150Google Scholar
  5. 5.
    Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: BEAT: the behavior expression animation toolkit. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2001, pp. 477–486 (2001), ACM ID: 383315Google Scholar
  6. 6.
    Cavazza, M., de la Camara, R.S., Turunen, M.: How was your day?: a companion ECA. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2010, International Foundation for Autonomous Agents and Multiagent Systems, Toronto, Canada, vol. 1, pp. 1629–1630 (2010), ACM ID: 1838515Google Scholar
  7. 7.
    Collett, T.H.J., Macdonald, B.A.: Player 2.0: Toward a practical robot programming framework. In: Proc. of the Australasian Conference on Robotics and Automation (ACRA) (2005)Google Scholar
  8. 8.
    De Carolis, B., Pelachaud, C., Poggi, I., de Rosis, F.: Behavior planning for a reflexive agent. In: Proceedings of the 17th international joint conference on Artificial intelligence, vol. 2, pp. 1059–1064 (2001), ACM ID: 1642236Google Scholar
  9. 9.
    Du Casse, K., Koay, K.L., Ho, W.C., Dautenhahn, K.: Reducing the cost of robotics software: SAMGAR, a generic modular robotic software communication architecture. In: Int. Conf. on Advanced Robotics 2009, ICAR 2009, pp. 1–6. IEEE, Los Alamitos (2009)Google Scholar
  10. 10.
    Fitzpatrick, P., Metta, G., Natale, L.: Towards long-lived robot genes. Robot. Auton. Syst. 56(1), 29–45 (2008)CrossRefGoogle Scholar
  11. 11.
    Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots: Concepts, design, and applications. Robotics and Autonomous Systems 42(3-4), 142–166 (2002)Google Scholar
  12. 12.
    Fritsch, J., Kleinehagenbrock, M., Haasch, A., Wrede, S., Sagerer, G.: A flexible infrastructure for the development of a robot companion with extensible HRI-Capabilities. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005, pp. 3408–3414 (2005)Google Scholar
  13. 13.
    Gat, E.: On Three-Layer architectures. Artificial Intelligence and Mobile Robots (1998)Google Scholar
  14. 14.
    Imai, M., Ono, T., Etani, T.: Agent migration: communications between a human and robot. In: IEEE International Conference on System, Man, and Cybernetics (SMC 1999), vol. 4, pp. 1044–1048 (1999)Google Scholar
  15. 15.
    Kopp, S., Krenn, B., Marsella, S.C., Marshall, A.N., Pelachaud, C., Pirker, H., Thórisson, K.R., Vilhjálmsson, H.H.: Towards a common framework for multimodal generation: The behavior markup language. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  16. 16.
    Lim, M.Y., Aylett, R., Ho, W.C., Enz, S., Vargas, P.: A Socially-Aware memory for companion agents. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents, pp. 20–26 (2009), ACM ID: 1612564Google Scholar
  17. 17.
    Magnenat-Thalmann, N., Kasap, Z., Moussa, M.B.: Communicating with a virtual human or a skin-based robot head. In: ACM SIGGRAPH ASIA 2008 Courses, SIGGRAPH Asia 2008, pp. 55:1–55:7. ACM, Singapore (2008), ACM ID: 1508099 Google Scholar
  18. 18.
    Ogawa, K., Ono, T.: Ubiquitous cognition: mobile environment achieved by migratable agent. In: Proceedings of the 7th international Conference on Human Computer Interaction with Mobile Devices & Services, pp. 337–338 (2005), ACM ID: 1085854Google Scholar
  19. 19.
    O’Hare, G.M.P., Duffy, B.R., Schön, B., Martin, A.N., Bradley, J.F.: Agent chameleons: Virtual agents real intelligence. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 218–225. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  20. 20.
    Syrdal, D.S., Koay, K.L., Walters, M.L., Dautenhahn, K.: The boy-robot should bark!–Children’s impressions of agent migration into diverse embodiments. In: Proceedings: New Frontiers of Human-Robot Interaction, a Symposium at AISB (2009)Google Scholar
  21. 21.
    Thiebaux, M., Marsella, S., Marshall, A.N., Kallmann, M.: Smartbody: Behavior realization for embodied conversational agents. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 151–158 (2008)Google Scholar
  22. 22.
    Vala, M., Raimundo, G., Sequeira, P., Cuba, P., Prada, R., Martinho, C., Paiva, A.: ION framework — a simulation environment for worlds with virtual agents. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents, pp. 418–424. Springer, Amsterdam (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Michael Kriegel
    • 1
  • Ruth Aylett
    • 1
  • Pedro Cuba
    • 2
  • Marco Vala
    • 2
  • Ana Paiva
    • 2
  1. 1.School Of Mathematical and Computer SciencesHeriot-Watt UniversityEdinburghScotland, UK
  2. 2.INESC-ID and IST/UTLPorto SalvoPortugal

Personalised recommendations