Social Situated Agents in Virtual, Real and Mixed Reality Environments

  • M. Dragone
  • T. Holz
  • B. R. Duffy
  • G. M. P. O’Hare
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3661)


This paper details a framework for explicit deliberative control of socially and physically situated agents in virtual, real and mixed reality environments. The objective is to blur the traditional boundaries between the real and the virtual and provide a standardized methodology for intelligent agent control specifically designed for social interaction. The architecture presented in this paper embraces the fusion between deliberative social reasoning mechanisms and explicit tangible behavioural mechanisms for human-agent social interaction.


Augmented Reality Multiagent System Social Robot Proportional Integrative Derivative Head Mount Display 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aylett, R., Luck, M.: Applying Artificial Intelligence to Virtual Reality: Intelligent Virtual Environments. Applied Artificial Intelligence 14, 3–32 (2000)CrossRefGoogle Scholar
  2. 2.
    Terzopoulos, D., Tu, X., Grzeszczuk, R.: Artificial Fishes: Autonomous Locomotion, Perception, Behavior, and Learning in a Simulated Physical World. Artificial Life 1, 327–351 (1994)CrossRefGoogle Scholar
  3. 3.
    Thalmann, D.: Challenges for the Research in Virtual Humans. In: Proceedings of the Workshop on Achieving Human-Like Behavior in Interactive Animated Agents, Barcelona, Spain (2000)Google Scholar
  4. 4.
    Smit, R., Verhagen, H.: On being social: degrees of sociality and models of rationality in relation to multiagent systems. In: Proceedings of the 1995 AAAI Fall Symposium: Concepts, Theories, Models and Applications (1995)Google Scholar
  5. 5.
    Duffy, B.R.: The Social Robot. Ph.D. Thesis, University College Dublin, Department of Computer Science (2000)Google Scholar
  6. 6.
    Dragone, M.: The Virtual Robotic Workbench. Technical Report No. UCD-PRISM-05-11. University College Dublin, Department of Computer Science (2005)Google Scholar
  7. 7.
    Duffy, B.R., O’Hare, G.M.P., Martin, A.N., Bradley, J.F., Schön, B.: Agent Chameleons: Agent Minds and Bodies. In: Proceedings of the 16th International Conference on Computer Animation and Social Agents (CASA 2003), New-Brunswick, USA (2003)Google Scholar
  8. 8.
    Isla, D.A., Burke, R.C., Downie, M., Blumberg, B.: A Layered Brain Architecture for Synthetic Creatures. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (IJCAI 2001), Seattle, USA (2001)Google Scholar
  9. 9.
    Brooks, R.A.: Intelligence without Reason. In: Proceedings of the 12th International Joint Conference on Artificial Intelligence (IJCAI 1991), Sydney, Australia (1991)Google Scholar
  10. 10.
    Egges, A., Kshirsagar, S., Zhang, X., Magnenat-Thalmann, N.: Emotional Communication with Virtual Humans. In: Proceedings of the 9th International Multmedia Modeling Conference (MMM 2003), Taiwan (2003)Google Scholar
  11. 11.
    Chittaro, L., Serra, M.: Behavioural programming of autonomous characters based on probabilistic automata and personality. Computer Animation and Virtual Worlds 15, 319–326 (2004)CrossRefGoogle Scholar
  12. 12.
    de Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From Greta’s mind to her face: modelling the dynamics of affective states in a conversational embodied agent. International Journal of Human-Computer Studies 59, 81–118 (2003)CrossRefGoogle Scholar
  13. 13.
    Nicholson, A., Brady, J.: Dynamic belief networks for discrete monitoring. IEEE Transactions on Systems, Man, and Cybernetics 24, 1593–1610 (1994)CrossRefGoogle Scholar
  14. 14.
    Rao, A.S., Georgeff, M.P.: BDI-agents: from theory to practice. In: Proc. of the 1st International Conference on Multiagent Systems (ICMAS 1995), San Francisco, USA (1995)Google Scholar
  15. 15.
    Duffy, B.R., Dragone, M., O’Hare, G.M.P.: Social Robot Architecture: A Framework for Explicit Social Interaction. Android Science: Towards Social Mechanisms. In: CogSci 2005 Workshop, Stresa, Italy (2005)Google Scholar
  16. 16.
    Konolige, K., Myers, K., Saffiotti, A., Ruspini, E.: The Saphira architecture: a design for autonomy. Journal of Experimental and Theoretical Artificial Intelligence 9, 215–235 (1997)CrossRefGoogle Scholar
  17. 17.
    Ulrich, I., Borenstein, J.: VFH+: Reliable Obstacle Avoidance for Fast Mobile Robots. In: IEEE International Conference on Robotics and Automation, Leuven, Belgium (1998)Google Scholar
  18. 18.
    Fox, D., Burgard, W., Thrun, S.: The dynamic window approach to collision avoidance. In: IEEE Robotics and Automation Magazine, vol. 4/1 (1997)Google Scholar
  19. 19.
    Ross, R., Collier, R., O’Hare, G.M.P.: AF-APL: Bridging Principles & Practice in Agent-Oriented Languages. In: Bordini, R.H., Dastani, M.M., Dix, J., El Fallah Seghrouchni, A. (eds.) PROMAS 2004. LNCS (LNAI), vol. 3346, pp. 66–88. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  20. 20.
    Collier, R.W.: Agent Factory: A Framework for the Engineering of Agent-Oriented Applications, Ph.D. Thesis, University College Dublin, Ireland (2001)Google Scholar
  21. 21.
    Rooney, C.F.B., Collier, R.W., O’Hare, G.M.P.: VIPER: VIsual Protocol EditoR. In: De Nicola, R., Ferrari, G.-L., Meredith, G. (eds.) COORDINATION 2004. LNCS, vol. 2949. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  22. 22.
    Coradeschi, S., Saffiotti, A.: Perceptual Anchoring of Symbols for Action. In: Proceedings of the 17th IJCAI Conference, Seattle, USA (2001)Google Scholar
  23. 23.
    Kuipers, B.: Qualitative Simulation. Artificial Intelligence 29, 289–338 (1986)zbMATHCrossRefMathSciNetGoogle Scholar
  24. 24.
    Sheshagiri, M., des Jardins, M.: Data Persistence: A Design Principle for Hybrid Robot Control Architectures. In: Proceedings of the International Conference On Knowledge Based Computer Systems, Mumbai, India (2002)Google Scholar
  25. 25.
    Duffy, B.R., Garcia, C., Rooney, C.F., O’Hare, G.M.: Sensor Fusion for Social Robotics. In: Proceedings of the 31st International Symposium on Robotics (ISR 2000), Montreal, Canada (2000)Google Scholar
  26. 26.
    Searle, J.: Speech Acts: An essay in the philosophy of language, London. Cambridge University Press, Cambridge (1969)Google Scholar
  27. 27.
    Duffy, B.R.: Social Embodiment in Autonomous Mobile Robotics. International Journal of Advanced Robotic Systems 1/3, 155–170 (2004)Google Scholar
  28. 28.
    Kato, H., Billinghurst, M., Poupyrev, I.: ARToolKit. Technical report, Hiroshima City University (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • M. Dragone
    • 1
  • T. Holz
    • 1
  • B. R. Duffy
    • 2
  • G. M. P. O’Hare
    • 1
  1. 1.Department of Computer ScienceUniversity College Dublin, BelfieldDublin 4Ireland
  2. 2.Institut EurécomSophia-AntipolisFrance

Personalised recommendations