Facilitating Ubiquitous interaction Using Intelligent Agents

  • Abey Campbell
  • Rem Collier
  • Mauro Dragone
  • Levent Görgü
  • Thomas Holz
  • Michael J. O’Grady
  • G. M. P. O’Hare
  • Antonella Sassu
  • John Stafford
Part of the Studies in Computational Intelligence book series (SCI, volume 396)


Facilitating intuitive interaction is a prerequisite for the ubiquitous computing paradigm in all its manifestations. How to achieve such interaction in practice remains an open question. Such interfaces must be perceived as being intuitive across a variety of contexts, including those of the hosting devices. Indeed, the heterogeneity of the device population raises significant challenges.While individual devices and the interaction modalities supported by, each satisfy the requirements of individual domains, integrating diverse devices such that the user experiences is perceived as consistent and intuitive is problematic. This chapter discusses and illustrates how intelligent agents may be harnessed for integrating a range of diverse interface and interaction modalities such that the ubiquitous user interface concept may be validated.


Global Position System Augmented Reality Intelligent Agent Ubiquitous Computing Belief State 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aarts, E., Res, P., Eindhoven, N.: Ambient intelligence: A multimedia perspective. IEEE Multimedia 11(1), 1219 (2004)CrossRefGoogle Scholar
  2. 2.
    Abowd, G.D., Mynatt, E.D.: Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer-Human Interaction (TOCHI) 7(1), 58 (2000)CrossRefGoogle Scholar
  3. 3.
    Anabuki, M., Kakuta, H., Yamamoto, H., Tamura, H.: Welbo: An embodied conversational agent living in mixed reality space. In: Proceedings of the Conference on Human Factors in Computing Systems - CHI 2000, The Hague, The Netherlands, pp. 10–11 (2000)Google Scholar
  4. 4.
  5. 5.
    Barakonyi, I., Psik, T., Schmalstieg, D.: Agents that talk and hit back: Animated agents in augmented reality. In: ISMAR 2004: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 141–150. IEEE Computer Society, Washington, DC, USA (2004)Google Scholar
  6. 6.
    Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Surf: Speeded up robust features. Computer Vision and Image Understanding (CVIU) 110(3), 346–359 (2008)CrossRefGoogle Scholar
  7. 7.
    Behrens, T.M., Dix, J., Hindriks, K.V.: Towards an environment interface standard for agent-oriented programming. Technical Report IfI-09-09, Clausthal University of Technology (2009)Google Scholar
  8. 8.
    Bellifemine, F., Poggi, A., Rimassa, G.: JADE - a FIPA-compliant agent framework. In: Proceedings of the Practical Applications of Intelligent Agents (1999)Google Scholar
  9. 9.
    Bogost, I.: The rhetoric of exergaming. In: Proceedings of the Digital Arts and Cultures(DAC), USA (2005)Google Scholar
  10. 10.
    chUmbaLum sOft. Milkshape 3d,
  11. 11.
    Collier, R.W., O’Hare, G.M.P., Lowen, T.D., Rooney, C.: Beyond prototyping in the factory of agents. In: CEEMAS, pp. 383–393 (2003)Google Scholar
  12. 12.
    Doswell, J.T.: It’s virtually pedagogical: Pedagogical agents in mixed reality learning environments. In: Proceedings of the Thirty second International Conference on Computer Graphics and Interactive Techniques - SIGGRAPH 2005 - Educators Program, Los Angeles, California, p. 25 (2005)Google Scholar
  13. 13.
    Dragone, M., Holz, T., O’Hare, G.M.P.: Mixing robotic realities. In: Proceedings of the 2006 International Conference on Intelligent User Interfaces - IUI 2006, Sydney, New South Wales, Australia (January 2006)Google Scholar
  14. 14.
    Dragone, M., Holz, T., O’Hare, G.M.P.: Using mixed reality agents as social interfaces for robots. In: RO-MAN 2007: Proceedings of the 16th IEEE International Workshop on Robot and Human Interactive Communication, Jeju Island, Korea. IEEE Press (Augugst 2007)Google Scholar
  15. 15.
    Dragone, M., Collier, R.W., Lillis, D., O’Hare, G.M.P.: Practical development of hybrid intelligent agent systems with soSAA. In: Coyle, L., Freyne, J. (eds.) AICS 2009. LNCS, vol. 6206, pp. 51–60. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
  17. 17.
    Fogg, B.J.: Persuasive technologies - introduction. Commun. ACM 42(5), 26–29 (1999)CrossRefGoogle Scholar
  18. 18.
    Fong, T.W., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robotics and Autonomous Systems (2003)Google Scholar
  19. 19.
    Friedman, B.: ”it’s the computer’s fault”: reasoning about computers as moral agents. In: CHI 1995 Conference Companion, pp. 226–227 (1995)Google Scholar
  20. 20.
    Geiger, C., Reimann, C., Stöcklein, J., Paelke, V.: Jartoolkit - a java binding for artoolkit. In: The First IEEE International Workshop on Augmented Reality Toolkit, p. 5 (2002)Google Scholar
  21. 21.
    Gockley, R., Bruce, A., Forlizzi, J., Michalowski, M., Mundell, A., Rosenthal, S., Sellner, B., Simmons, R., Snipes, K., Schultz, A.C., Wang, J.: Designing robots for long-term social interaction. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems - IROS 2005 (August 2005)Google Scholar
  22. 22.
    Görgü, L., O’Hare, G.M.P., O’Grady, M.J.: Towards mobile collaborative exergaming. In: International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services, CENTRIC 2009 (2009)Google Scholar
  23. 23.
    Hagras, H., Callaghan, V., Colley, M., Clarke, G., Pounds-Cornish, A., Duman, H.: Creating an ambient-intelligence environment using embedded agents. IEEE Intelligent Systems 19(6), 12–20 (2004)CrossRefGoogle Scholar
  24. 24.
    Holz, T., Dragone, M., O’Hare, G.M.P., Martin, A., Duffy, B.R.: Mixed reality agents as museum guides. In: ABSHL 2006: Agent-Based Systems for Human Learning, AAMAS 2006 Workshop. ACM Press, New York (2006)Google Scholar
  25. 25.
    Kato, H., Billinghurst, M.: Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings The 2nd International Workshop on Augmented Reality (1999)Google Scholar
  26. 26.
    Keegan, S., O’Hare, G.M.P., O’Grady, M.J.: Easishop: Ambient intelligence assists everyday shopping. Information Sciences 178(3), 588–611 (2008)CrossRefGoogle Scholar
  27. 27.
    Kim, J.H., Kim, Y.D., Lee, K.H.: The third generation of robotics: Ubiquitous robot. In: Proc. of the 2nd Int. Conf. on Autonomous Robots and Agents (2004)Google Scholar
  28. 28.
    Lamere, P., Kwok, P., Walker, W., Gouva, E., Singh, R., Raj, B., Wolf, P.: Design of the cmu sphinx-4 decoder. In: 8th European Conference on Speech Communication and Technology, EUROSPEECH 2003 (September 2003)Google Scholar
  29. 29.
    Ma, T., Kim, S.D., Wang, J., Zhao, Y.: Privacy Preserving in Ubiquitous Computing: Challenges & Issues. In: IEEE International Conference on e-Business Engineering, pp. 297–301. IEEE (2008)Google Scholar
  30. 30.
    Martin, A., O’Hare, G.M.P., Schön, B., Bradley, J.F., Duffy, B.R.: Intentional embodied agents. In: Proceedings of the Eighteenth International Conference on Computer Animation and Social Agents - CASA 2005, Hong Kong (October 2005)Google Scholar
  31. 31.
    Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: A class of displays on the reality-virtuality continuum. In: Proceedings of SPIE, vol. 2351, pp. 282–292 (1995)Google Scholar
  32. 32.
    Morris, M., Lundell, J., Dishman, E.: Catalyzing social interaction with ubiquitous computing: a needs assessment of elders coping with cognitive decline. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, p. 1154. ACM (2004)Google Scholar
  33. 33.
    Muldoon, C., O’Hare, G.M.P., Collier, R., O’Grady, M.J.: Towards pervasive intelligence: Reflections on the evolution of the agent factory framework. In: Multi-Agent Programming: Languages, Platforms and Applications, pp. 187–212 (2009)Google Scholar
  34. 34.
    Muldoon, C., O’Hare, G.M.P., Bradley, J.F.: Towards reflective mobile agents for resource-constrained mobile devices. In: AAMAS, p. 141 (2007)Google Scholar
  35. 35.
  36. 36.
    O’Hare, G.M.P., Duffy, O.B.R., Campbell, A.G.: NEXUS: Mixed reality experiments with embodied intentional agents. In: Proceedings of Computer Animation and Social Agents - CASA 2004, Geneva, Switzerland (July 2004)Google Scholar
  37. 37.
    O’Hare, G.M.P., O’Grady, M.J.: Gulliver’s genie: a multi-agent system for ubiquitous and intelligent content delivery. Computer Communications 26(11), 1177–1187 (2003)CrossRefGoogle Scholar
  38. 38.
    O’Hare, G.M.P., O’Grady, M.J., Muldoon, C., Bradley, J.F.: Embedded Agents: A Paradigm for Mobile Services. International Journal of Web and Grid Services (IJWGS) 2(4), 379–405 (2006)CrossRefGoogle Scholar
  39. 39.
    O’Hare, G.M.P., Campbell, A.G., Stafford, J.W., Aiken, R.: NeXuS: Behavioural realism in mixed reality scenarios through virtual sensing. In: Proceedings of the Eighteenth International Conference on Computer Animation and Social Agents - CASA 2005, Hong Kong (October 2005)Google Scholar
  40. 40.
  41. 41.
    Oracle Java ME and Java Card Technology,
  42. 42.
    Rao, A.S., Georgeff, M.P.: Bdi agents: From theory to practice. In: Weiss, G. (ed.) ECAI 1996 Workshops, vol. 1221, pp. 312–319 (June 1995)Google Scholar
  43. 43.
    Ricci, A., Viroli, M., Omicini, A.: Cartago: A Framework for Prototyping Artifact-Based Environments in MAS. In: Weyns, D., Van Dyke Parunak, H., Michel, F. (eds.) E4MAS 2006. LNCS (LNAI), vol. 4389, pp. 67–86. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  44. 44.
    Saponas, T.S., Lester, J., Hartung, C., Agarwal, S., Kohno, T.: Devices that tell on you: Privacy trends in consumer ubiquitous computing. In: Proceedings of 16th USENIX Security Symposium on USENIX Security Symposium, pp. 1–16. USENIX Association (2007)Google Scholar
  45. 45.
    Simmons, R., Goldberg, D., Goode, A., Monetmerlo, M., Roy, N., Sellner, B., Urmson, C., Schultz, A., Abramson, M., Adams, W., Atrash, A., Bugajska, M., Coblenz, M., MacMahon, M., Perzanowski, D., Horswill, I., Zubek, R., Kortenkamp, D., Wolfe, B., Milman, T., Maxwell, B.: Grace: An autonomous robot for the AAAI robot challenge. AI Magazine 24, 51–72 (2003)Google Scholar
  46. 46.
    Stajano, F., Anderson, R.: The resurrecting duckling: security issues for ubiquitous computing. Computer 35(4), 22–26 (2002)CrossRefGoogle Scholar
  47. 47.
    World Wide Web Consortion (W3C),
  48. 48.
    Weiser, M.: Some computer science issues in ubiquitous computing. Communications of the ACM 36(7), 75–84 (1993)CrossRefGoogle Scholar
  49. 49.
    Weiser, M.: The computer for the 21st century. Scientific American 272(3), 78–89 (1995)Google Scholar
  50. 50.
    Weiser, M., Brown, J.S.: The coming age of calm technology [1]. Xerox PARC 8, 2007 (1996) (retrieved July)Google Scholar
  51. 51.
    Young, J.E., Sharlin, E.: Sharing spaces with robots: An integrated environment for human-robot interaction. In: Proceedings of the First International Symposium on Intelligent Environments - ISIE 2006, Cambridge, England (April 2006)Google Scholar
  52. 52.
    Young, J.E., Xin, M., Sharlin, E.: Robot expressionism through cartooning. In: Proceedings of the 2007 ACM/IEEE International Conference on Human-Robot Interaction, Arlington, Virginia, USA (March 2007)Google Scholar
  53. 53.
    Zhang, G., Jin, Q., Lin, M.: A framework of social interaction support for ubiquitous learning. In: 19th International Conference on Advanced Information Networking and Applications, AINA 2005, pp. 639–643 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Abey Campbell
    • 1
  • Rem Collier
    • 2
  • Mauro Dragone
    • 1
  • Levent Görgü
    • 1
  • Thomas Holz
    • 1
  • Michael J. O’Grady
    • 1
  • G. M. P. O’Hare
    • 1
  • Antonella Sassu
    • 1
  • John Stafford
    • 3
  1. 1.CLARITY:Centre for Sensor Web TechnologyUniversity College DublinDublin 4Ireland
  2. 2.School of Computer Science & InformaticsUniversity College DublinDublin 4Ireland
  3. 3.Nova UCDDublin 4Ireland

Personalised recommendations