Rapid User-Centred Evaluation for Context-Aware Systems

  • Eleanor O’Neill
  • David Lewis
  • Kris McGlinn
  • Simon Dobson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4323)


This paper describes a platform for the user-centred design and evaluation of adaptive, context-aware services in the wireless, mobile and pervasive computing markets. It focuses on evaluating the user interactions with context-aware adaptive systems while synchronising the control of the environmental context that drives adaptivity and the user’s perception of that environment. The platform uses a 3D virtual reality simulation to present the environment to the user and to drive the generation of simulated environmental context. The platform thereby delivers repeatable, instrumented, context-dependent evaluations of adaptive services over a range of contexts. It aims to reduce development costs and facilitate the development of more effective, user-empowering services.


User-centred design and evaluation usability  context-aware services adaptive services 3D virtual environment 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Czarkowski, M., Kay, J.: Challenges of Scrutable Adaptivity. In: Proceedings of AIED Conference, 11th International Conference on Artificial Intelligence in Education, pp. 404–407. IOS Press, Amsterdam (2003)Google Scholar
  2. 2.
    Yamazaki, T.: Ubiquitous Home: Real-Life Testbed for Home Context-Aware Service. In: Proceedings of IEEE 1st International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities (Tridentcom 2005), IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  3. 3.
    Calvary, G., Coutaz, J., Thevenin, D.: A unifying reference framework for the development of plastic user interfaces. In: Proceedings of EHCI/DSVIS’04 (2004)Google Scholar
  4. 4.
    Dobson, S., Nixon, P.: More principled design of pervasive computing systems. In: Bastide, R., Palanque, P., Roth, J. (eds.) Engineering Human Computer Interaction and Interactive Systems. LNCS, vol. 3425, Springer, Heidelberg (2005)Google Scholar
  5. 5.
    Bylund, M., Espinoza, F.: Testing and Demonstrating Context-Aware Services with Quake III Arena. Communications of the ACM 45(1), 46–48 (2002)CrossRefGoogle Scholar
  6. 6.
    Barton, J., Vijayaraghavan, V.: UbiWise, A Ubiquitous Wireless Infrastructure Simulation Environment. HP technical report (2002)Google Scholar
  7. 7.
    Half-Life 2, Valve Corporation (2004),
  8. 8.
    eXist, Open Source Native XML Database.
  9. 9.
    Dobson, S.: Hybridising events and knowledge in an infrastructure for context-adaptive systems. In: Proceedings of the IJCAI’05 Workshop on Artificial Intelligence and Autonomic Communications (2005)Google Scholar
  10. 10.
    Gonzalez, A., Ahlers, T.: Context-based representation of intelligent behaviour in training simulations. Transactions of the Society for Computer Simulations International 15(4) (1999)Google Scholar
  11. 11.
    Henrickson, K., et al.: Modelling context information in pervasive computing systems. In: Mattern, F., Naghshineh, M. (eds.) Pervasive Computing. LNCS, vol. 2414, Springer, Heidelberg (2002)Google Scholar
  12. 12.
    Ranganathan, A., Al-Muhtadi, J., Campbell, R.: Reasoning about uncertain contexts in pervasive computing environments. IEEE Pervasive Computing 3(2) (2004)Google Scholar
  13. 13.
    Stevenson, G., Nixon, P., Dobson, S.: Towards a reliable wide-are infrastructure for the context-based self-management of communication. In: Proceedings of the 2nd IFIP Workshop on Autonomic Communications. LNCS. Springer Verlag (To appear 2005)Google Scholar
  14. 14.
    Dagger, D., Wade, V., Conlan, O.: Developing Active Learning Experiences for Adaptive Personalised eLearning. In: De Bra, P., Nejdl, W. (eds.) AH 2004. LNCS, vol. 3137, pp. 55–64. Springer, Heidelberg (2004)Google Scholar
  15. 15.
    O’Neill, E., et al.: A Testbed for Evaluating Human Interaction with Ubiquitous Computing Environments. In: Proceedings of IEEE 1st International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities (Tridentcom 2005), IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  16. 16.
    Kerttula, M., Tokkonen, T.: The Total User Experience - How to make it Positive in Future Wireless Systems and Services. In: WWRF Annual Workshop in Paris 2001 (2001)Google Scholar
  17. 17.
    Huebscher, M., McCann, J.: Simulation Model for Self-Adaptive Applications in Pervasive Computing. In: 2nd International Workshop on Self-Adaptive and Autonomic Computing Systems (SAACS ’04) (2004)Google Scholar
  18. 18.
    Yamazaki, T.: Ubiquitous home: real-life testbed for home context-aware service. In: Proceedings of IEEE 1st International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities (Tridentcom 2005), IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  19. 19.
    Abowd, G.: Living laboratories: The future computing environments group at the Georgia institute of technology. In: ACM Conference on Human Factors in Computing Systems, ACM Press, New York (2000)Google Scholar
  20. 20.
    Nazari Shirehjini, A.A., Klar, F.: 3DSim: Rapid Prototyping Ambient Intelligence. In: Joint sOc-EUSAI conference (2005)Google Scholar
  21. 21.
    Jang, S., Ko, E.-J., Woo, W.: Unified User-Centric Context: Who, Where, When, What, How and Why. In: UbiPCMM: Personalized Context Modelling and Management for Ubicomp Applications (2005)Google Scholar
  22. 22.
    Oh, Y., Woo, W.: User-centric Integration of Contexts for a Unified Context-aware Application Model. In: Joint sOc-EUSAI conference (2005)Google Scholar
  23. 23.
    Kenny, A., Lewis, D., O’Sullivan, D. (2006). Interlocutor: Decentralised Infrastructure for Adaptive Interaction. To appear in proceedings of 3rd International Workshop on Managing Ubiquitous Communications and Services (MUCS) (2006)Google Scholar
  24. 24.
    Feeney, K., Lewis, D., Wade, V.: Community Based Policy Management for Smart Spaces. In: Proceedings of 5th IEEE International Workshop on Policies and Distributed Systems and Networks, IEEE Computer Society Press, Los Alamitos (2004)Google Scholar

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Eleanor O’Neill
    • 1
  • David Lewis
    • 1
  • Kris McGlinn
    • 1
  • Simon Dobson
    • 2
  1. 1.Department of Computer Science, Trinity College Dublin IE 
  2. 2.Systems Research Group, School of Computer Science and Informatics, UCD Dublin IE 

Personalised recommendations