Evaluating Intelligibility Usage and Usefulness in a Context-Aware Application

  • Brian Y. Lim
  • Anind K. Dey
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8008)


Intelligibility has been proposed to help end-users understand context-aware applications with their complex inference and implicit sensing. Usable explanations can be generated and designed to improve user understanding. However, will users want to use these intelligibility features? How much intelligibility will they use, and will this be sufficient to improve their understanding? We present a quasi-field experiment of how participants used the intelligibility features of a context-aware application. We investigated how many explanations they viewed, how that affected their understanding of the application’s behavior, and suggestions they had for improving its behavior. We discuss what constitutes successful intelligibility usage, and provide recommendations for designing intelligibility to promote its effective use.


Context-Awareness Intelligibility Explanations User Study 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cheverst, K., et al.: Exploring issues of user model transparency and proactive behavior in an office environment control system. UMUAI 2005 15(3-4), 235–273 (2005)Google Scholar
  2. 2.
    Dey, A.K., Abowd, G.D., Salber, D.: A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. HCI Journal 16(2-4), 97–166 (2001)Google Scholar
  3. 3.
    Hilbert, D.M., Redmiles, D.F.: Extracting usability information from user interface events. ACM Computing Survey 32(4), 384–421 (2000)CrossRefGoogle Scholar
  4. 4.
    Lim, B.Y., et al.: Why and why not explanations improve the intelligibility of context-aware intelligent systems. In: CHI 2009, pp. 2119–2128 (2009)Google Scholar
  5. 5.
    Lim, B.Y., Dey, A.K.: Assessing Demand for Intelligibility in Context-Aware Applications. In: Ubicomp 2009, pp. 195–204 (2009)Google Scholar
  6. 6.
    Lim, B.Y., Dey, A.K.: Toolkit to Support Intelligibility in Context-Aware Applications. In: Ubicomp 2010, pp. 13–22 (2010)Google Scholar
  7. 7.
    Lim, B.Y., Dey, A.K.: Design of an Intelligible Mobile Context-Aware Application. In: MobileHCI 2011 (2011) (to appear)Google Scholar
  8. 8.
    Lim, B.Y., Dey, A.K.: Investigating Intelligibility for Uncertain Context-Aware Applications. In: Ubicomp 2011 (2011) (to appear)Google Scholar
  9. 9.
    Lu, H., et al.: SoundSense: scalable sound sensing for people-centric applications on mobile phones. In: MobiSys 2009, pp. 165–178 (2009)Google Scholar
  10. 10.
    Milewski, A.E., Smith, T.M.: Providing Presence Cues to Telephone Users. In: CSCW 2000, pp. 89–96 (2000)Google Scholar
  11. 11.
    Muir, B.: Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37(11), 1905–1922 (1994)CrossRefGoogle Scholar
  12. 12.
    Rosenthal, S., Dey, A.K., Veloso, M.: Using Decision-Theoretic Experience Sampling to Build Personalized Mobile Phone Interruption Models. In: Lyons, K., Hightower, J., Huang, E.M. (eds.) Pervasive 2011. LNCS, vol. 6696, pp. 170–187. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    Roto, V., et al.: Examining Mobile Phone Use in the Wild with Quasi-Experimentation. Helsinky Institute for Information Technology (HIIT), Technical Report (2004)Google Scholar
  14. 14.
    Tullio, J., et al.: How it works: A field study of non-technical users interacting with an intelligent system. In: CHI 2007, pp. 31–40 (2007)Google Scholar
  15. 15.
    Vermeulen, J., et al.: PervasiveCrystal: Asking and Answering Why and Why Not Questions about Pervasive Computing Applications. IE 10, 271–276 (2010)Google Scholar
  16. 16.
    Weka for Android, (retrieved August 26, 2011)

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Brian Y. Lim
    • 1
  • Anind K. Dey
    • 1
  1. 1.Carnegie Mellon UniversityPittsburghUSA

Personalised recommendations