Abstract
Although peripheral displays have been a domain of inquiry for over a decade now, evaluation criteria and techniques for this area are still being created. Peripheral display evaluation is an acknowledged challenge in a field setting. This chapter first describes models and methods that have been tailored specifically to evaluating peripheral displays (measuring how well they achieve their goals). Then, we present evaluation criteria used in past evaluations of peripheral displays, ranging from issues such as learnability to distraction. After explaining how these criteria have been assessed in the past, we present a case study evaluation of two e-mail peripheral displays that demonstrates the pros and cons of various evaluation techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arroyo E, Selker T (2003) Arbitrating multimodal outputs: Using ambient displays as interruptions. Proceedings of 10th International Conference on Human–Computer Interaction (HCI International), 591–595. Lawrence Erlbaum Associates, Crete, Greece.
Booth, P. (1989). An Introduction to Human–Computer Interaction. Lawrence Erlbaum Associates, London.
Brinck T, Gergle D, Wood SD (2002) Designing Web Sites that Work: Usability for the Web. Morgan Kaufmann, San Francisco.
Cadiz JJ, Venolia G, Jancke G, Gupta A (2002) Designing and deploying an information awareness interface. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW), 314–323. ACM Press, New York.
Carter S, Mankoff J, Klemmer S, Matthews T (2008) Exiting the cleanroom: On ecological validity and ubiquitous computing. Human–Computer Interaction Journal 23(1):47–99.
Consolvo S, Roessler P, Shelton BE (2004) The CareNet Display: Lessons learned from an in home evaluation of an ambient display. Proceedings of the 6th International Conference on Ubiquitous Computing (UbiComp), 1–17. Springer, Berlin.
Constantine LL, Lockwood LAD (1999) Software for Use: A Practical Guide to the Models and Methods of Usage-Centred Design. Addison-Wesley, New York.
Czerwinski M, Horvitz E, Wilhite S (2004) A diary study of task switching and interruptions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 175–182. ACM Press, New York.
Dabbish L, Kraut RE (2004) Controlling interruptions: Awareness displays and social motivation for coordination. Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW). ACM Press, New York.
Dabbish L, Kraut RE, Fussell S, Kiesler S (2005) Understanding email use: Predicting action on a message. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 691–700. ACM Press, New York.
Dahley A, Wisneski C, Ishii H (1998) Water lamp and pinwheels: Ambient projection of digital information into architectural space. Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 269–270. ACM Press, New York.
Dumas JS, Redish JC (1993) A Practical Guide to Usability Testing. Ablex Publishing Co, Norwood, NJ.
Gaver WW, Smith RB, O'shea T (1991) Effective sounds in complex systems: the ARKOLA simulation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 85–90. ACM Press, New York.
Guillemette RA (1995) The evaluation of usability in interactive information systems. In Carey JM (ed.), Human Factors in Information Systems: Emerging Theoretical Bases (207–221). Ablex Publishing Co, Norwood, NJ.
Hix D, Hartson HR (1993) Developing User Interfaces: Ensuring Usability Through Product & Process. John Wiley, New York.
Ho-Ching FW-L, Mankoff J, Landay JA (2003) Can you see what I hear? The design and evaluation of a peripheral sound display for the deaf. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 161–168. ACM Press, New York.
Iso-9241-11 International Standards Organization (1998) Guidance on Usability. (Report ISO 9241–11).
Maglio PP, Campbell CS (2000) Tradeoffs in displaying peripheral information. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 241–248. ACM Press, New York.
Mamykina L, Mynatt E, Terry M (2003) Time aura: Interfaces for pacing. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 144–151. ACM Press, New York.
Mankoff J, Dey AK, Hsieh G, Kientz J, Lederer S, Ames M (2003) Heuristic evaluation of ambient displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 169–176. ACM Press, New York.
Matthews T, Blais D, Shick A, Mankoff J, Forlizzi J, Rohrbach S, Klatzky R (2006a) Evaluating Glanceable Visuals for Multitasking. (Technical Report EECS-2006-173). U.C. Berkeley.
Matthews T, Czerwinski M, Robertson G, Tan D (2006b) Clipping Lists and Change Borders: Improving multitasking efficiency with peripheral information design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 989–998. ACM Press, New York.
Matthews T, Fong J, Ho-Ching FW, Mankoff J (2006c) Evaluating non-speech sound visualizations for the deaf. Behaviour & Information Technology, 25(4):333–351.
Matthews T, Forlizzi J, Rohrbach S (2005) Designing Glanceable Peripheral Displays. EECS-2006-113. U.C. Berkeley.
Matthews T, Rattenbury T, Carter S (2007) Defining, designing, and evaluating peripheral displays: An analysis using activity theory. Human–Computer Interaction Journal, 22(1):221–261.
McCrickard DS, Catrambone R, Chewar CM, Stasko JT (2003a) Establishing tradeoffs that leverage attention for utility: Empirically evaluating information display in notification systems. International Journal of Human–Computer Studies, 8(5):547–582.
McCrickard DS, Chewar CM, Somervell JP, Ndiwalana A (2003b) A model for notification systems evaluation – Assessing user goals for multitasking activity. ACM Transactions on Computer-Human Interaction, 10(4):312–338.
Mynatt ED, Back M, Want R, Baer M, Ellis JB (1998) Designing audio aura. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 566–573. ACM Press, New York.
Nielsen J (1993) Usability Engineering. Academic Press, London.
Parsowith S, Fitzpatrick G, Kaplan S, Segall B, Boot J (1998) Tickertape: Notification and communication in a single line. Proceedings of the Third Asian Pacific Computer and Human interaction (APCHI), 139–144. IEEE Computer Society.
Pedersen ER, Sokoler T (1997) AROMA: Abstract representation of presence supporting mutual awareness. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 51–58. ACM Press, New York.
Preece J, Rogers Y, Sharp H, Benyon D, Holland S, Carey T (1994) Human Computer Interaction. Addison-Wesley, Wokingham.
Redström J, Skog T, Hallnäs L (2000) Informative art: Using amplified artworks as information displays. Proceedings of the Conference on Designing Augmented Reality Environments (DARE), 103–114. ACM Press, New York.
Schneiderman B, Plaisant C (2004) Designing the User Interface. Addison-Wesley, Reading, MA.
Seffah A, Donyaee M, Kline RB, Padda HK (2006). Usability measurements and metrics: A consolidated model. Software Qual Journal, 14:159–178.
Shackel B (1991) Usability—Context, framework, definition, design and evaluation. In Shackel B, Richardson S (eds.), Human Factors for Informatics Usability (21–38). University Press, Cambridge.
Shami NS, Leshed G, Klein D (2005) Context of use evaluation of peripheral displays. Proceedings of the Tenth IFIP TC13 International Conference on Human Computer Interaction (INTERACT), 579–587. Springer, Berlin.
Skog T, Ljungblad S, Holmquist LE (2003) Between aesthetics and utility: Designing ambient information visualizations. IEEE Symposium on Information Visualization (INFOVIS), 233–240. IEEE Computer Society, Seattle, WA.
Stasko J, Mccolgin D, Miller T, Plaue C, Pousman Z (2005) Evaluating the InfoCanvas Peripheral Awareness System: A Longitudinal, In Situ Study. (Technical Report GIT-GVU-05-08). Georgia Institute of Technology, Atlanta, GA.
Van Dantzich M, Robbins D, Horvitz E, Czerwinski M (2002) Scope: Providing awareness of multiple notifications at a glance. Proceedings of the Working Conference on Advanced Visual Interfaces (AVI). ACM Press, New York.
Weiser M, Brown JS (1996) Designing calm technology. PowerGrid Journal, 1(1).
Zhang L, Tu N, Vronay D (2005) Info-Lotus: A peripheral visualization for email notification. Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI), 1901–1904. ACM Press, New York.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag London Limited
About this chapter
Cite this chapter
Matthews, T., Hsieh, G., Mankoff, J. (2009). Evaluating Peripheral Displays. In: Markopoulos, P., De Ruyter, B., Mackay, W. (eds) Awareness Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-477-5_19
Download citation
DOI: https://doi.org/10.1007/978-1-84882-477-5_19
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-476-8
Online ISBN: 978-1-84882-477-5
eBook Packages: Computer ScienceComputer Science (R0)