Human-Computer Interaction

INTERACT 2015: Human-Computer Interaction – INTERACT 2015 pp 159-176

An Empirical Study of the Effects of Three Think-Aloud Protocols on Identification of Usability Problems

Conference paper

DOI: 10.1007/978-3-319-22668-2_14

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9297)
Cite this paper as:
Bruun A., Stage J. (2015) An Empirical Study of the Effects of Three Think-Aloud Protocols on Identification of Usability Problems. In: Abascal J., Barbosa S., Fetter M., Gross T., Palanque P., Winckler M. (eds) Human-Computer Interaction – INTERACT 2015. INTERACT 2015. Lecture Notes in Computer Science, vol 9297. Springer, Cham

Abstract

Think-aloud is a de facto standard in user-based usability evaluation to verbalize what a user is experiencing. Despite its qualities, it has been argued that thinking aloud affects the task solving process. This paper reports from an empirical study of the effect of three think-aloud protocols on the identified usability problems. The three protocols were traditional, active listening and coaching. The study involved 43 test subjects distributed on the three think-aloud conditions and a silent control condition in a between-subject design. The results show that the three think-aloud protocols facilitated identification of the double number of usability problems compared to the silent condition, while the problems identified by the three think-aloud protocol were comparable. Our results do not support the common emphasis on the Coaching protocol, while we have seen that the Traditional protocol performs surprisingly well.

Keywords

Usability evaluation Thinking aloud Verbalization Think-aloud protocols Empirical study 

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  1. 1.Department of Computer ScienceAalborg UniversityAalborg EastDenmark

Personalised recommendations