Skip to main content
SpringerLink
Log in

Examining the ‘point of frustration’. The think-aloud method applied to online search tasks

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

By revisiting past research on the think-aloud method; its advantages, drawbacks and aptness for tracing online search processes will be examined. What emerges from this review is the need for more attention to detail so as to generate comparable findings. This is especially crucial as the method lends itself to both quantitative and qualitative data analysis and has been employed in a broad range of fields. Thus, a major concern is to describe in detail the design, procedure and framework of analysis of a qualitative study concerned with information needs of professionals in online search processes. Here, think-aloud protocols were used in combination with questionnaires and qualitative interviews, to examine how engineers and architects solved a search task on the European Union website (www.europa.eu). The protocols provided valuable data for tracing increasing levels of frustration followed by the ‘point of frustration’—when the participants gave up searching.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Benbunan-Fich R. (2001). Using protocol analysis to evaluate the usability of a commercial web site. Inform. Manage. 39: 151–163

    Article  Google Scholar 

  • Boren M.T. and Ramey J. (2000). Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43(3): 261–278

    Article  Google Scholar 

  • Branch J.L. (2000). Investigating the information-seeking processes of adolescents: the value of using think alouds and think afters. Library Inform. Sci. Res. 22(4): 371–392

    Article  Google Scholar 

  • Bringham, B., John, R., Lewis, C.: Usability testing of a graphical programming system. Things we missed in a programming walkthrough. Human factors in computing systems conference proceedings on Reaching through technology, pp. 7–12. New Orleans, Louisiana, USA (1991)

  • Bunz, U.: Usability and Gratifications – Towards a Website Analysis Model. Presented at the 87th Annual Conference of the National Communication Association, Atlanta, GA, USA, November (2001)

  • Davison G., Navarre S. and Vogel R. (1995). The articulated thoughts in simulated situations paradigm: a think-aloud approach to cognitive assessment. Curr. Direct. Psychol. Sci. 4(1): 29–33

    Article  Google Scholar 

  • Ericsson K.A. and Simon H.A. (1984). Protocol Analysis. Verbal Reports as Data. The MIT Press Cambridge, MA

    Google Scholar 

  • Ericsson K.A., Simon H.A. (1998) How to study thinking in everday life: Contrasting think-aloud protocols with descriptions and explanations of thinking. Mind, Culture, Activity 5(3): 178–186

    Article  Google Scholar 

  • Eveland W.P. and Dunwoody S. (2000). Examining information processing on the World Wide Web using think aloud protocols. Media Psychol. 2: 219–244

    Article  Google Scholar 

  • Jensen K.B. (2002). A Handbook of Media and Communication Research. Qualitative and Quantitative Methodologies. Routledge, London

    Google Scholar 

  • Kachelrieß E. (1999). Computerbezogene Sprache – Eine explorative Studie zur Untersuchung von handlungsbegleitendem Sprechen in der Interaktion mit dem Computer. Kovac, Hamburg

    Google Scholar 

  • Kjeldskov, J., Skov, M.B.: Creating realistic laboratory settings: comparative studies of three think-aloud usability evaluations of a mobile system. In: Rauterberg, M., et al. (eds.) Human-Computer Interaction, INTERACT 03, pp. 663–670 IOS Press (2003)

  • Lazar J., Bessiere K., Ceaparu I., Robinson J. and Shneiderman B. (2003). Help! I’m lost: user Frustration in Web Navigation. IT Soc. 1(3): 18–26

    Google Scholar 

  • Mastro D.E., Eastin M.S. and Tamborini R. (2002). Internet search behaviors and mood alterations: a selective exposure approach. Mediapsychology 4: 157–172

    Google Scholar 

  • Mehlenbacher, B.: Navigating online information: a characterization of extralinguistic factors that influence user behavior. ACM 089791-533-X1921001010035. (1992)

  • Nielsen J. (1994). Estimating the number of subjects needed for a thinking aloud test. Int. J. Hum.-Comput. Stud. 4: 385–397

    Article  Google Scholar 

  • Nielsen, J., Clemmensen, T., Yssing, C.: Getting access to what goes on in people’s heads? Reflections on the think-aloud technique. NordiCHI, October 19–23 (2002)

  • Papacharissi Z. and Rubin A.M. (2000). Predictors of Internet use. J. Broadcast. Electr. Media 44(2): 175–196

    Article  Google Scholar 

  • Rikard G.L. and Langley D.J. (1995). The think aloud procedure: a research technique for gaining. Phys. Educ. 52(2): 93–98

    Google Scholar 

  • Schaap G. (2004). Using protocol analysis in television news research: proposal and first tests. In: Renckstorf, K., McQuail, D., Rosenbaum, J. and Schaap, G. (eds) Action Theory and Communication Research, pp 115–140. Mouton de Gruyter, Berlin

    Google Scholar 

  • Someren van M.W., Barnard Y.F. and Sandberg J.A.C. (1994). The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes. Academic Press, London

    Google Scholar 

  • Vizri R.A. (1992). Refining the test phase of usability evaluation: How many subjects is enough. Hum Factors 34(4): 457–468

    Google Scholar 

  • Wilson T.D. (1994). The proper protocol: validity and completeness of verbal reports. Psychol. Sci. 5(5): 249–252

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Hans-Bredow-Institute for Media Research, University of Hamburg, Warburgstr. 8-10, Hamburg, 20543, Germany

    Talke Klara Hoppmann

  2. University of Hamburg, Lippmannstr. 23, Hamburg, 22769, Germany

    Talke Klara Hoppmann

Authors
  1. Talke Klara Hoppmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Talke Klara Hoppmann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hoppmann, T.K. Examining the ‘point of frustration’. The think-aloud method applied to online search tasks. Qual Quant 43, 211–224 (2009). https://doi.org/10.1007/s11135-007-9116-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-007-9116-0

Keywords

Search

Navigation