Abstract
We used eye-tracking to study 28 users when they evaluated result lists produced by web search engines. Based on their different evaluation styles, the users were divided into economic and exhaustive evaluators. Economic evaluators made their decision about the next action (e.g., query re-formulation, following a link) faster and based on less information than exhaustive evaluators. The economic evaluation style was especially beneficial when most of the results in the result page were relevant. In these tasks, the task times were significantly shorter for economic than for exhaustive evaluators. The results suggested that economic evaluators were more experienced with computers than exhaustive evaluators. Thus, the result evaluation style seems to evolve towards a more economic style as the users gain more experience.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Aaltonen, A., Hyrskykari, A., Räihä, K.-J.: 101 spots, or how do users read menus? In: Proc. CHI 1998, pp. 132–139. ACM Press, New York (1998)
Byrne, M.D., Anderson, J.R., Douglass, S., Matessa, M.: Eye tracking the visual search of click-down menus. In: Proc. CHI 1999, pp. 402–409. ACM Press, New York (1999)
Ellis, S., Cadera, R., Misner, J., Craig, C.S., Lankford, C.P.: Windows to the soul? What eye movements tell us about software usability. In: Proc. 7th Annual Conf. Usability, Professionals Association, Washington D.C (1998)
Goldberg, J.H., Stimson, M.J., Lewenstein, M., Scott, N., Wichansky, A.M.: Eye tracking in web search tasks: Design implications. In: Proc. ETRA 2002, pp. 51–58. ACM Press, New York (2002)
Granka, L., Joachims, T., Gay, vcG.: Eye-tracking analysis of user behavior in WWW search. In: Proc. SIGIR 2004, pp. 478–479. ACM Press, New York (2004)
Hornof, A.J., Halverson, T.: Cognitive strategies and eye movements for searching hierarchical computer displays. In: Proc. CHI 2003, pp. 249–256. ACM Press, New York (2003)
Klöckner, K., Wirschum, N., Jameson, A.: Depth- and breadth-first processing of search result lists. In: Proc. CHI 2004, p. 1539. ACM Press, New York (2004)
Räihä, K.-J., Aula, A., Majaranta, P., Rantala, H., Koivunen, K.: Static visualization of temporal eye-tracking data. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 946–949. Springer, Heidelberg (2005)
Salojärvi, J., Kojo, I., Jaana, S., Kaski, S.: Can relevance be inferred from eye movements in information retrieval? In: Proc. WSOM 2003, pp. 261–266 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 IFIP International Federation for Information Processing
About this paper
Cite this paper
Aula, A., Majaranta, P., Räihä, KJ. (2005). Eye-Tracking Reveals the Personal Styles for Search Result Evaluation. In: Costabile, M.F., Paternò, F. (eds) Human-Computer Interaction - INTERACT 2005. INTERACT 2005. Lecture Notes in Computer Science, vol 3585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11555261_104
Download citation
DOI: https://doi.org/10.1007/11555261_104
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28943-2
Online ISBN: 978-3-540-31722-7
eBook Packages: Computer ScienceComputer Science (R0)