Skip to main content
SpringerLink
Log in
Book cover

International Conference on Information Systems Development

ISD 2019: Advances in Information Systems Development pp 198–212Cite as

Watching People Making Decisions: A Gogglebox on Online Consumer Interaction

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 39))

Abstract

This paper presents a research study using eye tracking technology to observe user interaction with online decisions. Using a subjective measurement scale (NASA-TLX), cognitive load is measured for participants as they encounter micro-decisions in the online transactional process. It elaborates and improves on a pilot study that was used to test the experiment design. Prior research that led to a taxonomy of decision constructs encountered by participants in the online domain is also discussed. The main findings in this paper relate to participants’ subjective cognitive load and task error rates. The overall rationale for the study is to probe ethics in information systems design.

A prior version of this paper has been published in the ISD2019 Proceedings (http://aisel.aisnet.org/isd2014/proceedings2019).

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Barry, C., Torres, A.M.: Tricks and clicks - how low-cost carriers ply their trade through self-service websites. In: Oliver, D., Romm Livermore, C., Sudweeks, F. (eds.) Self-Service in the Internet Age - Expectations and Experiences, pp. 111–137. Springer, New York (2009)

    Google Scholar 

  2. Barry, C., Hogan, M., Torres, A.: Low-cost carriers and high-tech barriers - user views on questionable web design practices in Ireland. Irish J. Manag. 31(1), 43–58 (2011)

    Google Scholar 

  3. Barry, C., Hogan, M., Torres, A.M.: Perceptions of low cost carriers’ compliance with EU legislation on optional extras. In: 20th International Conference on Information Systems Development, Edinburgh, Scotland (2011)

    Google Scholar 

  4. Tversky, A., Kahneman, D.: The framing of decisions and the psychology of choice. Science 211(4481), 453–458 (1981)

    MathSciNet  MATH  Google Scholar 

  5. Kahneman, D., Miller, D.T.: Norm theory: comparing reality to its alternatives. Psychol. Rev. 93(2), 136 (1986)

    Google Scholar 

  6. Samuelson, W., Zeckhauser, R.: Status quo bias in decision making. J. Risk Uncertain. 1(1), 7–59 (1988)

    Google Scholar 

  7. Levin, I.P., Schneider, S.L., Gaeth, G.J.: All frames are not created equal: a typology and critical analysis of framing effects. Organ. Behav. Hum. Decis. Process. 76(2), 149–188 (1998)

    Google Scholar 

  8. Bellman, S., Johnson, E.J., Lohse, G.L.: On site: to opt-in or opt-out?: it depends on the question. Commun. ACM 44(2), 25–27 (2001)

    Google Scholar 

  9. Johnson, E.J., Goldstein, D.G.: Do defaults save lives? Science 302, 1338–1339 (2003)

    Google Scholar 

  10. Lai, Y.-L., Hui, K.-L.: Internet opt-in and opt-out: investigating the roles of frames, defaults and privacy concerns. In: Proceedings of the 2006 ACM SIGMIS CPR Conference on Computer Personnel Research: Forty Four Years of Computer Personnel Research: Achievements, Challenges & the Future, pp. 253–263. ACM, Claremount (2006)

    Google Scholar 

  11. Barry, C., Hogan, M., Torres, A.M.: Framing or gaming? Constructing a study to explore the impact of option presentation on consumers. In: Information System Development: Transforming Healthcare Through Information Systems, pp. 111–124. Springer (2016)

    Google Scholar 

  12. Anaraky, R.G., Nabizadeh, T., Knijnenburg, B.P., Risius, M.: Reducing default and framing effects in privacy decision-making. In: SIGCHI 2018, San Francisco, CA, pp. 1–6 (2018)

    Google Scholar 

  13. Hogan, M., Barry, C., Torres, A.M.: Theorising and testing a taxonomy of decision constructs. J. Cust. Behav. 13(3), 171–185 (2014)

    Google Scholar 

  14. Barry, C., Hogan, M., Torres, A.M.: Confirming a taxonomy of decision constructs in business-to-consumer commercial transactions. In: 23rd International Conference on Information Systems Development, Varaždin, Croatia (2014)

    Google Scholar 

  15. Grimes, G.M., Valacich, J.S.: Mind over mouse: the effect of cognitive load on mouse movement. In: Thirty Sixth International Conference on Information Systems, Forth Worth, USA (2015)

    Google Scholar 

  16. Miller, S.: Literature review - workload measures. National Advanced Driving Simulator (2001)

    Google Scholar 

  17. Brunken, R., Plass, J.L., Leutner, D.: Direct measurement of cognitive load in multimedia learning. Educational Psychologist. 38(1), 53–61 (2003)

    Google Scholar 

  18. Hoonakker, P., Carayon, P., Gurses, A., Brown, R., McGuire, K., Khunlertkit, A., Walker, J.M.: Measuring workload of ICU nurses with a questionnaire survey: the Nasa task load index (TLX). IIE Trans. Healthc. Syst. Eng. 1(2), 131–143 (2011)

    Google Scholar 

  19. Schmutz, P., Heinz, S., Métrailler, Y., Opwis, K.: Cognitive load in eCommerce applications - measurement and effects on user satisfaction. Adv. Hum.-Comput. Interact. 2009, 1–9 (2009)

    Google Scholar 

  20. Longo, L., Rusconi, F., Noce, L., Barrett, S.: The importance of human mental workload in web design. In: WEBIST 2012 8th International Conference on Web Information Systems and Technologies, pp. 403–409 (2012)

    Google Scholar 

  21. Martin, S.: Measuring cognitive load and cognition: metrics for technology-enhanced learning. Educ. Res. Eval. 20(7–8), 592–621 (2014)

    Google Scholar 

  22. Rubio, S., Díaz, J.E., Martín, J., Puente, J.M.: Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Appl. Psychol.: Int. Rev. 53(1), 61–86 (2004)

    Google Scholar 

  23. Eveland, W.P., Dunwoody, S.: Examining information processing on the world wide web using think aloud protocols. Media Psychol. 2(3), 219–244 (2000)

    Google Scholar 

  24. Gopher, D., Braune, R.: On the psychophysics of workload: why bother with subjective measures? Hum. Factors 26(5), 519–532 (1984)

    Google Scholar 

  25. Paas, F.: Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J. Educ. Psychol. 84(4), 429–434 (1992)

    Google Scholar 

  26. Galy, E., Cariou, M., Melan, C.: What is the relationship between mental workload factors and cognitive load types? Int. J. Psychophysiol. 83(3), 269–275 (2012)

    Google Scholar 

  27. Luximon, A., Goonetilleke, R.S.: Simplified subjective workload assessment technique. Ergonomics 44(3), 229–243 (2001)

    Google Scholar 

  28. Hill, S.G., Ianecchia, H.P., Byers, J.C., Bittner, A.C., Zakland, A.L., Christ, R.E.: Comparison of four subjective workload rating scales. Hum. Factors 34(4), 429–439 (1992)

    Google Scholar 

  29. Albers, M.: Tapping as a measure of cognitive load and website usability. In: 29th ACM International Conference on Design of Communication, pp. 25–32. ACM, Pisa (2011)

    Google Scholar 

  30. Zheng, B., Jiang, X., Tien, G., Meneghetti, A., Panton, O.N., Atkins, M.S.: Workload assessment of surgeons: correlation between NASA TLX and blinks. Surg. Endosc. 26(10), 2746–2750 (2012)

    Google Scholar 

  31. Finomore, V.S., Shaw, T.H., Warm, J.S., Matthews, G., Boles, D.B.: Viewing the workload of vigilance through the lenses of the NASA-TLX and the MRQ. Hum. Factors: J. Hum. Factors Ergon. Soc. 55(6), 1044–1063 (2013)

    Google Scholar 

  32. Hart, S.G.: Nasa-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 904–908 (2006)

    Google Scholar 

  33. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)

    Google Scholar 

  34. NASA: NASA TLX paper and pen manual. http://humansystems.arc.nasa.gov/groups/tlx/paperpencil.html

  35. Wiebe, E.N., Roberts, E., Behrend, T.S.: An examination of two mental workload measurement approaches to understanding multimedia learning. Comput. Hum. Behav. 26(3), 474–481 (2010)

    Google Scholar 

  36. Colligan, L., Potts, H.W., Finn, C.T., Sinkin, R.A.: Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record. Int. J. Med. Inform. 84(7), 469–476 (2015)

    Google Scholar 

  37. Nygren, T.E.: Psychometric properties of subjective workload measurement techniques: implications for their use in the assessment of perceived mental workload. Hum. Factors 33(1), 17–33 (1991)

    Google Scholar 

  38. Goodman, J., Brewster, S.A., Gray, P.: How can we best use landmarks to support older people in navigation? Behav. Inf. Technol. 24(1), 3–20 (2005)

    Google Scholar 

  39. Smuts, M., Scholtz, B., Calitz, A.P.: Usability guidelines for designing information visualisation tools for novice users. In: Beyond Development. Time for a New ICT4D Paradigm? Proceedings of the 9th IDIA Conference, IDIA2015, Nungwi, Zanzibar, pp. 148–162 (2015)

    Google Scholar 

  40. Hayashi, T., Kishi, R.: Utilization of NASA-TLX for workload evaluation of gaze-writing systems. In: IEEE International Symposium on Multimedia, pp. 271–272 (2014)

    Google Scholar 

  41. Mohamed, R., Raman, M., Anderson, J., McLaughlin, K., Rostom, A., Coderre, S.: Validation of the national aeronautics and space administration-task load index as a tool to evaluate the learning curve for endoscopy training. Can. J. Gastroentrol. Hepatol. 28(3), 155–160 (2014)

    Google Scholar 

  42. González Gutiérrez, J.L., Jiménez, B.M., Hernández, E.G., López López, A.: Spanish version of the swedish occupational fatigue inventory (SOFI): factorial replication, reliability and validity. Int. J. Ind. Ergon. 35(8), 737–746 (2005)

    Google Scholar 

  43. Wesiaka, G., Steinera, C.M., Moore, A., Dagger, D., Power, D., Bertholda, M., Alberta, D., Conlan, O.: Iterative augmentation of a medical training simulator: effects of affective metacognitive scaffolding. Comput. Educ. 76, 13–19 (2014)

    Google Scholar 

  44. Nielsen, J., Pernice, K.: Eyetracking Web Usability. New Riders, Berkeley (2010)

    Google Scholar 

  45. Djamasbi, S., Siegel, M., Tullis, T., Dai, R.: Efficiency, trust, and visual appeal: usability testing through eye tracking. In: 43rd Hawaii International Conference on System Sciences (HICSS), pp. 1–10. IEEE (2010)

    Google Scholar 

  46. Di Stasi, L.L., Antolí, A., Cañas, J.J.: Main sequence: an index for detecting mental workload variation in complex tasks. Appl. Ergon. 42(6), 807–813 (2011)

    Google Scholar 

  47. Djamasbi, S., Siegel, M., Skorinko, J., Tullis, T.: Online viewing and aesthetic preferences of generation Y and the baby boom generation: testing user web site experience through eye tracking. Int. J. Electron. Commer. 15(4), 121–158 (2011)

    Google Scholar 

  48. Huang, Y.-F., Kuo, F.-Y.: An eye-tracking investigation of internet consumers’ decision deliberateness. Internet Res. 21(5), 541–561 (2011)

    Google Scholar 

  49. Pernice, K., Nielsen, J.: Eyetracking methodology: how to conduct and evaluate usability studies using eyetracking. Technical report in Nielsen Norman Group (2009)

    Google Scholar 

  50. Day, R.F., Shyi, G.C.W., Wang, J.C.: The effect of flash banners on multiattribute decision making: distractor or source of arousal? Psychol. Mark. 23(5), 369–382 (2006)

    Google Scholar 

  51. Glöckner, A., Herbold, A.K.: An eye-tracking study on information processing in risky decisions: evidence for compensatory strategies based on automatic processes. J. Behav. Decis. Mak. 24(1), 71–98 (2011)

    Google Scholar 

  52. Hogan, M., Barry, C., Torres, A.M.: An eye tracking pilot study on optionality - some lessons learned. In: 17th Irish Academy of Management Annual Conference, Galway (2015)

    Google Scholar 

  53. European-Union: Directive on Consumer Rights. In: European-Union (ed.) 2011/83/EU (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National University of Ireland, Galway, Ireland

    Chris Barry & Mairéad Hogan

Authors
  1. Chris Barry
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mairéad Hogan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chris Barry .

Editor information

Editors and Affiliations

  1. 130 impasse Louis Bonamici Résidence le Gouverneur B2, Toulon, France

    Alena Siarheyeva

  2. Cairnes School of Business and Economics, National University of Ireland Galway, Galway, Ireland

    Chris Barry

  3. Cairnes School of Business and Economics, National University of Ireland Galway, Galway, Ireland

    Michael Lang

  4. Faculty of Information Technology, Monash University, Melbourne, VIC, Australia

    Henry Linger

  5. IESE Business School, University of Navarra, Barcelona, Spain

    Christoph Schneider

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Barry, C., Hogan, M. (2020). Watching People Making Decisions: A Gogglebox on Online Consumer Interaction. In: Siarheyeva, A., Barry, C., Lang, M., Linger, H., Schneider, C. (eds) Advances in Information Systems Development. ISD 2019. Lecture Notes in Information Systems and Organisation, vol 39. Springer, Cham. https://doi.org/10.1007/978-3-030-49644-9_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49644-9_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49643-2

  • Online ISBN: 978-3-030-49644-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation