Intelligent Invocation: Towards Designing Context-Aware User Assistance Systems Based on Real-Time Eye Tracking Data Analysis

  • Christian PeukertEmail author
  • Jessica Lechner
  • Jella Pfeiffer
  • Christof Weinhardt
Conference paper
Part of the Lecture Notes in Information Systems and Organisation book series (LNISO, volume 32)


Recently introduced virtual and augmented reality devices such as the HTC Vive Pro Eye or Microsoft’s HoloLens 2 come with integrated eye tracking technology. Eye tracking technology is thus closer to the consumer market than ever before. Should these systems make the leap into the end consumer market, possibilities also evolve to use the data to feed intelligent user assistance systems in real time. One application could be to detect phases in consumers’ decision making processes based on eye tracking data, which, in turn, can be used to offer context-aware assistance to consumers. By analyzing eye tracking data from an experiment in a virtual reality shopping environment, we test existing approaches to detect decision phases and evaluate their applicability for an intelligent invocation of real-time user assistance. Furthermore, we propose a new approach, called on-the-fly-detection, since we conclude that existing approaches are not suitable for real-time phase detection.


User assistance systems Decision phases NeuroIS Context-aware systems Eye tracking Virtual reality 


  1. 1.
    Patney, A., Salvi, M., Kim, J., Kaplanyan, A., Wyman, C., Benty, N., et al. (2016). Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics, 35, 1–12.CrossRefGoogle Scholar
  2. 2.
    Meißner, M., Pfeiffer, J., Pfeiffer, T., & Oppewal, H. (2019). Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research, 100, 445–458.Google Scholar
  3. 3.
    Russo, J. E., & Leclerc, F. (1994). An eye-fixation analysis of choice processes for consumer nondurables. Journal of Consumer Research, 21, 274–290.Google Scholar
  4. 4.
    Gidlöf, K., Wallin, A., Dewhurst, R., & Holmqvist, K. (2013). Using eye tracking to trace a cognitive process: Gaze behaviour during decision making in a natural environment. Journal of Eye Movement Research, 6, 1–14.Google Scholar
  5. 5.
    Glaholt, M. G., & Reingold, E. M. (2011). Eye movement monitoring as a process tracing methodology in decision making research. Journal of Neuroscience, Psychology, 4, 125–146.CrossRefGoogle Scholar
  6. 6.
    Pfeiffer, J., Meißner, M., Brandstätter, E., Riedl, R., Decker, R., & Rothlauf, F. (2014). On the influence of context-based complexity on information search patterns: An individual perspective. Journal of Neuroscience, Psychology, and Economics, 7, 103–124.CrossRefGoogle Scholar
  7. 7.
    Friemel, C., Morana, S., Pfeiffer, J., & Maedche, A. (2017). On the role of users’ cognitive-affective states for user assistance invocation. Lecture Notes in Information Systems and Organisation, 25, 37–46.CrossRefGoogle Scholar
  8. 8.
    Maedche, A., Morana, S., Schacht, S., Werth, D., & Krumeich, J. (2016). Advanced user assistance systems. Business and Information Systems Engineering, 58, 367–370.CrossRefGoogle Scholar
  9. 9.
    vom Brocke, J., & Liang, T. (2014). Guidelines for neuroscience studies in information systems research. Journal of Management Information Systems, 30, 211–233.CrossRefGoogle Scholar
  10. 10.
    Xiao, B., & Benbasat, I. (2007). E-Commerce product recommendation agents: Use, characteristics, and impact. MIS Quarterly, 31, 137–209.CrossRefGoogle Scholar
  11. 11.
    Wang, W., & Benbasat, I. (2005). Trust in and adoption of online recommendation agents. Journal of the Association for Information Systems, 6, 72–101.CrossRefGoogle Scholar
  12. 12.
    Groissberger, T., & Riedl, R. (2017). Do online shops support customers’ decision strategies by interactive information management tools? Results of an empirical analysis. Electronic Commerce Research and Applications, 26, 131–151.CrossRefGoogle Scholar
  13. 13.
    Bailey, B. P., & Konstan, J. A. (2006). On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in Human Behavior, 22, 685–708.CrossRefGoogle Scholar
  14. 14.
    Venkatesh, V., Aloysius, J. A., Hoehle, H., Burton, S., & Walton, S. M. (2017). Design and evaluation of auto-ID enabled shopping assistance artifacts in customers’ mobile phones: Two retail store laboratory experiments. MIS Quarterly, 41, 83–113.CrossRefGoogle Scholar
  15. 15.
    Reutskaja, E., Nagel, R., Camerer, C. F., & Rangel, A. (2011). Dynamics in consumer choice under time pressure: An eye-tracking study. American Economic Review, 101, 900–926.CrossRefGoogle Scholar
  16. 16.
    Orquin, J. L., & Mueller Loose, S. (2013). Attention and choice: A review on eye movements in decision making. Acta Psychologica, 144, 190–206.CrossRefGoogle Scholar
  17. 17.
    Peukert, C., Pfeiffer, J., Meißner, M., Pfeiffer, T., & Weinhardt, C. (2019). Shopping in virtual reality stores: The influence of immersion on system adoption. Journal of Management Information Systems, 36, 755–788.Google Scholar
  18. 18.
    The CBC system for choice-based conjoint analysis. (2013). Sawtooth Software Inc. Sawtooth Software Technology Paper Series, 8, 1–27.Google Scholar
  19. 19.
    Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford: Oxford University Press.Google Scholar
  20. 20.
    Gloeckner, A., & Herbold, A.-K. (2011). An eye-tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes. Journal of Behavioral Decision Making, 24, 71–98.CrossRefGoogle Scholar
  21. 21.
    Guan, Z., Lee, S., Cuddihy, E., Ramey, J. (2006). The validity of the stimulated retrospective think-aloud method as measured by eye tracking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2006 (pp. 1253–1262). ACM: New York.Google Scholar
  22. 22.
    Gregor, S., & Benbasat, I. (1999). Explanations from intelligent systems: Theoretical foundations and implications for practice. MIS Quarterly, 23, 497–530.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Christian Peukert
    • 1
    Email author
  • Jessica Lechner
    • 2
  • Jella Pfeiffer
    • 3
  • Christof Weinhardt
    • 1
  1. 1.Karlsruhe Institute of Technology (KIT), Institute of Information Systems and MarketingKarlsruheGermany
  2. 2.Karlsruhe Institute of Technology (KIT)KarlsruheGermany
  3. 3.Department of Economics and Business StudiesJustus Liebig University GiessenGiessenGermany

Personalised recommendations