Skip to main content
SpringerLink
Log in

Predicting users’ behavior using mouse movement information: an information foraging theory perspective

  • S.I. : Deep Neuro-Fuzzy Analytics in Smart Ecosystems
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The prediction of users’ behavior is essential for keeping useful information on the web. Previous studies have used mouse cursor information in web usability evaluation and designing user-oriented search interfaces. However, we know fairly to a small extent pertaining to user behavior, specifically clicking and navigating behavior, for prolonged search session illustrating sophisticated search norms. In this study, we perform extensive analysis on a mouse movement activities dataset to capture every users’ movement pattern using the effects of information foraging theory (IFT). The mouse cursor movement information dataset includes the timing and positioning information of mouse cursors collected from several users in different sessions. The tasks vary in two dimensions: (1) to determine the interactive elements (i.e., information episodes) of user interaction with the site; (2) adopt these findings to predict users’ behavior by exploiting the LSTM model. Our model is developed to find the main patterns of the user’s movement on the site and simulate the behavior of users’ mouse movement on any website. We validate our approach on a mouse movement dataset with a rich collection of time and position information of mouse pointers in which searchers and websites are annotated by web foragers and information patches, respectively. Our evaluation shows that the proposed IFT-based effects provide an LSTM model a more accurate interpretative exposition of all the patterns in the movement of the users’ mouse cursors across the screen.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Code Availability

https://github.com/amitkumarj441/PUBMMI

References

  1. Bates MJ (1989) The design of browsing and berrypicking techniques for the online search interface. Online Rev 13(5):407–424

    Article  Google Scholar 

  2. Locke EA, Shaw KN, Saari LM, Latham GP (1981) Goal setting and task performance: 1969–1980. Psychol Bull 90(1):125

    Article  Google Scholar 

  3. Saracevic T, Kantor P (1988) A study of information seeking and retrieving. II. Users, questions, and effectiveness. J Am Soc Inform Sci 39(3):177–196

    Article  Google Scholar 

  4. Blackmon MH (2012) Information scent determines attention allocation and link selection among multiple information patches on a webpage. Behav Inform Technol 31(1):3–15

    Article  Google Scholar 

  5. Fang Q, Sang J, Xu C, Hossain MS (2015) Relational user attribute inference in social media. IEEE Trans Multimed 17(7):1031–1044

    Article  Google Scholar 

  6. Pirolli P, Card S (1995) Information foraging in information access environments. In: Chi, vol 95, pp 51–58

  7. Wittek P, Liu YH, Darányi S, Gedeon T, Lim IS (2016) Risk and ambiguity in information seeking: eye gaze patterns reveal contextual behavior in dealing with uncertainty. Front Psychol 7:1790

    Article  Google Scholar 

  8. Savolainen R, Kari J (2004) Conceptions of the Internet in everyday life information seeking. J Inf Sci 30(3):219–226

    Article  Google Scholar 

  9. Catledge L, Pitkow J (1999) Characterizing browsing behavior on the world wide web. Comput Netw ISDN Syst 54(6):20–24

    Google Scholar 

  10. Lazonder AW, Biemans HJ, Wopereis IG (2000) Differences between novice and experienced users in searching information on the World Wide Web. J Am Soc Inf Sci 51(6):576–581

    Article  Google Scholar 

  11. Olston C, Chi EH (2003) ScentTrails: integrating browsing and searching on the Web. ACM Trans Comput Hum Interact (TOCHI) 10(3):177–197

    Article  Google Scholar 

  12. Tomasi D (2014) Using cues to forage for information on the Web. J Syst Inform Technol 16(4):296–312

    Google Scholar 

  13. Winter S, Krämer NC (2012) Selecting science information in Web 2.0: How source cues, message sidedness, and need for cognition influence users’ exposure to blog posts. J Comput Mediat Commun 18(1):80–96

    Article  Google Scholar 

  14. Pirolli P, Card S (1999) Information foraging. Psychol Rev 106(4):643

    Article  Google Scholar 

  15. Azzopardi L, Thomas P, Craswell N (2018) Measuring the utility of search engine result pages: an information foraging based measure. In: The 41st international ACM SIGIR conference on research and development in information retrieval. ACM, pp 605–614

  16. Joachims T, Granka LA, Pan B, Hembrooke H, Gay G (2005) Accurately interpreting clickthrough data as implicit feedback. In: Sigir, vol 5, pp 154–161

  17. Trippas JR, Spina D, Sanderson M, Cavedon L (2015) Towards understanding the impact of length in web search result summaries over a speech-only communication channel. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 991–994

  18. Chen MC, Anderson JR, Sohn MH (2001) What can a mouse cursor tell us more?: Correlation of eye/mouse movements on web browsing. In: CHI’01 extended abstracts on human factors in computing systems. ACM, pp 281–282

  19. Jiang J, He D, Allan J (2014) Searching, browsing, and clicking in a search session: changes in user behavior by task and over time. In: Proceedings of the 37th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 607–616

  20. Huang J, White RW, Dumais S (2011) No clicks, no problem: using cursor movements to understand and improve search. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1225–1234

  21. Agichtein E, Brill E, Dumais S (2006) Improving web search ranking by incorporating user behavior information. In: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, pp 19–26

  22. Lagun D, Agichtein E (2015) Inferring searcher attention by jointly modeling user interactions and content salience. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 483–492

  23. Jansen BJ, Spink A, Saracevic T (2000) Real life, real users, and real needs: a study and analysis of user queries on the web. Inform Process Manag 36(2):207–227

    Article  Google Scholar 

  24. Goecks J, Shavlik J (2000) Learning users’ interests by unobtrusively observing their normal behavior. In: Proceedings of the 5th international conference on intelligent user interfaces. ACM

  25. Claypool M, Le P, Wased M, Brown D (2001) Implicit interest indicators. In: Proceedings of the 6th international conference on Intelligent user interfaces. ACM, pp 33–40

  26. Buscher G, Dumais ST, Cutrell E (2010) The good, the bad, and the random: an eye-tracking study of ad quality in web search. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval. ACM, pp 42–49

  27. Dumais ST, Buscher G, Cutrell E (2010) Individual differences in gaze patterns for web search. In: Proceedings of the third symposium on information interaction in context. ACM, pp 185–194

  28. Clarke CL, Agichtein E, Dumais S, White RW (2007) The influence of caption features on clickthrough patterns in web search. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 135–142

  29. Cutrell E, Guan Z (2007) What are you looking for?: An eye-tracking study of information usage in web search. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 407–416

  30. Broder A (2002) A taxonomy of web search. In: ACM Sigir forum. ACM, vol 36, no 2, pp 3–10

  31. Markey K (2007) Twenty-five years of end-user searching. Part 1: research findings. J Am Soc Inform Sci Technol 58(8):1071–1081

    Article  Google Scholar 

  32. Guo Q, Agichtein E (2008) Exploring mouse movements for inferring query intent. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 707–708

  33. Guo Q, Agichtein E (2010) Ready to buy or just browsing?: Detecting web searcher goals from interaction data. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval. ACM, pp 130–137

  34. Chen L, Fan A, Shi H, Chen G (2020) Region-action LSTM for mouse interaction sequence based search satisfaction evaluation. Inform Process Manag 57(6):102349

    Article  MathSciNet  Google Scholar 

  35. Liu J, Liu C, Cole M, Belkin NJ, Zhang X (2012) Exploring and predicting search task difficulty. In: Proceedings of the 21st ACM international conference on Information and knowledge management. ACM, pp 1313–1322

  36. Steurer M, Trattner C (2013) Predicting interactions in online social networks: an experiment in second life. In: Proceedings of the 4th international workshop on modeling social media. ACM, p 5

  37. Deng L, Poole MS (2010) Affect in web interfaces: a study of the impacts of web page visual complexity and order. Mis Q 711–730

  38. Buda R, Zhang Y (2000) Consumer product evaluation: the interactive effect of message framing, presentation order, and source credibility. J Prod Brand Manag 9(4):229–242

    Article  Google Scholar 

  39. Fülöp Á, Kovács L, Kurics T, Windhager-Pokol E (2017) Balabit mouse dynamics challenge data set. Accessed on May 2016

  40. Pascanu R, Gulcehre C, Cho K, Bengio Y (2013) How to construct deep recurrent neural networks. arXiv preprint arXiv:1312.6026

  41. Graves A (2012) Supervised sequence labelling with recurrent neural networks. http://books.google.com/books

  42. Rathee G, Garg S, Kaddoum G, Choi BJ (2020) A decision-making model for securing IoT devices in smart industries. IEEE Trans Ind Inform

  43. Singh A, Aujla GS, Garg S, Kaddoum G, Singh G (2019) Deep learning-based SDN model for internet of things: an incremental tensor train approach. IEEE Internet Things J

  44. Gochhayat SP, Kaliyar P, Conti M, Prasath VBS, Gupta D, Khanna A (2019) LISA: Lightweight context-aware IoT service architecture. J Clean Prod 212:1345–1356

    Article  Google Scholar 

  45. Zhang T, Sodhro AH, Luo Z, Zahid N, Nawaz MW, Pirbhulal S, Muzammal M (2020) A joint deep learning and internet of medical things driven framework for elderly patients. IEEE Access 8:75822–75832

    Article  Google Scholar 

  46. Kumar S, Zymbler M (2019) Internet of things is a revolutionary approach for future technology enhancement: a review. J Big Data 6(1):111

    Article  Google Scholar 

  47. Pirbhulal S, Pombo N, Felizardo V, Garcia N, Sodhro AH, Mukhopadhyay SC (2019) Towards machine learning enabled security framework for IoT-based healthcare. In: 13th international conference on sensing technology (ICST). IEEE, Chicago, pp 1–6

  48. Shahi GK, Bilbao I, Capecci E, Nandini D, Choukri M, Kasabov N (2018) Analysis, classification and marker discovery of gene expression data with evolving spiking neural networks. In: International conference on neural information processing. Springer, Cham, pp 517–527

  49. Garg S, Kaur K, Batra S, Aujla GS, Morgan G, Kumar N, Ranjan R (2020) En-ABC: an ensemble artificial bee colony based anomaly detection scheme for cloud environment. J Parallel Distrib Comput 135: 219-233

Download references

Acknowledgements

M. Shamim Hossain is grateful to the Deanship of Scientific Research at King Saud University, Riyadh, Saudi Arabia for funding through the Vice Deanship of Scientific Research Chairs: Chair of Pervasive and Mobile Computing.

Author information

Authors and Affiliations

  1. Institute for Research in Applicable Computing, University of Bedfordshire, Luton, UK

    Amit Kumar Jaiswal

  2. Department of Information Engineering, University of Padova, Padua, Italy

    Prayag Tiwari

  3. Chair of Pervasive and Mobile Computing, King Saud University, Riyadh, 11543, Saudi Arabia

    M. Shamim Hossain

  4. Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    M. Shamim Hossain

Authors
  1. Amit Kumar Jaiswal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Prayag Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Shamim Hossain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Prayag Tiwari or M. Shamim Hossain.

Ethics declarations

Conflict of interest

The authors declare that they have any conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jaiswal, A.K., Tiwari, P. & Hossain, M.S. Predicting users’ behavior using mouse movement information: an information foraging theory perspective. Neural Comput & Applic 35, 23767–23780 (2023). https://doi.org/10.1007/s00521-020-05306-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05306-7

Keywords

Search

Navigation