Empirical Evaluation of Adaptive User Modeling in a Medical Information Retrieval Application
A comprehensive methodology for evaluating a user model presents challenges in choosing metrics and in assessing usefulness from both user and system perspectives. In this paper, we describe such a methodology and use it to assess the effectiveness of an adaptive user model embedded in a medical information retrieval. We demonstrate that the user model helps to improve the retrieval quality without degrading the system performance and identify usability problems overlooked in the user model architecture. Empirical data help us in analyzing drawbacks in our user model and develop solutions.
KeywordsInformation Retrieval Query Graph System Response Time Adaptive User Comprehensive Methodology
Unable to display preview. Download preview PDF.
- 1.Brajnik G.; Mizzaro S.; and Tasso C. 1996. Evaluating User Interfaces to Information Retrieval Systems. In Proceedings of SIGIR 96. 128–136.Google Scholar
- 3.Harter S. P.; and Hert C. A. 1997. Evaluation of Information Retrieval Systems: Approaches, Issues and Methods. In Annual Review of Information Science and Technology. Vol 32. 3–94.Google Scholar
- 5.Koenemann, J.; and Belkin, N. 1996. A case for interaction: a study of interactive information retrieval behavior and effectiveness. In Proceedings of CHI 96. 205–212.Google Scholar
- 7.Santos E. Jr.; Nguyen H.; and Brown M.S. 2001. Kavanah: An active user interface Information Retrieval Application. In Proceedings of 2nd Asia-Pacific Conference on Intelligent Agent Technology. 412–423.Google Scholar
- 8.Salton, G.; and McGill, M. 1983. Introduction to Modern Information Retrieval. McGraw-Hill Book Company.Google Scholar
- 9.Shneiderman, B. 1998. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley.Google Scholar