A User Study on Features Supporting Subjective Relevance for Information Retrieval Interfaces
Objective relevance regards retrieved documents as relevant without considering users’ tasks. Subjective relevance, in contrast, focuses on usefulness of documents for users’ contexts. This paper aims to enhance objective relevance and address its limitations by designing a mock-up interface based on ACM Digital Library so as to enhance its support for users’ evaluating the subjective relevance of documents. Important features elicited using a factor analytic approach from an earlier study were used to inform the design of the search, results list and document record pages in the mock-up. A pilot study was conducted to gather users’ feedback about usefulness of designed features. Findings indicated that majority of important features designed were useful. However, subjects suggested that the design of some features could be further improved to facilitate their support for SR. The paper concludes by discussing recommendations for improving the mock-up.
KeywordsFull Text Digital Library User Study Extended Format Boolean Operator
Unable to display preview. Download preview PDF.
- 4.Borlund, P., Ingwersen, P.: Measures for relative relevance and ranked half-life: Performance indicators for interactive IR. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 324–331. ACM Press, New York (1998)CrossRefGoogle Scholar
- 6.Ingwersen, P., Borlund, P.: Information transfer viewed as interactive cognitive processes. In: Ingwersen, P., Pors, N.O. (eds.) Information Science: Integration in Perspective, Royal School of Librarianship, Denmark, pp. 219–232 (1996)Google Scholar
- 7.Lee, S.-S., Theng, Y.-L., Goh, H.-L.D., Foo, S.-B.S.: An exploratory factor analytic approach to understand design features for academic learning environments. In: Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) ECDL 2006. LNCS, vol. 4172, Springer, Heidelberg (2006)CrossRefGoogle Scholar
- 8.Meyyapan, N., Chowdhury, G.G., Foo, S.: Use of a digital work environment prototype to create a user-centered university library. Journal of Information Science 27(4), 249–264 (2001)Google Scholar
- 10.Shneiderman, B.: Designing the user interface: Strategies for effective human-computer interaction. Addison Wesley Longman, USA (1998)Google Scholar