Advertisement

Effects of Domain Knowledge on User Performance and Perception in a Knowledge Domain Visualization System

  • Xiaojun Yuan
  • Chaomei Chen
  • Xiangmin Zhang
  • Josh Avery
  • Tao Xu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8015)

Abstract

This study investigated how the level of a user’s domain knowledge affected the user’s performance and perception of a knowledge domain visualization system called CiteSpace. Sixteen graduate and sixteen undergraduate students participated in a within-subjects user-centered experiment in a US university. Each of them conducted eight searching tasks in CiteSpace. Results demonstrated that there was an impact of level of domain knowledge on users’ behavior, performance and perception with CiteSpace. Statistical significance was shown that users with higher level of domain knowledge (HD group) spent significantly more time completing tasks and felt significantly more satisfied with the results than users with lower level of domain knowledge (LD group). Statistical significance was also shown that the HD group perceived the system more usable than those of the LD group. The HD group claimed that they learned more new knowledge on the topics than those of the LD group.

Keywords

Information visualization domain knowledge knowledge domain visualization 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Allen, B.L.: Topic knowledge and online catalog search formulation. Library Quarterly 61(2), 188–213 (1991)CrossRefGoogle Scholar
  2. 2.
    Borlund, P.: Experimental components for the evaluation of interaction information retrieval systems. Journal of Documentation 56(1), 71–90 (2000)CrossRefGoogle Scholar
  3. 3.
    Chen, C.: CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. Journal of the American Society for Information Science and Technology 57(3), 359–377 (2006)CrossRefGoogle Scholar
  4. 4.
    Chen, C.: Top 10 unsolved information visualization problems. IEEE Computer Graphics and Applications 25(4), 12–16 (2005)CrossRefGoogle Scholar
  5. 5.
    Chen, C., Paul, R.J.: Visualizing a knowledge domain’s intellectual structure. IEEE Computer 34(3), 65–71 (2001)CrossRefGoogle Scholar
  6. 6.
    Drabenstott, K.M.: Do nondomain experts enlist the strategies of domain experts? Journal of the American Society for Information Science & Technology 54(9), 836–854 (2003)CrossRefGoogle Scholar
  7. 7.
    Ju, B., Burnett, K.: Comparison of human performance by knowledge domain: Types, frequency, and sequencing of errors made while interacting with an information system. Library & Information Science Research 29(4), 471–494 (2007)CrossRefGoogle Scholar
  8. 8.
    Koshman, S.: Testing user interaction with a prototype visualization-based information retrieval system. Journal of the American Society for Information Science and Technology 56(8), 824–833 (2005)CrossRefGoogle Scholar
  9. 9.
    Marchionini, G.: Information Seeking in Full-Text End-User-Oriented Search Systems: The Roles of Domain and Search Expertise. Library and Information Science Research 15(1), 35–69 (1993)Google Scholar
  10. 10.
    Sebrechts, M.M., Cugini, J.V., et al.: Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, Berkeley (1999)Google Scholar
  11. 11.
    Synnestvedt, M., Chen, C.: Design and evaluation of the tightly coupled perceptual-cognitive tasks in knowledge domain visualization. In: Proceedings of the 11th International Conference on Human-Computer Interaction, Las Vegas, Nevada (2005)Google Scholar
  12. 12.
    Vibert, N., Ros, C., Le Bigot, L., Ramond, M., Gatefin, J.: Effects of domain knowledge on reference search with the PubMed database: An experimental study. Journal of the American Society for Information Science & Technology 60(7), 1423–1447 (2009)CrossRefGoogle Scholar
  13. 13.
    Wen, L., Ruthven, I., Borlund, P.: The Effects on Topic Familiarity on Online Search Behaviour and Use of Relevance Criteria. In: Lalmas, M., MacFarlane, A., Rüger, S.M., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds.) ECIR 2006. LNCS, vol. 3936, pp. 456–459. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  14. 14.
    Yuan, X.-J., Belkin, N.J.: Investigating information retrieval support techniques for different information-seeking strategies. Journal of the American Society for Information Science and Technology 61, 1543–1563 (2010), doi:10.1002/asi.21314CrossRefGoogle Scholar
  15. 15.
    Yuan, X.-J., White, R.: Building the Trail Best Traveled: Effects of Domain Knowledge on Web Search Trailblazing. In: ACM SIGCHI Conference on Human Factors in ComputingSystems(CHI 2012), Austin, USA (May 2012)Google Scholar
  16. 16.
    Zhang, X., Anghelescu, H., Yuan, X.: Domain Knowledge, Search Behavior, and Search Effectiveness of Engineering/Science Students: An Exploratory Study. Information Research 10(2), paper 217 (2005), http://InformationR.net/ir/10-2/paper217.html

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Xiaojun Yuan
    • 1
  • Chaomei Chen
    • 2
  • Xiangmin Zhang
    • 3
  • Josh Avery
    • 1
  • Tao Xu
    • 1
  1. 1.College of Computing and InformationUAlbany, State University of New YorkAlbanyUSA
  2. 2.College of Information Science and TechnologyDrexel UniversityPhiladelphiaUSA
  3. 3.School of Library and Information ScienceWayne State UniversityDetroitUSA

Personalised recommendations