Skip to main content
View expanded cover

SIGIR ’94 pp 192–201Cite as

OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research

  • Conference paper

Abstract

A series of information retrieval experiments was carried out with a computer installed in a medical practice setting for relatively inexperienced physician end-users. Using a commercial MEDLINE product based on the vector space model, these physicians searched just as effectively as more experienced searchers using Boolean searching. The results of this experiment were subsequently used to create a new large medical test collection, which was used in experiments with the SMART retrieval system to obtain baseline performance data as well as compare SMART with the other searchers.

Keywords

  • Relevance Feedback
  • Relevant Reference
  • Test Collection
  • Relevance Judgment
  • Test Database

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-1-4471-2099-5_20
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-1-4471-2099-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Knowledge Finder Reference Manual.North Andover, MA: Aries Systems Corp., 1988

    Google Scholar 

  2. Hersh W, Hickam D. Impact of a computerized information system in a university general medicine clinic. Clinical Research 1992;40:567A

    Google Scholar 

  3. Salton G, Buckley C. Term-weighting approaches in automatic text retrieval. Info Proc Mgmt 1988; 24 (5): 513–523.

    CrossRef  Google Scholar 

  4. Salton G, Buckley C. Improving retrieval performance by relevance feedback. J Am Soc Info Sci 1990; 41: 288–297.

    CrossRef  Google Scholar 

  5. Belkin N, Cool C, Croft W, Callan J. Effect of multiple query representations on information retrieval system performance. In: Korihage R, Rasmussen E, Willett P, ed. Proceedings of the 16th Annual International ACM Special Interest Group in Information Retrieval. Pittsbrugh, PA: ACM Press, 1993: 339–346.

    Google Scholar 

  6. Fuhr N, Knorz G. Retrieval test evaluation of a rule-based automatic indexing (AIR/PHYS). In: vanRijsbergen C, ed. Research and Development in Information Retrieval. Cambridge: Cambridge University Press,1984: 391–408.

    Google Scholar 

  7. Salton G. A new comparison between conventional indexing (MEDLARS) and automatic text processing (SMART). J Am Soc Info Sci 1972; 23 (2): 75–84.

    CrossRef  Google Scholar 

  8. Salton G, Fox E, Wu H. Extended boolean information retrieval. Comm Assoc Comp Mach 1983; 26: 1022–1036.

    MathSciNet  MATH  Google Scholar 

  9. Turtle H, Croft W. Evaluation of an inference network-based retrieval model. ACM Transactions on Information Systems 1991; 9: 187–222.

    CrossRef  Google Scholar 

  10. Robertson S, Thompson C. Weighted searching: The CIRT experiment. Informatics 10: Prospects for Intelligent Retrieval. York: ASLIB, 1990: 153–166.

    Google Scholar 

  11. Harman D. Overview of the first Text REtrieval Conference. In: Korthage R, ed. Proceedings of the 16th Annual International ACM Special Interest Group in Information Retrieval. Pittsburgh: ACM Press, 1993: 36–47.

    Google Scholar 

  12. Hersh W, Hickam D. A comparison of two methods for indexing and retrieval from a full-text medical database. Proceedings of the 55th Annual Meeting of the American Society for Information Science. 1992: 221–230.

    Google Scholar 

  13. Hersh W, Hickam D. A performance and failure analysis of SAPHIRE with a MEDLINE test collection. Journal of the American Medical Informatics Association 1994; 1: 51–60.

    CrossRef  Google Scholar 

  14. Haynes R, McKibbon K, Walker C, Ryan N, Fitzgerald D, Ramsden M. Online access to MEDLINE in clinical settings. Ann Int Med 1990; 112 (1): 78–84.

    Google Scholar 

  15. Saracevic T, Kantor P. A study of information seeking and retrieving. III. Searchers, searches, and overlap. J Am Soc Info Sci 1988; 39: 197–216.

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 1994 Springer-Verlag London Limited

About this paper

Cite this paper

Hersh, W., Buckley, C., Leone, T.J., Hickam, D. (1994). OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research. In: Croft, B.W., van Rijsbergen, C.J. (eds) SIGIR ’94. Springer, London. https://doi.org/10.1007/978-1-4471-2099-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2099-5_20

  • Publisher Name: Springer, London

  • Print ISBN: 978-3-540-19889-5

  • Online ISBN: 978-1-4471-2099-5

  • eBook Packages: Springer Book Archive