Skip to main content
SpringerLink
Log in
Book cover

PROMISE Winter School

PROMISE 2012: Information Retrieval Meets Information Visualization pp 86–91Cite as

User-Oriented Evaluation in IR

  • Chapter

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7757))

Abstract

The paper discusses briefly user-oriented evaluation in test collections with simulated users and real users, as well as operational systems evaluation. It concludes by a glimpse of issues beyond evaluation. The paper provides pointers to literature where much more thorough discussion of each topic may be found.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Azzopardi, L.: The economics of interactive information retrieval. In: 34th ACM SIGIR Conference (ACM SIGIR 2011), pp. 15–24. ACM Press, New York (2011)

    Chapter  Google Scholar 

  2. Baskaya, F., Keskustalo, H., Järvelin, K.: Simulating Simple and Fallible Relevance Feedback. In: Clough, P., Foley, C., Gurrin, C., Jones, G.J.F., Kraaij, W., Lee, H., Mudoch, V. (eds.) ECIR 2011. LNCS, vol. 6611, pp. 593–604. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  3. Baskaya, F., Keskustalo, H., Järvelin, K.: Time Drives Interaction: Simulating Sessions in Diverse Searching Environments. In: 35th ACM SIGIR Conference (ACM SIGIR 2012), pp. 97–106. ACM Press, New York (2011, 2012)

    Google Scholar 

  4. Harman, D.: Information retrieval evaluation. Morgan & Claypool (2011)

    Google Scholar 

  5. Ingwersen, P., Järvelin, K.: The Turn: Integration of Information Seeking and Retrieval in Context. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  6. Järvelin, K.: An Analysis of Two Approaches in Information Retrieval: From Frameworks to Study Designs. Journal of the American Society for Information Science and Technology (JASIST) 58, 971–986 (2007)

    Article  Google Scholar 

  7. Järvelin, K.: Evaluation. In: Ruthven, I., Kelly, D. (eds.) Interactive Information Seeking, Behaviour and Retrieval, pp. 113–138. Facet Publishing, London (2011)

    Google Scholar 

  8. Järvelin, K.: IR Research: Systems, Interaction, Evaluation and Theories. ACM SIGIR Forum 45, 17–31 (2011), http://www.sigir.org/forum/2011D/conferences/2011d_sigirforum_jarvelin.pdf

    Article  Google Scholar 

  9. Kelly, D.: Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval (FnTIR) 3, 1–224 (2009)

    Article  Google Scholar 

  10. Kumpulainen, S., Järvelin, K.: Information Interaction in Molecular Medicine: Integrated Use of Multiple Channels. In: 3rd Information Interaction in Context Conference (IIiX 2010), pp. 95–104. ACM Press, New York (2010)

    Google Scholar 

  11. Kumpulainen, S., Järvelin, K.: Barriers to Task-based Information Access in Molecular Medicine. Journal of the American Society for Information Science and Technology (JASIST) 63, 86–97 (2012)

    Article  Google Scholar 

  12. Sanderson, M.: Test Collection Based Evaluation of Information Retrieval Systems. Foundations and Trends in Information Retrieval (FnTIR) 4, 247–375 (2010)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Tampere, Finland

    Kalervo Järvelin

Authors
  1. Kalervo Järvelin
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information Engineering, University of Padua, Via Gradenigo 6/a, 35131, Padua, Italy

    Maristella Agosti

  2. Department of Information Engineering, University of Padua, Via Gradenigo 6/a, 35131, Italy

    Nicola Ferro

  3. Center for the Evaluation of Language and Communication Technologies (CELCT), Via alla Cascata 56/c, 38123, Povo, TN, Italy

    Pamela Forner

  4. University of Applied Sciences Western Switzerland, TechnoArk 3, 3960, Sierre, Switzerland

    Henning Müller

  5. Department of Computer, Control and Management, Engineering Antonio Ruberti, Sapienza University of Rome, Via Ariosto 25, 00185, Rome, Italy

    Giuseppe Santucci

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Järvelin, K. (2013). User-Oriented Evaluation in IR. In: Agosti, M., Ferro, N., Forner, P., Müller, H., Santucci, G. (eds) Information Retrieval Meets Information Visualization. PROMISE 2012. Lecture Notes in Computer Science, vol 7757. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36415-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-36415-0_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-36414-3

  • Online ISBN: 978-3-642-36415-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation