Skip to main content
SpringerLink
Log in

NTCIR Workshop : Japanese- and Chinese-English Cross-Lingual Information Retrieval and Multi-grade Relevance Judgments

  • Conference paper
  • First Online:
Cross-Language Information Retrieval and Evaluation (CLEF 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2069))

Included in the following conference series:

Abstract

This paper introduces the NTCIR Workshops, a series of evaluation workshops designed to enhance research in Japanese and Asian language text retrieval, cross-lingual information retrieval, and related text processing techniques such as summarization, extraction, etc. by providing large-scale test collections and a forum of researchers. Twenty-eight groups from six countries participated in the first workshop and forty-six groups from eight countries have registered for the second. The test collections used in the Workshops are basically TREC-type collections but they contain several unique characteristics including multi-grade relevance judgments. Finally some thoughts on future directions are suggested.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. NTCIR Project: http://research.nii.ac.jp/ntcir/

  2. NTCIR Workshop 1: Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition, Aug. 30-Sept. 1, 1999, Tokyo, ISBN 4-924600-77-6. (http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings

  3. TREC URL: http://trec.nist.gov

  4. NTCIR Workshop 2: http://research.nii.ac.jp/ntcir-ws2

  5. Kando, N.: Cross-Linguistic Scholarly Information Transfer and Database Services in Japan. Annual Meeting of the ASIS, Washington DC. 1997

    Google Scholar 

  6. Chiang, Yu-ting: A Study on Design and Implementation for Chinese Information Retrieval Benchmark. Master Thesis, National Taiwan University, 1999, 184 p.

    Google Scholar 

  7. Shaw, W.M., Jr, et al.: The cystic fibrosis database: Content and research opportunities. Library and Information Science Research, 13, 347–366, 1991.

    Google Scholar 

  8. Hersh, W., et al.: OHSUMED: an Interactive Retrieval Evaluation and New Large Test Collection for Research. Proceedings of ACM-SIGIR’94. p.192–201, 1994.

    Google Scholar 

  9. Losee, R.M.: Text retrieval and filtering: analytic models of performance. Kluwer, 1998

    Google Scholar 

  10. Borlund, P., Ingwersen, P.: Measures of relative relevance and ranked half-life: Performance indicators for interactive IR. Proceedings of ACM-SIGIR 98, p.324–331, 1998.

    Google Scholar 

  11. Jarvelin, K., Kekalainen, J.: IR evaluation methods for retrieving highly relevant documents. Proceedings of ACM-SIGIR 2000, p. 41–48, 2000.

    Google Scholar 

  12. Kando, N. et al.: NTCIR-1: Its Policy and Practice, IPSJ SIG Notes, Vol.99, No.20, pp. 33–40, 1999 [in Japanese].

    Google Scholar 

  13. Kuriyama, K. et al.: Pooling for a Large Scale Test Collection: Analysis of the Search Results for the Pre-test of the NTCIR-1 Workshop, IPSJ SIG Notes, May, 1999 [in Japanese].

    Google Scholar 

  14. Kuriyama, K. et al.: Construction of a Large Scale Test Collection: Analysis of the Training Topics of the NTCIR-1, IPSJ SIG Notes, July 1999 [in Japanese].

    Google Scholar 

  15. Kando, N. et al.: Construction of a Large Scale Test Collection: Analysis of the Test Topics of the NTCIR-1, in Proceedings of IPSJ Annual Meeting [in Japanese]. Sept, 30-Oct.3, 1999.

    Google Scholar 

  16. Voorhees, E.M.: Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness, in Proceedings of the ACM SIGIR’ 98, pp. 315–323.

    Google Scholar 

  17. Ballesteros, L. et al.: Resolving ambiguity for cross-language retrieval, in Proceedings of the ACM SIGIR’ 98, pp. 64–71.

    Google Scholar 

  18. Shauble, P. et al.: Cross-language Information Retrieval (CLIR) Track overview, in Proceedings of TREC 6, pp. 25–30, 1998.

    Google Scholar 

  19. Kando, N. et al.: Cross-Lingual Information Retrieval using Automatically Generated Multilingual Keyword Clusters, in Proceedings of the 3rd IRAL, pp. 86–94, 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Institute of Informatics (NII), Tokyo 101-8430, Japan

    Noriko Kando

Authors
  1. Noriko Kando
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Istituto di Elaborazione della Informazione, Via Moruzzi, 1, 56124, Pisa, Italy

    Carol Peters

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kando, N. (2001). NTCIR Workshop : Japanese- and Chinese-English Cross-Lingual Information Retrieval and Multi-grade Relevance Judgments. In: Peters, C. (eds) Cross-Language Information Retrieval and Evaluation. CLEF 2000. Lecture Notes in Computer Science, vol 2069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44645-1_3

Download citation

  • DOI: https://doi.org/10.1007/3-540-44645-1_3

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42446-8

  • Online ISBN: 978-3-540-44645-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation