Overview of the CLEF-2006 Cross-Language Speech Retrieval Track

  • Douglas W. Oard
  • Jianqiang Wang
  • Gareth J. F. Jones
  • Ryen W. White
  • Pavel Pecina
  • Dagobert Soergel
  • Xiaoli Huang
  • Izhak Shafran
Conference paper

DOI: 10.1007/978-3-540-74999-8_94

Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)
Cite this paper as:
Oard D.W. et al. (2007) Overview of the CLEF-2006 Cross-Language Speech Retrieval Track. In: Peters C. et al. (eds) Evaluation of Multilingual and Multi-modal Information Retrieval. CLEF 2006. Lecture Notes in Computer Science, vol 4730. Springer, Berlin, Heidelberg

Abstract

The CLEF-2006 Cross-Language Speech Retrieval (CL-SR) track included two tasks: to identify topically coherent segments of English interviews in a known-boundary condition, and to identify time stamps marking the beginning of topically relevant passages in Czech interviews in an unknown-boundary condition. Five teams participated in the English evaluation, performing both monolingual and cross-language searches of speech recognition transcripts, automatically generated metadata, and manually generated metadata. Results indicate that the 2006 English evaluation topics are more challenging than those used in 2005, but that cross-language searching continued to pose no unusual challenges when compared with monolingual searches of the same collection. Three teams participated in the monolingual Czech evaluation using a new evaluation measure based on differences between system-suggested and ground truth replay start times, with results that were broadly comparable to those observed for English.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Douglas W. Oard
    • 1
  • Jianqiang Wang
    • 2
  • Gareth J. F. Jones
    • 3
  • Ryen W. White
    • 4
  • Pavel Pecina
    • 5
  • Dagobert Soergel
    • 6
  • Xiaoli Huang
    • 6
  • Izhak Shafran
    • 7
  1. 1.College of Information Studies and, Institute for Advanced Computer Studies, University of Maryland, College Park, MD 20742USA
  2. 2.Department of Library and Information Studies, State University of New York at Buffalo, Buffalo, NY 14260USA
  3. 3.School of Computing, Dublin City University, Dublin 9Ireland
  4. 4.Microsoft Research, One Microsoft Way, Redmond, WA 98052USA
  5. 5.MFF UK, Malostranske namesti 25, Room 422, Charles University, 118 00 Praha 1Czech Republic
  6. 6.College of Information Studies, University of Maryland, College Park, MD 20742USA
  7. 7.OGI School of Science & Engineering, Oregon Health and Sciences University, 20000 NW Walker Rd, Portland, OR 97006USA

Personalised recommendations