Skip to main content

Parallel Computing for Term Selection in Routing/Filtering

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2633))

Abstract

It has been postulated that a method of selecting terms in either routing or filtering using relevance feedback would be to evaluate every possible combination of terms in a training set and determine which combination yields the best retrieval results. Whilst this is not a realistic proposition because of the enormous size of the search space, some heuristics have been developed on the Okapi system to tackle the problem which are computationally intensive. This paper describes parallel computing techniques that have been applied to these heuristics to reduce the time it takes to select to select terms.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S.E. Robertson, S. Walker, S. Jones, M.M. Hancock-Beaulieu and M. Gatford, Okapi at TREC-3. In: D.K. Harman, (ed.): Proceedings of the Third Text Retrieval Conference, NIST Gaithersburg (1995) 109–126

    Google Scholar 

  2. S.E. Robertson, S. Walker, S. Jones, M.M. Beaulieu M. Gatford and A. Payne, Okapi at TREC-4. In: D.K. Harman, (ed.): Proceedings of the Fourth Text Retrieval Conference, NIST Gaithersburg (1996) 73–96

    Google Scholar 

  3. M.M. Beaulieu, M. Gatford, X. Huang, S.E. Robertson, S. Walker and P. Williams, Okapi at TREC-5. In: Voorhees E.M and D.K. Harman, (eds.): Proceedings of the Fifth Text Retrieval Conference, NIST Gaithersburg (1997) 143–166.

    Google Scholar 

  4. S. Walker, S.E. Robertson and M Boughanem, OKAPI at TREC-6. In: Voorhees E.M and D.K. Harman, (eds.): Proceedings of the Sixth Text Retrieval Conference, NIST Gaithersburg (1998) 125–136

    Google Scholar 

  5. Tuson, Optimisation with Hillclimbing on Steriods: An Overview of Neightbourhood Search Techniques. Proceedings of the 10th Young Operational research Conference, Operational Research Society (1998) 141–156

    Google Scholar 

  6. F. Glover and M. Laguna, Tabu Search, Kluwer Academic Publishers, 1997

    Google Scholar 

  7. D. Harman, Overview of the Fourth Text REtrieval Conference (TREC-4). In: D.K. Harman, (ed.): Proceedings of the Fourth Text Retrieval Conference, NIST Gaithersburg (1996) 1–24

    Google Scholar 

  8. D. Hawking, “The Design and Implementation of a Parallel Document Retrieval Engine”, Technical Report TR-CS-95-08, Department of Computer Science, Australian National University (1995)

    Google Scholar 

  9. Hutchinson, Algorithm Learning, Clarendon Press (1994)

    Google Scholar 

  10. J. Kittler, Feature selection and extraction. In: T.Y. Young and K. Fu, (ed.): Handbook of Pattern Recognition and Image Processing, Academic Press (1986) 59–83

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

MacFarlane, A., Robertson, S.E., McCann, J.A. (2003). Parallel Computing for Term Selection in Routing/Filtering. In: Sebastiani, F. (eds) Advances in Information Retrieval. ECIR 2003. Lecture Notes in Computer Science, vol 2633. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36618-0_40

Download citation

  • DOI: https://doi.org/10.1007/3-540-36618-0_40

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-01274-0

  • Online ISBN: 978-3-540-36618-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics