An Efficient Computation of the Multiple-Bernoulli Language Model

  • Leif Azzopardi
  • David E. Losada
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3936)


The Multiple Bernoulli (MB) Language Model has been generally considered too computationally expensive for practical purposes and superseded by the more efficient multinomial approach. While, the model has many attractive properties, little is actually known about the retrieval effectiveness of the MB model due to its high cost of execution. In this paper, we show how an efficient implementation of this model can be achieved. The resulting method is comparable in terms of efficiency to other standard term matching algorithms (such as the vector space model, BM25 and the multinomial Language Model).


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Losada, D.E.: Language modeling for sentence retrieval: a comparison between multiple-bernoulli models and multinomial models. In: Information Retrieval and Theory Workshop, Glasgow, UK (2005)Google Scholar
  2. 2.
    Metlzer, D., Lavrenko, V., Croft, W.B.: Formal multiple-bernoulli models for language modeling. In: Proc. 27th ACM Conference on Research and Development in Information Retrieval, SIGIR 2004, Sheffield, UK, pp. 540–541. ACM press, New York (2004)Google Scholar
  3. 3.
    Ponte, J., Craft, W.B.: A language modeling approach to information retrieval. In: Proc. 21st ACM Conference on Research and Development in Information Retrieval, SIGIR 1998, Melbourne, Australia, pp. 275–281 (1998)Google Scholar
  4. 4.
    Zhai, C., Lafferty, J.: A study of smoothing methods for language models applied to information retrieval. ACM Transactions on Information Systems 22(2), 179–214 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Leif Azzopardi
    • 1
  • David E. Losada
    • 2
  1. 1.Dept. of Computer and Information SciencesUniversity of StrathclydeScotland
  2. 2.Grupo de Sistemas Inteligentes, Departamento de Electrónica y ComputaciónUniversidad de Santiago de CompostelaSpain

Personalised recommendations