Probability smoothing is a language modeling technique that assigns some nonzero probability to events that were unseen in the training data. This has the effect that the probability mass is divided over more events; hence the probability distribution becomes more smooth.
- 1.Chen SF, Goodman J An empirical study of smoothing techniques for language modeling. Technical report TR-10-98, Center for Research in Computing Technology, Harvard University, August 1998.Google Scholar
- 2.Zaragoza H, Hiemstra D, Tipping M, Robertson S Bayesian extension to the language model for ad hoc information retrieval. In: Proceedings of 26th annual international ACM SIGIR conference on research and development in information retrieval; 2003. p. 4–9.Google Scholar