Probability smoothing is a language modeling technique that assigns some nonzero probability to events that were unseen in the training data. This has the effect that the probability mass is divided over more events; hence, the probability distribution becomes more smooth.
- 1.Chen SF, Goodman J. An empirical study of smoothing techniques for language modeling. Technical report TR-10-98, Center for Research in Computing Technology, Harvard University, August 1998.Google Scholar
- 2.Zaragoza H, Hiemstra D, Tipping M, Robertson S. Bayesian extension to the language model for ad hoc information retrieval. In: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; 2003. p. 4–9.Google Scholar