An Algebraic Implicitization and Specialization of Minimum KL-Divergence Models
- Cite this paper as:
- Dukkipati A., Manathara J.G. (2010) An Algebraic Implicitization and Specialization of Minimum KL-Divergence Models. In: Gerdt V.P., Koepf W., Mayr E.W., Vorozhtsov E.V. (eds) Computer Algebra in Scientific Computing. CASC 2010. Lecture Notes in Computer Science, vol 6244. Springer, Berlin, Heidelberg
In this paper we study representation of KL-divergence minimization, in the cases where integer sufficient statistics exists, using tools from polynomial algebra. We show that the estimation of parametric statistical models in this case can be transformed to solving a system of polynomial equations. In particular, we also study the case of Kullback-Csisźar iteration scheme. We present implicit descriptions of these models and show that implicitization preserves specialization of prior distribution. This result leads us to a Gröbner bases method to compute an implicit representation of minimum KL-divergence models.
KeywordsGröbner Bases statistical models elimination
Unable to display preview. Download preview PDF.