Gaussian Mixture Modeling with Gaussian Process Latent Variable Models
Density modeling is notoriously difficult for high dimensional data. One approach to the problem is to search for a lower dimensional manifold which captures the main characteristics of the data. Recently, the Gaussian Process Latent Variable Model (GPLVM) has successfully been used to find low dimensional manifolds in a variety of complex data. The GPLVM consists of a set of points in a low dimensional latent space, and a stochastic map to the observed space. We show how it can be interpreted as a density model in the observed space. However, the GPLVM is not trained as a density model and therefore yields bad density estimates. We propose a new training strategy and obtain improved generalisation performance and better density estimates in comparative evaluations on several benchmark data sets.
Unable to display preview. Download preview PDF.
- 2.Ghahramani, Z., Beal, M.J.: Variational inference for Bayesian mixtures of factor analysers. In: NIPS, vol. 12 (2000)Google Scholar
- 6.Vincent, P., Bengio, Y.: Manifold parzen windows. In: NIPS, vol. 15 (2003)Google Scholar
- 8.Roweis, S., Saul, L.K., Hinton, G.E.: Global coordination of local linear models. In: NIPS, vol. 14 (2002)Google Scholar
- 11.Rasmussen, C.E.: The infinite Gaussian mixture model. In: NIPS, vol. 12 (2000)Google Scholar
- 12.Quiñonero-Candela, J., Girard, A., Rasmussen, C.E.: Prediction at an uncertain input for GPs and RVMs. Technical Report IMM-2003-18, TU Denmark (2003)Google Scholar