Abstract
Gaussian processes using nonstationary covariance functions are a powerful tool for Bayesian regression with input-dependent smoothness. A common approach is to model the local smoothness by a latent process that is integrated over using Markov chain Monte Carlo approaches. In this paper, we demonstrate that an approximation that uses the estimated mean of the local smoothness yields good results and allows one to employ efficient gradient-based optimization techniques for jointly learning the parameters of the latent and the observed processes. Extensive experiments on both synthetic and real-world data, including challenging problems in robotics, show the relevance and feasibility of our approach.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Brooks, A., Makarenko, A., Upcroft, B.: Gaussian process models for sensor-centric robot localisation. In: Proc. of ICRA (2006)
Brooks, M.: The matrix reference manual, http://www.ee.ic.ac.uk/hp/staff/dmb/matrix/intro.html
Cornford, D., Nabney, I., Williams, C.: Adding constrained discontinuities to gaussian process models of wind fields. In: Advances in Neural Information Processing Systems 11 (NIPS), Cambridge, MA (1999)
Dimatteo, I., Genovese, C.R., Kass, R.E.: Bayesian curve-fitting with free-knot splines. Biometrika 88(4), 1055–1071 (2001)
Kersting, K., Plagemann, C., Pfaff, P., Burgard, W.: Most likely heteroscedastic gaussian processes regression. In: Gharahmani, Z. (ed.) ICML 2007 (2007)
Lang, T., Plagemann, C., Burgard, W.: Adaptive non-stationay kernel regression for terrain modelling. In: Proc. of Robotics: Science and Systems (RSS) (2007)
Møller, M.: A Scaled Conjugate Gradient Algoritm for Fast Supervised Learning. Neural Networks 6, 525–533 (1993)
Paciorek, C., Schervish, M.: Nonstationary covariance functions for Gaussian process regression. In: Thrun, S., Saul, L., Schoelkopf, B. (eds.) Advances in Neural Information Processing Systems 16. MIT Press, Cambridge (2004)
Pfingsten, T., Kuss, M., Rasmussen, C.E.: Nonstationary gaussian process regression using a latent extension of the input space. In: Proc. of ISBA Eighth World Meeting on Bayesian Statistics, Valencia, Spain (Extended Abstract, 2006)
Plagemann, C., Fox, D., Burgard, W.: Efficient failure detection on mobile robots using particle filters with gaussian process proposals. In: Proc. of the International Joint Conference on Artificial Intelligence (IJCAI), Hyderabad, India (2007)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. MIT Press, Cambridge (2006)
Sampson, P.D., Guttorp, P.: Nonparametric estimation of nonstationary spatial covariance structure. Journal of the American Stat. Association 87, 108–119 (1992)
Schmidt, A.M., OHagan, A.: Bayesian inference for nonstationary spatial covariance structure via spatial deformations. JRSS, series B 65, 745–758 (2003)
Schwaighofer, A., Grigoras, M., Tresp, V., Hoffmann, C.: A Gaussian process positioning system for cellular networks. In: Advances in Neural Information Processing Systems 16. MIT Press, Cambridge (2004)
Snelson, E., Ghahramani, Z.: Variable noise and dimensionality reduction for sparse gaussian processes. In: UAI (2006)
Williams, O.: A switched Gaussian process for estimating disparity and segmentation in binocular stereo. In: Neural Info. Proc. Systems (NIPS) (2006)
Yu, K., Tresp, V., Schwaighofer, A.: Learning gaussian processes from multiple tasks. In: ICML 2007 (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Plagemann, C., Kersting, K., Burgard, W. (2008). Nonstationary Gaussian Process Regression Using Point Estimates of Local Smoothness. In: Daelemans, W., Goethals, B., Morik, K. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2008. Lecture Notes in Computer Science(), vol 5212. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87481-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-87481-2_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87480-5
Online ISBN: 978-3-540-87481-2
eBook Packages: Computer ScienceComputer Science (R0)