Abstract
Latent force models (LFM) are an hybrid approach which combines multiple output Gaussian processes and differential equations, where the covariance functions encode the physical models given by the differential equations. LFM require the specification of the number of latent functions used to build the covariance function for the outputs. Furthermore, they assume that the output data is explained by using the entire set of latent functions, which is not the case in many real applications. We propose in this paper the use of an Indian Buffet process (IBP) as a way to perform model selection over the number of latent Gaussian processes in LFM applications. Furthermore, IBP allows us to infer the interconnection between latent functions and the outputs. We use variational inference to approximate the posterior distributions, and show examples of the proposed model performance over artificial data and a motion capture dataset.
Chapter PDF
Similar content being viewed by others
References
Álvarez, M.A., Luengo, D., Lawrence, N.D.: Latent force models. In: van Dyk, D., Welling, M. (eds.) Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics. JMLR W&CP 5, Clearwater Beach, Florida, pp. 9–16, April 16–18, 2009
Álvarez, M.A., Luengo, D., Lawrence, N.D.: Linear latent force models using gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(11), 2693–2705 (2013)
Álvarez, M.A., Luengo, D., Titsias, M.K., Lawrence, N.D.: Variational inducing kernels for sparse convolved multiple output gaussian processes. University of Manchester, Tech. rep. (2009)
Álvarez, M.A., Luengo, D., Titsias, M.K., Lawrence, N.D.: Efficient multioutput Gaussian processes through variational inducing kernels. In: Teh, Y.W., Titterington, M. (eds.) Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. JMLR W&CP 9, Chia Laguna, Sardinia, Italy, pp. 25–32, May 13–15, 2010
Álvarez, M.A., Rosasco, L., Lawrence, N.D.: Kernels for vector-valued functions: a review. Foundations and Trends in Machine Learning 4(3), 195–266 (2012)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer (2006)
Chai, K.M., Williams, C., Klanke, S., Vijayakumar, S.: Multi-task Gaussian Process Learning of Robot Inverse Dynamics. In: NIPS 2008 (2009). http://eprints.pascal-network.org/archive/00004640/
Doshi-Velez, F., Miller, K., Van Gael, J., Teh, Y.W.: Variational inference for the indian buffet process. In: AISTATS (2009), pp. 137–144 (2009)
Griffiths, T.L., Ghahramani, Z.: Infinite latent feature models and the indian buffet process. In: NIPS, pp. 475–482. MIT Press (2005)
Griffiths, T.L., Ghahramani, Z.: The indian buffet process: an introduction and review. Journal of Machine Learning Research 12, 1185–1224 (2011)
Guo, S., Zoeter, O., Archambeau, C.: Sparse bayesian multi-task learning. In: Shawe-Taylor, J., Zemel, R., Bartlett, P., Pereira, F., Weinberger, K. (eds.) Advances in Neural Information Processing Systems 24, pp. 1755–1763. Curran Associates, Inc. (2011). http://papers.nips.cc/paper/4242-sparse-bayesian-multi-task-learning.pdf
Knowles, D.A., Ghahramani, Z.: Nonparametric Bayesian sparse factor models with application to gene expression modelling. Annals of Applied Statistics 5(2B), 1534–1552 (2011)
Olsen, C., Fleming, K., Prendergast, N., Rubio, R., Emmert-Streib, F., Bontempi, G., Haibe-Kains, B., Quackenbush, J.: Inference and validation of predictive gene networks from biomedical literature and gene expression data. Genomics 103(5–6), 329–336 (2014)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)
Titsias, M.K., Lázaro-Gredilla, M.: Spike and slab variational inference for multi-task and multiple kernel learning. In: NIPS 2011, pp. 2339–2347 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Guarnizo, C., Álvarez, M.A., Orozco, A.A. (2015). Indian Buffet Process for Model Selection in Latent Force Models. In: Pardo, A., Kittler, J. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2015. Lecture Notes in Computer Science(), vol 9423. Springer, Cham. https://doi.org/10.1007/978-3-319-25751-8_76
Download citation
DOI: https://doi.org/10.1007/978-3-319-25751-8_76
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25750-1
Online ISBN: 978-3-319-25751-8
eBook Packages: Computer ScienceComputer Science (R0)