Abstract
Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for multi-view learning. Unlike the existing methods, it combines multiple views by regularizing marginal likelihood with the consistency among the posterior distributions of latent functions from different views. Moreover, we give a general point selection scheme for multi-view learning and improve the proposed model by this criterion. Experimental results on multiple real world data sets have verified the effectiveness of the proposed model and witnessed the performance improvement through employing this novel point selection scheme.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Data sets are available at http://archive.ics.uci.edu/ml/.
References
Ashish, K., Grauman, K., Urtasun, R., Darrell, T.: Gaussian processes for object categorization. Int. J. Comput. Vis. 88, 169–188 (2010)
Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
Bonilla, E.V., Chai, K.M.A., Williams, C.K.I.: Multi-task Gaussian process prediction. In: Proceedings of the 21th Annual Conference on Neural Information Processing Systems, pp. 153–160 (2007)
Damianou, A.C., Titsias, M.K., Lawrence, N.D.: Variational Gaussian process dynamical systems. In: Proceedings of the 25th Annual Conference on Neural Information Processing Systems, pp. 2510–2518 (2011)
Engel, Y., Mannor, S., Meir, R.: Reinforcement learning with Gaussian processes. In: Proceedings of the 22th International Conference on Machine Learning, pp. 201–208 (2005)
Farquhar, J.D.R., Hardoon, D.R., Meng, H., Shawe-Taylor, J., Szedmák, S.: Two view learning: SVM-2K, theory and practice. In: Proceedings of the 19th Annual Conference on Neural Information Processing Systems, pp. 355–362 (2005)
Joyce, J.M.: Kullback-Leibler Divergence. Springer, New York (2011)
Krause, A., Guestrin, C.: Nonmyopic active learning of Gaussian processes: an exploration-exploitation approach. In: Proceedings of the 24th International Conference on Machine Learning, pp. 449–456 (2007)
Lawrence, N.D., Jordan, M.I.: Semi-supervised learning via Gaussian processes. In: Proceedings of the 18th Annual Conference on Neural Information Processing Systems, pp. 753–760 (2004)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)
Rasmussen, C.E., Kuss, M.: Gaussian processes in reinforcement learning. In: Proceedings of the 17th Annual Conference on Neural Information Processing Systems, pp. 751–758(2003)
Rasmussen, C.E., Nickisch, H.: Gaussian processes for machine learning (GPML) toolbox. J. Mach. Learn. Res. 11, 3011–3015 (2010)
Shon, A.P., Grochow, K., Hertzmann, A., Rao, R.P.N.: Learning shared latent structure for image synthesis and robotic imitation. In: Proceedings of the 19th Annual Conference on Neural Information Processing Systems, pp. 1233–1240 (2005)
Sindhwani, V., Chu, W., Keerthi, S.S.: Semi-supervised Gaussian process classifiers. In: Proceedings of the 20th International Joint Conference on Artificial Intelligence, pp. 1059–1064 (2007)
Sun, S.: A survey of multi-view machine learning. Neural Comput. Appl. 23, 2031–2038 (2013)
Sun, S., Jin, F.: Robust co-training. Int. J. Pattern Recognit Artif Intell. 25, 1113–1126 (2011)
Xu, C., Tao, D., Li, Y., Xu, C.: Large-margin multi-view Gaussian process for image classification. In: Proceedings of the 5th International Conference on Internet Multimedia Computing and Service, pp. 7–12. ACM (2013)
Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. arXiv preprint arXiv:1304.5634 (2013)
Yu, K., Tresp, V., Schwaighofer, A.: Learning Gaussian processes from multiple tasks. In: Proceedings of the 22th International Conference on Machine Learning, pp. 1012–1019 (2005)
Yu, S., Krishnapuram, B., Rosales, R., Rao, R.B.: Bayesian co-training. J. Mach. Learn. Res. 12, 2649–2680 (2011)
Zhao, J., Sun, S.: Variational dependent multi-output Gaussian process dynamical systems. J. Mach. Learn. Res. 17, 1–36 (2016)
Zhao, J., Sun, S.: Gaussian process versus margin sampling active learning. Neurocomputing 167, 122–131 (2016)
Zhu, X., Ghahramani, Z., Lafferty, J.D.: Semi-supervised learning using Gaussian fields and harmonic functions. In: Proceedings of the 20th International Conference on Machine Learning, pp. 912–919 (2003)
Acknowledgments
The corresponding author Shiliang Sun would like to thank supports from the National Natural Science Foundation of China under Projects 61673179 and 61370175.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Liu, Q., Sun, S. (2017). Multi-view Regularized Gaussian Processes. In: Kim, J., Shim, K., Cao, L., Lee, JG., Lin, X., Moon, YS. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2017. Lecture Notes in Computer Science(), vol 10235. Springer, Cham. https://doi.org/10.1007/978-3-319-57529-2_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-57529-2_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-57528-5
Online ISBN: 978-3-319-57529-2
eBook Packages: Computer ScienceComputer Science (R0)