Gaussian Process Regression for Structured Data Sets

  • Mikhail Belyaev
  • Evgeny Burnaev
  • Yermek KapushevEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9047)


Approximation algorithms are widely used in many engineering problems. To obtain a data set for approximation a factorial design of experiments is often used. In such case the size of the data set can be very large. Therefore, one of the most popular algorithms for approximation — Gaussian Process regression — can hardly be applied due to its computational complexity. In this paper a new approach for a Gaussian Process regression in case of a factorial design of experiments is proposed. It allows to efficiently compute exact inference and handle large multidimensional and anisotropic data sets.


Gaussian process Structured data Regularization 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abdel-Gawad, A.H., Minka, T.P., et al.: Sparse-posterior gaussian processes for general likelihoods. arXiv preprint arXiv:1203.3507 (2012)
  2. 2.
    Armand, S.C.: Structural Optimization Methodology for Rotating Disks of Aircraft Engines. NASA technical memorandum, National Aeronautics and Space Administration, Office of Management, Scientific and Technical Information Program (1995)Google Scholar
  3. 3.
    Chan, G., Wood, A.T.: Algorithm as 312: An algorithm for simulating stationary gaussian random fields. Journal of the Royal Statistical Society: Series C (Applied Statistics) 46(1), 171–181 (1997)CrossRefzbMATHGoogle Scholar
  4. 4.
    Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Mathematical Programming 91(2), 201–213 (2002)CrossRefzbMATHMathSciNetGoogle Scholar
  5. 5.
    Evoluationary computation pages – the function testbed: Laappeenranta University of Technology.
  6. 6.
    Forrester, A.I.J., Sobester, A., Keane, A.J.: Engineering Design via Surrogate Modelling - A Practical Guide. J. Wiley (2008)Google Scholar
  7. 7.
    Friedman, J.H.: Multivariate adaptive regression splines. The Annals of Statistics, 1–67 (1991)Google Scholar
  8. 8.
    Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Review 51(3), 455–500 (2009)CrossRefzbMATHMathSciNetGoogle Scholar
  9. 9.
    Lázaro-Gredilla, M., Quiñonero-Candela, J., Rasmussen, C.E., Figueiras-Vidal, A.R.: Sparse spectrum gaussian process regression. The Journal of Machine Learning Research 11, 1865–1881 (2010)zbMATHGoogle Scholar
  10. 10.
    Montgomery, D.C.: Design and Analysis of Experiments. John Wiley & Sons (2006)Google Scholar
  11. 11.
    Neal, R.M.: Monte carlo implementation of gaussian process models for bayesian regression and classification. arXiv preprint physics/9701026 (1997)
  12. 12.
    Quiñonero-Candela, J., Rasmussen, C.E.: A unifying view of sparse approximate gaussian process regression. The Journal of Machine Learning Research 6, 1939–1959 (2005)zbMATHGoogle Scholar
  13. 13.
    Rasmussen, C.E., Williams, C.: Gaussian Processes for Machine Learning. MIT Press (2006)Google Scholar
  14. 14.
    Rasmussen, C.E., Ghahramani, Z.: Infinite mixtures of gaussian process experts. In: Advances in Neural Information Processing Systems 14, pp. 881–888. MIT Press (2001)Google Scholar
  15. 15.
    Rendall, T., Allen, C.: Multi-dimensional aircraft surface pressure interpolation using radial basis functions. Proc. IMechE Part G: Aerospace Engineering 222, 483–495 (2008)Google Scholar
  16. 16.
    Snelson, E., Ghahramani, Z.: Sparse gaussian processes using pseudo-inputs. In: Advances in Neural Information Processing Systems 18, pp. 1257–1264 (2005)Google Scholar
  17. 17.
    Stone, C.J., Hansen, M., Kooperberg, C., Truong, Y.K.: Polynomial splines and their tensor products in extended linear modeling. Ann. Statist. 25, 1371–1470 (1997)CrossRefzbMATHMathSciNetGoogle Scholar
  18. 18.
    Swiss International Institute of Technology.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Mikhail Belyaev
    • 1
    • 2
    • 3
  • Evgeny Burnaev
    • 1
    • 2
    • 3
  • Yermek Kapushev
    • 1
    • 2
    Email author
  1. 1.Institute for Information Transmission ProblemsMoscowRussia
  2. 2.DATADVANCE, llcMoscowRussia
  3. 3.PreMoLabMIPTDolgoprudnyRussia

Personalised recommendations