On Dealing with Uncertainties from Kriging Models in Offline Data-Driven Evolutionary Multiobjective Optimization

  • Atanu MazumdarEmail author
  • Tinkle Chugh
  • Kaisa Miettinen
  • Manuel López-Ibáñez
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11411)


Many works on surrogate-assisted evolutionary multiobjective optimization have been devoted to problems where function evaluations are time-consuming (e.g., based on simulations). In many real-life optimization problems, mathematical or simulation models are not always available and, instead, we only have data from experiments, measurements or sensors. In such cases, optimization is to be performed on surrogate models built on the data available. The main challenge there is to fit an accurate surrogate model and to obtain meaningful solutions. We apply Kriging as a surrogate model and utilize corresponding uncertainty information in different ways during the optimization process. We discuss experimental results obtained on benchmark multiobjective optimization problems with different sampling techniques and numbers of objectives. The results show the effect of different ways of utilizing uncertainty information on the quality of solutions.


Machine learning Gaussian process Pareto optimality Metamodelling Surrogate 



This research is related to the thematic research area Decision Analytics utilizing Causal Models and Multiobjective Optimization (DEMO) at the University of Jyvaskyla. This work was partially supported by the Natural Environment Research Council [NE/P017436/1].


  1. 1.
    Bezerra, L.C.T., López-Ibáñez, M., Stützle, T.: A large-scale experimental evaluation of high-performing multi- and many-objective evolutionary algorithms. Evol. Comput. 26, 621–656 (2018)CrossRefGoogle Scholar
  2. 2.
    Blackwell, T., Branke, J.: Multiswarms, exclusion, and anti-convergence in dynamic environments. IEEE Trans. Evol. Comput. 10(4), 459–472 (2006)CrossRefGoogle Scholar
  3. 3.
    Castano, S., Antonellis, V.D.: Global viewing of heterogeneous data sources. IEEE Trans. Knowl. Data Eng. 13(2), 277–297 (2001)CrossRefGoogle Scholar
  4. 4.
    Chugh, T., Chakraborti, N., Sindhya, K., Jin, Y.: A data-driven surrogate-assisted evolutionary algorithm applied to a many-objective blast furnace optimization problem. Mater. Manuf. Process. 32(10), 1172–1178 (2017)CrossRefGoogle Scholar
  5. 5.
    Chugh, T., Jin, Y., Miettinen, K., Hakanen, J., Sindhya, K.: A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Trans. Evol. Comput. 22(1), 129–142 (2018)CrossRefGoogle Scholar
  6. 6.
    Chugh, T., Sindhya, K., Hakanen, J., Miettinen, K.: A survey on handling computationally expensive multiobjective optimization problems with evolutionary algorithms. Soft Comput. (to appear).
  7. 7.
    Coello, C., Lamont, G., Veldhuizen, D.: Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd edn. Springer, New York (2007). Scholar
  8. 8.
    Forrester, A., Sobester, A., Keane, A.: Engineering Design via Surrogate Modelling. Wiley, Hoboken (2008)CrossRefGoogle Scholar
  9. 9.
    Jeong, S., Obayashi, S.: Efficient global optimization (EGO) for multi-objective problem and data mining. In: 2005 IEEE Congress on Evolutionary Computation, vol. 3, pp. 2138–2145 (2005)Google Scholar
  10. 10.
    Jin, Y.: Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol. Comput. 1, 61–70 (2011)CrossRefGoogle Scholar
  11. 11.
    Jin, Y., Wang, H., Chugh, T., Guo, D., Miettinen, K.: Data-driven evolutionary optimization: an overview and case studies. IEEE Trans. Evol. Comput. (to appear).
  12. 12.
    Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4), 455–492 (1998)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Knowles, J.: ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evol. Comput. 10(1), 50–66 (2006)CrossRefGoogle Scholar
  14. 14.
    Li, K., Omidvar, M.N., Deb, K., Yao, X.: Variable interaction in multi-objective optimization problems. In: Handl, J., Hart, E., Lewis, P.R., López-Ibáñez, M., Ochoa, G., Paechter, B. (eds.) PPSN 2016. LNCS, vol. 9921, pp. 399–409. Springer, Cham (2016). Scholar
  15. 15.
    Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  16. 16.
    Pilat, M., Neruda, R.: Aggregate meta-models for evolutionary multiobjective and many-objective optimization. Neurocomputing 116, 392–402 (2013)CrossRefGoogle Scholar
  17. 17.
    Rasmussen, C., Williams, C.: Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press, Cambridge (2005)CrossRefGoogle Scholar
  18. 18.
    Regis, R.G.: Evolutionary programming for high-dimensional constrained expensive black-box optimization using radial basis functions. IEEE Trans. Evol. Comput. 18(3), 326–347 (2014)CrossRefGoogle Scholar
  19. 19.
    Sun, X., Gong, D., Jin, Y., Chen, S.: A new surrogate-assisted interactive genetic algorithm with weighted semisupervised learning. IEEE Trans. Cybern. 43(2), 685–698 (2013)CrossRefGoogle Scholar
  20. 20.
    Wang, H., Jin, Y., Jansen, J.O.: Data-driven surrogate-assisted multiobjective evolutionary optimization of a trauma system. IEEE Trans. Evol. Comput. 20(6), 939–952 (2016)CrossRefGoogle Scholar
  21. 21.
    Wang, H., Jin, Y., Sun, C., Doherty, J.: Offline data-driven evolutionary optimization using selective surrogate ensembles. IEEE Trans. Evol. Comput. (to appear).
  22. 22.
    Wang, H., Zhang, Q., Jiao, L., Yao, X.: Regularity model for noisy multiobjective optimization. IEEE Trans. Cybern. 46(9), 1997–2009 (2016)CrossRefGoogle Scholar
  23. 23.
    Wang, S., Minku, L.L., Yao, X.: Resampling-based ensemble methods for online class imbalance learning. IEEE Trans. Knowl. Data Eng. 27(5), 1356–1368 (2015)CrossRefGoogle Scholar
  24. 24.
    Zhang, Q., Liu, W., Tsang, E., Virginas, B.: Expensive multiobjective optimization by MOEA/D with Gaussian process model. IEEE Trans. Evol. Comput. 14(3), 456–474 (2010)CrossRefGoogle Scholar
  25. 25.
    Zitzler, E., Künzli, S.: Indicator-based selection in multiobjective search. In: Yao, X., et al. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 832–842. Springer, Heidelberg (2004). Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Atanu Mazumdar
    • 1
    Email author
  • Tinkle Chugh
    • 2
  • Kaisa Miettinen
    • 1
  • Manuel López-Ibáñez
    • 3
  1. 1.University of Jyvaskyla, Faculty of Information TechnologyUniversity of JyvaskylaFinland
  2. 2.Department of Computer ScienceUniversity of ExeterExeterUK
  3. 3.Alliance Manchester Business SchoolUniversity of ManchesterManchesterUK

Personalised recommendations