Skip to main content
Log in

Combining metaheuristics with mathematical programming, constraint programming and machine learning

  • Invited Survey
  • Published:
4OR Aims and scope Submit manuscript

Abstract

During the last years, interest on hybrid metaheuristics has risen considerably in the field of optimization and machine learning. The best results found for many optimization problems in science and industry are obtained by hybrid optimization algorithms. Combinations of optimization tools such as metaheuristics, mathematical programming, constraint programming and machine learning, have provided very efficient optimization algorithms. Four different types of combinations are considered in this paper: (i) Combining metaheuristics with complementary metaheuristics. (ii) Combining metaheuristics with exact methods from mathematical programming approaches which are mostly used in the operations research community. (iii) Combining metaheuristics with constraint programming approaches developed in the artificial intelligence community. (iv) Combining metaheuristics with machine learning and data mining techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33
Fig. 34
Fig. 35
Fig. 36
Fig. 37

Similar content being viewed by others

Notes

  1. This class of hybrid metaheuristics includes memetic algorithms.

  2. Also known as evolutionary local search algorithms.

  3. The name is an allusion to Jean Batiste de Lamarck’s contention that phenotype characteristics acquired during lifetime can become heritable traits.

  4. HTH hybrids is referred as multiple interacting walksVerhoeven and Aarts (1995) multi-agent algorithms (Boese 1996), and cooperative search algorithms (Clearwater et al. 1991, 1992; Hogg and Williams 1993; Huberman 1990; Toulouse et al. 1996).

  5. Also known as migration model, diffusion model, and coarse grain model.

  6. The concept of adaptive memory has been proposed in the domain of combinatorial optimization (Taillard et al. 2001). It is similar to the concept of blackboard in the field of Artificial Intelligence (Engelmore 1988).

  7. This procedure is also called meta-evolution.

  8. We consider here a minimization problem.

  9. The term complete is always used in the CP community.

  10. However, the duals cannot be considered.

  11. This scheme is called fitness imitation or fitness inheritance.

  12. Using this design approach, it is worthwhile to speak about hybrid metaheuristics as any metaheuristic will be a hybrid one!.

References

  • Abbattista F, Abbattista N, Caponetti L (1995) An evolutionary and cooperative agent model for optimization. In: IEEE international conference on evolutionary computation ICEC’95, Perth, Australia, pp 668–671

  • Abramson D, Logothetis P, Postula A, Randall M (1997) Application specific computers for combinatorial optimisation. In: Australien computer architecture workshop, Sydney, Australia

  • Abramson DA (1992) A very high speed architecture to support simulated annealing. IEEE Comput 25:27–34

    Article  Google Scholar 

  • Aggarwal CC, Orlin JB, Tai RP (1997) An optimized crossover for the maximum independent set. Oper Res 45:226–234

    Article  Google Scholar 

  • Aiex RM, Binato S, Ramakrishna RS (2003) Parallel GRASP with path relinking for job shop scheduling. Parallel Comput 29:393–430

    Article  Google Scholar 

  • Applegate D, Cook W (1991) A computational study of the job-shop scheduling problem. ORSA J Comput 3:149–156

    Article  Google Scholar 

  • Apt K (2003) Principles of constraint programming. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Augerat P, Belenguer JM, Benavent E, Corberan A, Naddef D (1998) Separating capacity constraints in the CVRP using tabu search. Eur J Oper Res 106(2):546–557

    Article  Google Scholar 

  • Balas E, Niehaus W (1998) Optimized crossover-based genetic algorithms for the maximum cardinality and maximum weight clique problems. J Heuristics 4(2):107–122

    Article  Google Scholar 

  • Barnhart C, Johnson EL, Nemhauser GL, Savelsbergh MWP, Vance PH (1998) Branch-and-price: column generation for huge integer programs. Oper Res 46:316–329

    Google Scholar 

  • Beasley JE (1990) OR-library: distributing test problems by electronic mail. J Oper Res Soc 41(11):1069–1072

    Google Scholar 

  • Belding T (1995) The distributed genetic algorithm revisted. In: Eshelmann D (ed) Sixth international conference on genetic algorithms. Morgan Kaufmann, San Mateo, CA

  • Belew RK, McInerny J, Schraudolph NN (1991) Evolving networks: using genetic algorithms with connectionist learning. In: Langton CG, Taylor C, Doyne Farmer JD, Rasmussen S (eds) Second confernce on artificial life. Addison-Wesley, USA, pp 511–548

  • Bellman R (1957) Dynamic programming. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Benders JF (1962) Partitioning procedures for solving mixed-variables programming problems. Numer Math 4:238–252

    Article  Google Scholar 

  • Bertsekas DP (1998) Network optimization: continuous and discrete models. Athena Scientific, Belmont, MA

    Google Scholar 

  • Boese KD (1996) Models for iterative global optimization. PhD thesis, University of California, Los Angeles

  • Boese KD, Kahng AB, Muddu S (1994) New adaptive multi-start techniques for combinatorial global optimizations. Oper Res Lett 16(2):101–113

    Article  Google Scholar 

  • Braun H (1990) On solving traveling salesman problems by genetic algorithms. In: Schwefel H-P, Manner R (eds) Parallel problem solving from nature, vol 496 of LNCS. Springer, Dortmund, pp 129–133

  • Burke EK, Cowling PI, Keuthen R (2001) Effective local and guided variable neighborhood search methods for the asymmetric traveling salesman problem. In: EvoWorkshop. LNCS 2037, Springer, Berlin, pp 203–312

  • Burke EK, Kendall G, Newall J, Hart E, Ross P, Schulemburg S (2003) Hyper-heuristics: an emerging direction in modern search technology. In: Glover F, Kochenberger G (eds) Handbook of metaheuristics. Kluwer Academic Publishers, Dordrecht

  • Caseau Y, Laburthe F (1995) Disjunctive scheduling with task intervals. Technical report LIENS-95-25, Ecole Normale Supérieure de Paris, France

  • Caseau Y, Laburthe F (1999) Heuristics for large constrained routing problems. J Heuristics 5:281–303

    Article  Google Scholar 

  • Cesta A, Cortellessa G, Oddi A, Policella N, Susi A (2001) A constraint-based architecture for flexible support to activity scheduling. Lect Notes Comput Sci 2175:369–390

    Article  Google Scholar 

  • Chabrier A, Danna E, Le C (2002) Pape. Coopération entre génération de colonnes sans cycle et recherche locale appliquée au routage de véhicules. In: Huitièmes Journées Nationales sur la résolution de Problèmes NP-Complets JNPC’2002, Nice, France

  • Chelouah R, Siarry P (2004) A hybrid method combining continuous tabu search and Nelder–Mead simplex algorithms for the global optimization of multiminima functions. Eur J Oper Res 161(3):636–654

    Article  Google Scholar 

  • Chen H, Flann NS (1994) Parallel simulated annealing and genetic algorithms: a space of hybrid methods. In: Davidor Y, Schwefel H-P, Manner R (eds) Third conference, on parallel problem solving from nature. Springer, Jerusalem, pp 428–436

  • Chu PC (1997) A genetic algorithm approach for combinatorial optimization problems. PhD thesis, University of London, London, UK

  • Chvatal V (1979) A greedy heuristic for the set covering problem. Math Oper Res 4(3):233–235

    Article  Google Scholar 

  • Clearwater SH, Hogg T, Huberman BA (1992) Cooperative problem solving. In: Huberman BA (ed) Computation: the micro and the macro view. World Scientific, Singapore, pp 33–70

  • Clearwater SH, Huberman BA, Hogg T (1991) Cooperative solution of constraint satisfaction problems. Science 254:1181–1183

    Article  Google Scholar 

  • Cohoon J, Hedge S, Martin W, Richards D (1987) Punctuated equilibria: a parallel genetic algorithm. In: Grefenstette JJ (ed) Second international conference on genetic algorithms. MIT, Cambridge, MA, pp 148–154

  • Cohoon JP, Martin WN, Richards DS (1990) Genetic algorithms and punctuated equilibria. In: Schwefel H-P, Manner R (eds) Parallel problem solving from nature, vol 496. Springer, Dortmund, pp 134–141

  • Cohoon JP, Martin WN, Richards DS (1991) A multi-population genetic algorithm for solving the k-partition problem on hypercubes. In: Belew RK, Booker LB (eds) Fourth international conference on genetic algorithms. Morgan Kaufmann, San Mateo, CA, pp 244–248

  • Cook W, Seymour P (2003) Tour merging via branch-decomposition. INFORMS J Comput 15(3):233–248

    Article  Google Scholar 

  • Crainic TG, Nguyen AT, Gendreau M (1997) Cooperative multi-thread parallel tabu search with evolutionary adaptive memory. In: 2nd international conference on metaheuristics, Sophia Antipolis, France

  • Crainic TG, Toulouse M, Gendreau M (1995) Synchronous tabu search parallelization strategies for multi-commodity location-allocation with balancing requirements. OR Spektrum 17:113–123

    Article  Google Scholar 

  • Crainic TG, Toulouse M (2003) Parallel strategies for metaheuristics. In: Glover FW, Kochenberger GA (eds) Handbook of metaheuristics. Springer, Berlin, pp 475–513

  • Cung V-D, Mautor T, Michelon P, Tavares A (1997) A scatter search based approach for the quadratic assignment problem. In: IEEE international conference on evolutionary computation ICEC’97. Indianapolis, USA

  • Dalboni FL, Ochi LS, Drummond LMD (2003) On improving evolutionary algorithms by using data mining for the oil collector vehicle routing problem. In: International network optimization conference INOC’2003, Paris, France

  • Davis L (1985) Job-shop scheduling with genetic algorithms. In: Grefenstette JJ (ed) International conference on genetic algorithms and their applications, Pittsburgh, pp 136–140

  • Dimitrescu I, Stutzle T (2003) Combinations of local search and exact algorithms. In: Evo workshops, pp 211–223

  • Dowsland KA (1998) Nurse scheduling with tabu search and strategic oscillation. Eur J Oper Res 106:393–407

    Article  Google Scholar 

  • Dowsland KA, Herbert EA, Kendall G (2006) Using tree search bounds to enhance a genetic algorithm approach to two rectangle packing problems. Eur J Oper Res 168(2):390–402

    Article  Google Scholar 

  • Dowsland KA, Thomson JM (2000) Solving a nurse scheduling problem with knapsacks, networks and tabu search. J Oper Res Soc 51:825–833

    Google Scholar 

  • Eby D, Averill R, Punch W, Goodman E (1998) Evaluation of injection island model GA performance on flywheel design optimization. In: International conference on adaptive computing in design and manufacturing. Springer, Devon, pp 121–136

  • Engelmore RS, Morgan A (1988) Blackboard systems. Addison-Wesley, Reading, MA

    Google Scholar 

  • De Falco I, Del Balio R, Tarantino E (1997) An analysis of parallel heuristics for task allocation in multicomputers. Computing 59(3):259–275

    Article  Google Scholar 

  • De Falco I, Del Balio R, Tarantino E, Vaccaro R (1994) Improving search by incorporating evolution principles in parallel tabu search. In: IEEE conference on evolutionary computation, pp 823–828

  • Federgruen A, Tzur M (1999) Time-partitioning heuristics: application to one warehouse, multi-item, multi-retailer lot-sizing problems. Nav Res Logist 46:463–486

    Article  Google Scholar 

  • Feo TA, Resende MGC (1995) Greedy randomized adaptive search procedures. J Glob Optim 6:109–133

    Article  Google Scholar 

  • Feo TA, Resende MGC, Smith SH (1994) A greedy randomized adaptive search procedure for maximum independent set. Oper Res 42:860–878

    Article  Google Scholar 

  • Feo TA, Venkatraman K, Bard JF (1991) A GRASP for a difficult single machine scheduling problem. Comput Oper Res 18:635–643

    Article  Google Scholar 

  • Filho, GR, Lorena LAN (2000) Constructive genetic algorithm and column generation: an application to graph coloring. In: APORS’2000 conference of the Association of the Asian-Pacific Operations Research Societies within IFORS

  • Fischetti M, Lodi A (2003) Local branching. Math Program 98(1–3):23–47

    Google Scholar 

  • Fisher ML (1985) An application oriented guide to lagrangian relaxation. Interfaces 15:399–404

    Article  Google Scholar 

  • Fleurent C, Ferland JA (1994) Genetic hybrids for the quadratic assignment problem. DIMACS Ser Discret Math Theor Comput Sci 16:173–188

    Google Scholar 

  • Fleurent C, Ferland JA (1996) Genetic and hybrid algorithms for graph coloring. Ann Oper Res 63(3):437–461

    Article  Google Scholar 

  • Focacci F, Laburthe F, Lodi A (2002) Local search and constraint programming. International Series in Operations Research and Management Science. In: Ribeiro CC, Hansen P (eds) Handbook of metaheuristics. Kluwer Academic Publishers, Norwell, MA

  • Fonlupt C, Robillard D, Preux P, Talbi E-G (1999) Fitness landscape and performance of metaheuristics. In: Meta-heuristics—advances and trends in local search paradigms for optimization. Kluwer Academic Press, Dordrecht, pp 255–266

  • Gilmore PC, Gomory RE (1961) A linear programming approach to the cutting stock problem. Oper Res 9:849–859

    Article  Google Scholar 

  • Ginsberg ML (1993) Dynamic backtracking. J Artif Intell Res 1:25–46

    Google Scholar 

  • Golden B, Pepper J, Vossen T (1998) Using genetic algorithms for setting parameter values in heuristic search. Intell Eng Syst Through Artif Neural Netw 1:9–32

    Google Scholar 

  • Gomory RE (1958) Outline of an algorithm for integer solutions to linear programs. Bull AMS 64: 275–278

    Google Scholar 

  • Grefenstette JJ (1987) Incorporating problem specific knowledge into genetic algorithms. In: Davis L (ed) Genetic algorithms and simulated annealing, Research Notes in Artificial Intelligence. Morgan Kaufmann, San Mateo, CA, pp 42–60

    Google Scholar 

  • Gutin GM (1999) Exponential neighborhood local search for the traveling salesman problem. Comput Oper Res 26(4):313–320

    Article  Google Scholar 

  • Habet D, Li CM, Devendeville L, Vasquez M (2002) A hybrid approach for SAT. In: CP’2003 principles and practice of constraint programming. LNCS No. 2470, Springer, Ithaca, USA, pp 172–184

  • Hansen P, Mladenovic M, Perez-Britos D (2001) Variable neighborhood decomposition search. J Heuristics 7(4):330–350

    Article  Google Scholar 

  • Hart WE (1994) Adaptive global optimization with local search. PhD thesis, University of California, San Diego

  • Harvey WD, Ginsberg ML (1997) Limited discrepancy search. In: IJCAI international joint conference on artificial intelligence. Morgan Kaufmann, Burlington, MA, pp 607–613

  • Hindi KS, Fleszar K, Charalambous C (2003) An effective heuristic for the CLSP with setup times. J Oper Res Soc 54:490–498

    Article  Google Scholar 

  • Hogg T, Williams C (1993) Solving the really hard problems with cooperative search. In: 11th conference on artificial intelligemce AAAI’93. AAAI Press, Menlo Park, CA, pp 231–236

  • Hong T-P, Wang H-S, Chen W-C (2000) Simultaneous applying multiple mutation operators in genetic algorithm. J Heuristics 6(4):439–455

    Article  Google Scholar 

  • Huberman BA (1990) The performance of cooperative processes. Physica D 42:38–47

    Article  Google Scholar 

  • Husbands P, Mill F, Warrington S (1990) Genetic algorithms, production plan optimisation and scheduling. In: Schewefel H-P, Manner R (eds) Parallel problem solving from nature, vol 496 of LNCS. Springer, Dortmund, pp 80–84

  • Jahuira CAR, Cuadros-Vargas E (2003) Solving the TSP by mixing GAs with minimal spanning trees. In: First international conference of the Peruvian Computer Society, Lima, Peru, pp 123–132

  • Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12

    Article  Google Scholar 

  • Jin Y, Sendhoff B (2004) Reducing fitness evaluations using clustering techniques and neural network ensembles. In: Genetic and evolutionary computation GECCO’2004, LNCS No. 3102. Springer, Berlin, pp 688–699

  • Jog P, Suh JY, Van Gucht D (1989) The effects of population size, heuristic crossover and local improvement on a genetic algorithm for the traveling salesman problem. In: 3rd international conference on genetic algorithms. Morgan Kaufmann, Burlington, MA

  • Jourdan L, Basseur M, Talbi E-G (2009) Hybridizing exact methods and metaheuristics: a taxonomy. Eur J Oper Res 199(3):620–629

    Article  Google Scholar 

  • Jourdan L, Dhaenens C, Talbi E-G (2006) Using data mining techniques to help metaheuristics: a short survey. In: Hybrid metaheuristics (HM’2006), vol 4030 of LNCS, Gran Canaria, Spain, pp 57–69

  • Juenger M, Reinelt G, Thienel S (1995) Practical problem solving with cutting plane algorithms in combinatorial optimization. DIMACS Ser Discret Math Theor Comput Sci 20:111–152

    Google Scholar 

  • Kamarainen O, Sakkout HE (2002) Local probing applied to scheduling. In: CP’2002 international conference on principles and practice of constraint programming, pp 155–171

  • Karp RM (1977) Probabilistic analysis of partitioning algorithms for the traveling salesman problem in the plane. Math Oper Res 2:209–224

    Article  Google Scholar 

  • Kim H, Hayashi Y, Nara K (1995) The performance of hybridized algorithm of genetic algorithm simulated annealing and tabu search for thermal unit maintenance scheduling. In: 2nd IEEE conference on evolutionary computation ICEC’95, Perth, Australia, pp 114–119

  • Kim H-S, Cho S-B (2001) An efficient genetic algorithm with less fitness evaluation by clustering. In: Congress on evolutionary computation CEC’01. IEEE Press, New York, pp 887–894

  • Kostikas K, Fragakis C (2004) Genetic programming applied to mixed integer programming. In: Keijzer M et al. (eds) EuroGP conference on genetic programming. LNCS vol 3003, Springer, Berlin, pp 113–124

  • Koza J, Andre D (1995) Parallel genetic programming on a network of transputers. Technical report CS-TR-95-1542, Stanford University

  • Krueger M (1993) Méthodes d’analyse d’algorithmes d’optimisation stochastiques à l’aide d’algorithmes génétiques. PhD thesis, Ecole Nationale Supèrieure des Télécommunications, Paris, France

  • Levine D (1994) A parallel genetic algorithm for the set partitioning problem. PhD thesis, Argonne National Laboratory, Illinois Institute of Technology, Argonne, USA

  • Lin FT, Kao CY, Hsu CC (1991) Incorporating genetic algorithms into simulated annealing. In: Proceedings of the fourth international symposium on AI, pp 290–297

  • Louis SJ (2003) Genetic learning from experiences. In: Congress on evolutionary computations CEC’2003, Australia, pp 2118–2125

  • Lourenco HR (1995) Job-shop scheduling: computational study of local search and large-step optimization methods. Eur J Oper Res 83:347–367

    Article  Google Scholar 

  • Mahfoud SW, Goldberg DE (1995) Parallel recombinative simulated annealing: a genetic algorithm. Parallel Comput 21:1–28

    Article  Google Scholar 

  • Maniezzo V (1999) Exact and approximate nondeterministic tree-search procedures for the quadratic assignment problem. INFORMS J Comput 11(4):358–369

    Article  Google Scholar 

  • Mariano CE, Morales E (1998) A multiple objective ant-q algorithm for the design of water distribution irrigation networks. In: First international workshop on ant colony optimization ANTS’98, Brussels, Belgium

  • Martin OC, Otto SW, Felten EW (1992) Large-step markov chains for the TSP: incorporating local search heuristics. Oper Res Lett 11:219–224

    Article  Google Scholar 

  • Mautor T, Michelon P (1997) Mimausa: a new hybrid method combining exact solution and local search. In: Second international conference on metaheuristics, Sophia-Antipolis, France

  • Michalski RS (2000) Learnable evolution model: evolutionary processes guided by machine learning. Mach Learn 38(1):9–40

    Article  Google Scholar 

  • Minsky M (1994) Negative expertise. Int J Expert Syst 7(1):13–19

    Google Scholar 

  • Nagar A, Heragu SS, Haddock J (1995) A metaheuristic algorithm for a bi-criteria scheduling problem. Ann Oper Res 63:397–414

    Article  Google Scholar 

  • Narayek A, Smith S, Ohler C (2003) Integrating local search advice into a refinment search solver (or not). In: CP’03 Workshop on cooperative constraint problem solvers, pp 29–43

  • Nemhauser G, Wolsey L (1999) Integer and combinatorial optimization. Wiley, New York

    Google Scholar 

  • Nissen V (Jan 1994) Solving the quadratic assignment problem with clues from nature. IEEE Trans Neural Netw 5(1):66–72

    Google Scholar 

  • Nuijten W, Le Pape C (1998) Constraint based job scheduling with ILOG scheduler. J Heuristics 3:271–286

    Article  Google Scholar 

  • Nwana V, Darby-Dowman K, Mitra G (2005) A cooperative parallel heuristic for mixed zero-one linear programming. Eur J Oper Res 164:12–23

    Article  Google Scholar 

  • O’Reilly U-M, Oppacher F (1995) Hybridized crossover-based techniques for program discovery. In: IEEE international conference on evolutionary computation ICEC’95, Perth, Australia, pp 573–578

  • Patterson R, Rolland E, Pirkul H (1999) A memory adaptive reasoning technique for solving the capacitated minimum spanning tree problem. J Heuristics 5:159–180

    Article  Google Scholar 

  • Pesant G, Gendreau M (1999) A view of local search in constraint programming. J Heuristics 5:255–279

    Article  Google Scholar 

  • Potts CN, Velde SL (1995) Dynasearch—iterative local improvement by dynamic programming. Technical Report TR, University of Twente, Netherlands

  • Prestwich S (2002) Combining the scalability of local search with the pruning techniques of systematic search. Ann Oper Res 115:51–72

    Article  Google Scholar 

  • Puchinger J. Raidl GR (2005) Combining metaheuristics and exact algorithms in combinatorial optimization: a survey and classification. In: Artificial intelligence and knowledge engineering applications: a bioinspired approach. LNCS vol 3562, Springer, Berlin, pp 41–53

  • Ramsey CL, Grefenstette JJ (1993) Case-based initialization of genetic algorithms. In: Fifth international conference on genetic algorithms, pp 84–91

  • Rasheed K, Vattam S, Ni X (2002) Comparison of methods for developing dynamic reduced models for design optimization. In: CEC’2002 congress on evolutionary computation, pp 390–395

  • Reynolds RG, Michalewicz Z, Peng B (2005) Cultural algorithms: computational modeling of how cultures learn to solve problems—an engineering example. Cybern Syst 36(8):753–771

    Article  Google Scholar 

  • Ribeiro M, Plastino A, Martins S (2006) Hybridization of GRASP metaheuristic with data mining techniques. J Math Modell Algorithms 5(1):23–41

    Article  Google Scholar 

  • Rosing KE, ReVelle CS (1997) Heuristic concentration: two stage solution construction. Eur J Oper Res 97(1):75–86

    Article  Google Scholar 

  • Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by backpropagating errors. Nature 323:533–536

    Article  Google Scholar 

  • Salami M, Cain G (1996) Genetic algorithm processor on reprogrammable architectures. In: Fifth annual conference on evolutionary programming EP’96. MIT Press, San Diego, CA

  • Sebag M, Schoenauer M, Ravise C (1997) Toward civilized evolution: developing inhibitions. In: Bäck T (eds) Seventh international conference on genetic algorithms, pp 291–298

  • Sefraoui M, Periaux J (2000) A hierarchical genetic algorithm using multiple models for optimization. In: Parallel problem solving from nature PPSN’2000, LNCS No.1917. Springer, Berlin, pp 879–888

  • Sellmann M, Ansótegui C (2006) Disco-novo-gogo: integrating local search and complete search with restarts. In: The twenty-first national conference on artificial intelligence and the eighteenth innovative applications of artificial intelligence conference, Boston, USA

  • Shahookar K, Mazumder P (1990) A genetic approach to standard cell placement using meta-genetic parameter optimization. IEEE Trans Comput Aided Design 9(5):500–511

    Article  Google Scholar 

  • Shaw P (1998) Using constraint programming and local search methods to solve vehicle routing problems. In: Maher M, Puget J-F (eds) CP’98 principle and practice of constraint programming, LNCS No. 1520, pp 417–431

  • Sprave J (1999) A unified model of non-panmictic population structures in evolutionary algorithms. In: Proceedings of the 1999 congress on evolutionary computation, vol 2. IEEE Press, Piscataway, NJ, pp 1384–1391

  • Stutzle T, Hoos HH (1997) The MAX-MIN ant system and local search for combinatorial optimization problems: towards adaptive tools for global optimization. In: 2nd international conference on metaheuristics. INRIA, Sophia Antipolis, France, pp 191–193

  • Suh JY, Van Gucht D (1987) Incorporating heuristic information into genetic search. In: 2nd international conference on genetic algorithms. Lawrence Erlbaum Associates, USA, pp 100–107

  • Taillard E (1993) Parallel iterative search methods for vehicle routing problem. Networks 23:661–673

    Article  Google Scholar 

  • Taillard E (2003) Heuristic methods for large centroid clustering problems. J Heuristics 9(1):51–74

    Article  Google Scholar 

  • Taillard E, Voss S (2002) POPMUSIC: partial optimization metaheuristic under special intensification conditions. In: Essays and surveys in metaheuristics. Kluwer Academic Publishers, Dordrecht, pp 613–629

  • Taillard ED, Gambardella L (1997) Adaptive memories for the quadratic assignment problem. Technical Report 87–97, IDSIA, Lugano, Switzerland

  • Taillard ED, Gambardella LM, Gendreau M, Potvin J-Y (2001) Adaptive memory programming: a unified view of metaheuristics. Eur J Oper Res 135(1):1–16

    Article  Google Scholar 

  • Talbi E-G (2002) A taxonomy of hybrid metaheuristics. J Heuristics 8:541–564

    Article  Google Scholar 

  • Talbi E-G (2009) Metaheuristics: from design to implementation. Wiley, New York

    Google Scholar 

  • Talbi E-G, Bachelet V (2006) COSEARCH: a parallel cooperative metaheuristic. J Math Modell Algorithms 5(2):5–22

    Article  Google Scholar 

  • Talbi E-G, Fonlupt C, Preux P, Robillard D (1998) Paysages de problèmes d’optimisation et performances des méta-heuristiques. In: Premier Congrés de la Société Francaise de Recherche Opérationnelle et Aide à la Décision ROAD, Paris, France

  • Talbi EG, Muntean T, Samarandache I (1994) Hybridation des algorithmes génétiques avec la recherche tabou. In: Evolution Artificielle EA94, Toulouse, France

  • Talukdar S, Baerentzen L, De Gove A, Souza P (1998) Asynchronous teams: cooperation schemes for autonomous agents. J Heuristics 4(4):295–321

    Article  Google Scholar 

  • Tamura H, Hirahara A, Hatono I, Umano M (1994) An approximate solution method for combinatorial optimization—hybrid approach of genetic algorithm and lagrangean relaxation method. Trans Soc Instrum Control Eng 130:329–336

    Google Scholar 

  • Tanese R (1987) Parallel genetic algorithms for a hypercube. In: Proceedings of the second international conference on genetic algorithms. MIT, Cambridge, MA, pp 177–183

  • Thiel J, Voss S (1994) Some experiences on solving multiconstraint zero-one knapsack problems with genetic algorithms. INFOR 32(4):226–242

    Google Scholar 

  • Toulouse M, Crainic T, Gendreau M (1996) Communication issues in designing cooperative multi-thread parallel searches. In: Osman IH, Kelly JP (eds) Meta-heuristics: theory and applications. Kluwer Academic Publishers, Dordrecht, pp 501–522

    Google Scholar 

  • Tuson A, Ross P (1998) Adapting operator settings in genetic algorithms. Evol Comput 6(2):161–184

    Article  Google Scholar 

  • Ulder NLJ, Aarts EHL, Bandelt H-J, Van Laarhoven PJM, Pesch E (1990) Genetic local search algorithms for the traveling salesman problem. In: Schewefel H-P, Manner R (eds) Parallel problem solving from nature, vol 496 of LNCS. Springer-Verlag, Dortmund, pp 109–116

  • Vasquez M, Hao J-K (2001) A hybrid approach for the 0–1 multidimensional knapsack problem. In: Proceedings of the international joint conference on artificial intelligence IJCAI, pp 328–333

  • Verhoeven MGA, Aarts EHL (1995) Parallel local search. J Heuristics 1(1):43–65

    Article  Google Scholar 

  • Voigt H-M, Born J, Santibanez-Koref I (1990) Modelling and simulation of distributed evolutionary search processes for function optimization. In: Schwefel H-P, Manner R (eds) Parallel problem solving from nature, vol 496 of LNCS. Springer, Dortmund, pp 373–380

  • Voss S (1993) Tabu search: applications and prospects. In: Du DZ, Pardalos PM (eds) Network optimization problems. World Scientific, USA, pp 333–353

  • Wang L-H, Kao C-Y, Ouh-young M, Chen W-C (1995) Molecular binding: a case study of the population-based annealing genetic algorithms. In: IEEE international conference on evolutionary computation ICEC’95, Perth, Australia, pp 50–55

  • Yagiura M, Ibaraki T (1996) Metaheuristics as robust and simple optimization tools. In: IEEE international conference on evolutionary computation, ICEC’96, pp 541–546

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to El-Ghazali Talbi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Talbi, EG. Combining metaheuristics with mathematical programming, constraint programming and machine learning. 4OR-Q J Oper Res 11, 101–150 (2013). https://doi.org/10.1007/s10288-013-0242-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10288-013-0242-3

Keywords

Mathematics Subject Classification

Navigation