Skip to main content

Part of the book series: Operations Research/Computer Science Interfaces Series ((ORCS,volume 36))

Abstract

Tabu Search is a metaheuristic that guides a local heuristic search procedure to explore the solution space beyond local optimality. One of the main components of tabu search is its use of adaptive memory, which creates a more flexible search behavior. Memory based strategies are therefore the hallmark of tabu search approaches, founded on a quest for “integrating principles,” by which alternative forms of memory are appropriately combined with effective strategies for exploiting them. In this chapter we address the problem of training multilayer feed-forward neural networks. These networks have been widely used for both prediction and classification in many different areas. Although the most popular method for training these networks is backpropagation, other optimization methods such as tabu search have been applied to solve this problem. This chapter describes two training algorithms based on the tabu search. The experimentation shows that the procedures provide high quality solutions to the training problem, and in addition consume a reasonable computational effort.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Bishop, C. M., 1995, Neural Networks for Pattern Recognition, Oxford University Press.

    Google Scholar 

  • El-Fallahi A., 2002, Entrenamiento de Redes Neuronales, Trabajo de Investigatión, Dpto Estadśtica e I.O. University of Valencia.

    Google Scholar 

  • El-Fallahi, A., Martí, R., and Lasdon, L., 2005, Path relinking and GRG for artificial neural networks, European journal of operational research 169:508–519.

    Article  Google Scholar 

  • Fahlman, S. E., 1988, An empirical study of learning speed in back-propagation networks, in: Connectionist Models Summer School, T. J. Sejnowski, G. E. Hinton and D. S. Touretzky, eds., San Mateo, CA, Morgan Kaufmann, pp. 38–51.

    Google Scholar 

  • Glover, F., 1986, Future paths for integer programming and links to artificial intelligence, Computers and Operations Research 13:533–549.

    Article  MATH  MathSciNet  Google Scholar 

  • Glover, F., 1989, Tabu search part I, ORSA Journal on Computing 1:190–206.

    MATH  MathSciNet  Google Scholar 

  • Glover, F., and Laguna, M., 1993, Tabu search, in: Modern Heuristic Techniques for Combinatorial Problems, C. Reeves, ed., Blackwell Scientific Publishing, Oxford, pp. 70–150.

    Google Scholar 

  • Glover, F., and Laguna, M., 1997, Tabu Search, Kluwer Academic Publishers, Boston.

    MATH  Google Scholar 

  • Jacobs, R. A., 1988, Increased rates of convergence through learning rate adaptation, Neural Networks 1:295–307.

    Article  Google Scholar 

  • Laguna, M., Martí, R., 2003, Scatter Search—Methodology and Implementations in C, Kluwer Academic Publishers, Boston.

    Google Scholar 

  • Riedmiller, M., and Heinrich, B., 1993, A direct adaptive method for faster back-propagation learning: the RPROP algorithm, IEEE Intl. Conf. on Neural Networks, pp. 586–591.

    Google Scholar 

  • Rumelhart, D. E., and McClelland, J. L., 1986, Parallel distributed processing: explorations in the microstructure of cognition, Cambridge, MA: The MIT Press.

    Google Scholar 

  • Sexton, R. S., Alidaee, B., Dorsey, R. E., and Johnson, J. D., 1998, Global optimization for artificial neural networks: a tabu search application, European Journal of Operational Research 106:570–584.

    Article  MATH  Google Scholar 

  • Smith, S., and Lasdon, L., 1992, Solving large nonlinear programs using GRG, ORSA Journal on Computing 4(1): 2–15.

    MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Glover, F., Marti, R. (2006). Tabu Search. In: Alba, E., Martí, R. (eds) Metaheuristic Procedures for Training Neutral Networks. Operations Research/Computer Science Interfaces Series, vol 36. Springer, Boston, MA . https://doi.org/10.1007/0-387-33416-5_3

Download citation

Publish with us

Policies and ethics