Advertisement

Abstract

In this paper a team of agents applied to train a feed-forward artificial neural networks is proposed, implemented and experimentally evaluated. The approach is based on a new variant of the A-Team architecture. Each agent member of the team is executing its own simple training procedure and it is expected that the whole team demonstrates complex collective behavior. The paper includes a description of the proposed approach and presents the results of the experiment involving benchmark datasets. The results show that the approach could be considered as a competitive training tool.

Keywords

Artificial Neural Network Shared Memory Neural Network Training Training Tool Interface Agent 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    W. Duch & J. Korczak. Optimization and Global Minimization Methods Suitable for Neural Network. Neural Computing Surveys 2, 1998, http://www.icsi.berkeley.edu/jagopta/CNS.Google Scholar
  2. [2]
    I. Czarnowski, P. Jedrzejowicz, E. Ratajczak. Population Learning Algorithm — Example Implementations and Experiments. Proceedings of the Fourth Metaheuristics International Conference, Porto, 2001, 607–612.Google Scholar
  3. [3]
    I. Czarnowski & P. Jedrzejowicz. Population Learning Metaheuristic for Neural Network Training. Proceedings of the Sixth International Conference on Neural Networks and Soft Computing (ICNNSC), Zakopane, Poland, 2002.Google Scholar
  4. [4]
    I. Czarnowski & P. Jedrzejowicz. Application of the Parallel Population Learning Algorithm to Training Feed-forward ANN. Proceedings of the Euro-International Symposium on Computational Intelligence (E-ISCI), Kosice, 2002.Google Scholar
  5. [5]
    I. Czarnowski & P. Jedrzejowicz. An Agent-Based PLA for the Cascade Correlation Learning Architecture. Springer-Verlag, Lecture Notes in Computer Science (to appear in 2005)Google Scholar
  6. [6]
    S.E. Fahlman & C. Lebiere. The Cascade-Corelation Learning Architecture. Advances in Neural Information Processing Systems 2, Morgan Kaufmann, 1990.Google Scholar
  7. [7]
    J. Hertz, A. Krogh, R.G. Palmer. Introduction to the Theory of Neural Computation. WNT, Warsaw, 1995 (in Polish).Google Scholar
  8. [8]
    P. Jedrzejowicz. Social Learning Algorithm as a Tool for Solving Some Difficult Scheduling Problems. Foundation of Computing and Decision Sciences, 1999, 24:51–66.MathSciNetGoogle Scholar
  9. [9]
    O.L. Mangasarian & W.H. Wolberg. Cancer Diagnosis via Linear Programming. SIAM News, 1990, 23(5):1–18.Google Scholar
  10. [10]
    C.J. Merz & M. Murphy. UCI Repository of machine learning databases. [http://www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California, Department of Information and Computer Science, 1998.Google Scholar
  11. [11]
    Z. Michalewicz. Genetic Algorithms + Data Structures = Evolution Programs. Springer, Berlin, 1996.zbMATHGoogle Scholar
  12. [12]
    H.V.D. Parunak. Agents in Overalls: Experiences and Issues in the Development and Deployment of Industrial Agent-Based Systems. International Journal of Cooperative Information Systems, 2000, 9(3):209–228.CrossRefGoogle Scholar
  13. [13]
    Yi Shang & B.W. Wah. A Global Optimization Method for Neural Network Training. Conference of Neural Networks. IEEE Computer, 1996, 29: 45–54.Google Scholar
  14. [14]
    B.W. Wah & Minglun Qian. Constrained Formulations for Neural Network Training and Their Applications to Solve the Two-Spiral Problem. Proceedings of the Fifth International Conference on Computer Science and Informatics, 2000, 1:598–601.Google Scholar
  15. [15]
    D. Whitley. Genetic Algorithms and Neural Networks. Genetic Algorithms in Enginering and Computer Science, G. Winter, J. Perianx, M. Galan and P. Cuesta (eds.), John Wiley 1995, 203–216.Google Scholar
  16. [16]
    S. Talukdar, L. Baerentzen, A. Gove, P. de Souza. Asynchronous Teams: Co-operation Schemes for Autonomous, Computer-Based Agents, Technical Report EDRC 18-59-96, Carnegie Mellon University, Pittsburgh, 1996.Google Scholar
  17. [17]
    Xiao-Feng Xie and Wen-Jun Zhang. SWAF: Swarm Algorithm Framework for Numerical Optimization. In: Kalyanmoy Deb et al (eds.), Proceedings of the Genetic and Evolutionary Computation Conference (GECCO’2004), Heidelberg, Germany, June 2004. Seattle, WA, Springer Verlag, Lecture Notes in Computer Science, 2004, 3102:238–250.Google Scholar

Copyright information

© Springer-Verlag London Limited 2006

Authors and Affiliations

  • Ireneusz Czarnowski
    • 1
  • Piotr Jedrzejowicz
    • 1
  1. 1.Department of Information SystemsGdynia Maritime UniversityGdyniaPoland

Personalised recommendations