An Application of Component-Wise Iterative Optimization to Feed-Forward Neural Networks

  • Yachen Lin
Conference paper

DOI: 10.1007/978-3-540-72586-2_67

Part of the Lecture Notes in Computer Science book series (LNCS, volume 4488)
Cite this paper as:
Lin Y. (2007) An Application of Component-Wise Iterative Optimization to Feed-Forward Neural Networks. In: Shi Y., van Albada G.D., Dongarra J., Sloot P.M.A. (eds) Computational Science – ICCS 2007. ICCS 2007. Lecture Notes in Computer Science, vol 4488. Springer, Berlin, Heidelberg

Abstract

Component-wise Iterative Optimization (CIO) is a method of dealing with a large data in the OLAP applications, which can be treated as the enhancement of the traditional batch version methods such as least squares. The salient feature of the method is to process transactions one by one, optimizes estimates iteratively for each parameter over the given objective function, and update models on the fly. A new learning algorithm can be proposed when applying CIO to feed-forward neural networks with a single hidden layer. It incorporates the internal structure of feed-forward neural networks with a single hidden layer by applying the algorithm CIO in closed-form expressions to update weights between the output layer and the hidden layer. Its optimally computational property is a natural consequence inherited from the property of the algorithm CIO and is also demonstrated in an illustrative example.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Yachen Lin
    • 1
  1. 1.Fidelity National Information Services, Inc., 11601 Roosevelt Blvd-TA76, Saint Petersburg, FL 33716 

Personalised recommendations