Advertisement

PCA-Based Elman Neural Network Algorithm

  • Shifei Ding
  • Weikuan Jia
  • Chunyang Su
  • Xinzheng Xu
  • Liwen Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5370)

Abstract

When we manipulate high dimensional data with Elman neural network, many characteristic variables provide enough information, but too many network inputs go against designing of the hidden-layer of the network and take up plenty of storage space as well as computing time, and in the process interfere the convergence of the training network, even influence the the accuracy of recognition finally. PCA,which is short for principal component analysis is a multivariate analysis method which transforms many characteristic variables to few synthetic variables. Not only can it eliminate relationship among characteristic variables but new variables can also hold most information of the original ones as well. In this paper we make full use of the advantages of PCA and the properties of Elman neural network structures to establish PCA-Elman based on PCA. The new algorithm reduces dimensions of the high dimensional data by PCA, and carry on network training and simulation with low dimensional data that we get, which obviously simplifies the network structure, and in the process, improves the training speed and generalization capacity of the Elman neural network. We prove the effectiveness of the new algorithm by case analysis. The algorithm improves the efficiency in network problems solving and is worth further generalizing.

Keywords

Elman neural network PCA PCA-Elman algorithm 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Mccllochw, S., Pitts, W.: A Logical Calculus of the Ideas Immanent in Nervous activity. Bulletin of Mathematical Biophysics 10(5), 115–133 (1943)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Elman, J.L.: Finding Structure in Time. Cognitive Science 14(2), 179–211 (1990)CrossRefGoogle Scholar
  3. 3.
    Gopi, E.S.: Digital Image Forgery Detection Using Artificial Neural Network and Independent Component Analysis. Applied Mathematics and Computation 194(2), 540–543 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Melchiorre, C., Matteucci, M., Azzoni, A., et al.: Artificial Neural Networks and Cluster Analysis in Landslide Susceptibility Zonation. Geomorphology 94(3), 379–400 (2008)CrossRefGoogle Scholar
  5. 5.
    Lewis, E., Sheridan, C., Farrell, M.O., et al.: Principal Component Analysis and Artificial Neural Network Based Approach to Analysing Optical Fibre Sensors Signals. Sensors and Actuators A: Physical 136(1), 28–38 (2007)CrossRefGoogle Scholar
  6. 6.
    Yan, W.G., Liu, G.X., Yang, J.: Quality Modeling of Mechanical Product Based on PCA and Elman neural network. Science Technology and Engineering 7(19), 5091–5095 (2007)Google Scholar
  7. 7.
    Liu, B.P., Qin, H.J., Luo, X.: Study on Quantitative Analysis of Multi-component Based on Near-Infrared Spectroscopy Technique in Elman Network. Spectroscopy and Spectral Analysis 27(12), 245–2459 (2007)Google Scholar
  8. 8.
    Johnson, R.A., Wichern, D.W.: Applied Multivariate Statistical Analysis, 6th edn. Prentice Hall, Englewood Cliffs (2007)zbMATHGoogle Scholar
  9. 9.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Representation by Back-Propagating Errors. Nature 3(6), 533–536 (1986)CrossRefGoogle Scholar
  10. 10.
    Zhang, Y.M.: Application of Artificial Neural Network Used in Pridiction of Wheat Midge. Northwest Sci-Tech University of Agriculture and Forestry (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Shifei Ding
    • 1
    • 2
  • Weikuan Jia
    • 3
  • Chunyang Su
    • 1
  • Xinzheng Xu
    • 1
  • Liwen Zhang
    • 1
  1. 1.School of Computer Science and TechnologyChina University of Mining and TechnologyXuzhouChina
  2. 2.Key Laboratory of Intelligent Information Processing, Institute of Computing TechnologyChinese Academy of SciencesBeijingChina
  3. 3.College of Plant ProtectionShandong Agricultural UniversityTaianChina

Personalised recommendations