Abstract
This article discusses three specific issues of particular interest in the study of nonlinear dynamical systems:
-
Bayesian estimation, exemplified by particle filtering;
-
Learning in recurrent neural networks;
-
Correlative learning, exemplified by the ALOPEX algorithm.
By and large, the discussion is of a philosophical nature.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Haykin, S.: Signal processing: Where Physics and Mathematics Meet. IEEE Signal Processing Magazine 18(4), 6–7 (2001) (invited)
Kalman, R.E.: A New Approach to Linear Filtering and Prediction Problems. Transactions of the ASME, Journal of Basic Engineering 82(3), 5–45 (1960)
Robert, C.P., Casella, G.: Monte Carlo Statistical Methods. Springer, Berlin (1999)
Gordon, N., Salmond, D., Smith, A.F.M.: Novel Approach to Nonlinear/Non-gaussian Bayesian State Estimation. IEE Proceedings-F 140, 107–113 (1993)
Doucet, A., de Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)
Cappé, O., Moulines, E., Rydén, T.: Inference in Hidden Markov Models. Springer, Heidelberg (2005)
Haykin, S., de Freitas, N. (eds.): In: Special Issue of the Proc. IEEE on Sequential State Estimation (2004)
Haykin, S.: Adaptive Filter Theory, 4th edn. Prentice-Hall, Englewood Cliffs (2002)
Cover, T.: Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition. IEEE Trans. on Electronic Computers EC-14, 326–334 (1965)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice-Hall, Englewood Cliffs (1999)
Maass, W., Natschläger, T., Markram, H.: Real-Time Computing without Stable States: A New Framework for Neural Computation Based on Perturbations. Neural Computation 14, 2531–2560 (2002)
Jaegar, H., Haas, H.: Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 304(5667), 78–80 (2003)
Bengio, Y., Simard, P., Frasconi, P.: Learning Long-Term Dependencies with Gradient Descent is Difficult. IEEE Transactions on Neural Networks 5, 157–166 (1994)
Puskorious, G.V., Feldkamp, L.: Parameter-based Kalman Filter Training: Theory and Implementation. In: Haykin, S. (ed.) Kalman Filtering and Neural Networks, pp. 23–67. John Wiley & Son, Chichester (2001)
Feldkamp, L.: Private Communication (October 19, 2004)
Eggermont, J.J.: The Correlative Brain: Theory and Experiment in Neural Interaction. Springer, New York (1990)
Hebb, D.: Organization of Behavior: A Neuropsychological Theory. Wiley, New York (1949)
Fujita, O.: Trial-and-Error Correlation Learning. IEEE Transactions on Neural Networks 4(4), 720–722 (1993)
Haykin, S., Chen, Z., Becker, S.: Stochastic Correlative Learning Algorithms. IEEE Transactions on Signal Processing 52(8), 2200–2209 (2004)
Chen, Z.: Stochastic Optimization Approaches for Correlative-based Learning, Ph.D. Thesis, McMaster University, Hamilton, Ontario, Canada, under preparation
Becker, S., Bruce, I.C.: Neural Coding in The Auditory Periphery: Insights From Physiology and Modeling Lead to a Novel Hearing Compensation Algorithm. In: Workshop in Neural Information Coding, Les Houches, France (2002)
Bruce, I.C., Sachs, M.B., Young, E.: An Auditory-Periphery Model of the Effects of Acoustic Trauma on Auditory Nerve Responses. J. of Acoustical Society of America 113(1), 369–388 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Haykin, S. (2005). Signal Processing in a Nonlinear, NonGaussian, and Nonstationary World. In: Chollet, G., Esposito, A., Faundez-Zanuy, M., Marinaro, M. (eds) Nonlinear Speech Modeling and Applications. NN 2004. Lecture Notes in Computer Science(), vol 3445. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11520153_3
Download citation
DOI: https://doi.org/10.1007/11520153_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27441-4
Online ISBN: 978-3-540-31886-6
eBook Packages: Computer ScienceComputer Science (R0)