Overview of Artificial Neural Networks
The artificial neural network (ANN), or simply neural network, is a machine learning method evolved from the idea of simulating the human brain. The data explosion in modern drug discovery research requires sophisticated analysis methods to uncover the hidden causal relationships between single or multiple responses and a large set of properties. The ANN is one of many versatile tools to meet the demand in drug discovery modeling. Compared to a traditional regression approach, the ANN is capable of modeling complex nonlinear relationships. The ANN also has excellent fault tolerance and is fast and highly scalable with parallel processing. This chapter introduces the background of ANN development and outlines the basic concepts crucially important for understanding more sophisticated ANN. Several commonly used learning methods and network setups are discussed briefly at the end of the chapter.
KeywordsTransfer function Hopfield network Kohonen network perceptron unsupervised learning supervised learning
- 2.Hebb DO (1993) The organization of behavior. John Wiley & Sons, New York.Google Scholar
- 4.Minsky ML, Papert SA (1969) Perceptrons. MIT Press, Cambridge, MA.Google Scholar
- 6.Rosenblatt, F. (1962) Principles of neurodynamics: perceptrons and the theory of brain mechanisms. Spartan Books, New York.Google Scholar
- 7.Rumelhart DE, McClelland JL (1986) Parallel distributed processing: exploration in the microstructure of cognition. MIT Press, Cambridge, MA.Google Scholar
- 9.Kohonen T (1989) Self Organization and associative memory, 3 edn. Springer-Verlag, New York.Google Scholar