Deep Neural Networks—A Brief History

Cao, Y., Chen, Y., Khosla, D.: Spiking deep convolutional neural networks for energy-efficient object recognition. Int. J. Comput. Vis. (2014)Google Scholar

Cios, K.J., Shin, I.: Image recognition neural network: IRNN. Neurocomputing 7(2), 159–185 (1995)CrossRefMATHGoogle Scholar

Fukushima, K.: Neocognitron: a self organizing neural network model for a mechanism for pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202 (1980)CrossRefMATHGoogle Scholar

Hebb DO. 1949. The Organization of Behavior. WileyGoogle Scholar

Hinton, G.E., Osindero, S., Teh, Y.: A fast learning algorithm for deep belief nets. Neural Comput. 18, 1527–1554 (2006)MathSciNetCrossRefMATHGoogle Scholar

Hinton, G.E., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATHGoogle Scholar

Hodgkin, A.L., Huxley, A.F.: A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 177, 500–544 (1952)CrossRefGoogle Scholar

Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J. Physiol. 160, 106–154 (1962)CrossRefGoogle Scholar

Izhikevich, E.M.: Simple model of spiking neurons. IEEE Trans. Neural Networks 14, 1569–1572 (2003)CrossRefGoogle Scholar

Izhikevich, E.M.: Polychronization: computation with spikes. Neural Comput. 18(2), 245–282 (2006)MathSciNetCrossRefMATHGoogle Scholar

Kandel E.R., et al.: Principles of Neural Science, 5th edn. McGraw-Hill (2013)Google Scholar

Kohonen, T.: Self-organized formation of topologically correct feature maps. Biol. Cybern. 43, 59–69 (1982)MathSciNetCrossRefMATHGoogle Scholar

Konorski J.: Conditioned Reflexes and Neuron Organization. Cambridge University Press, Cambridge (267 pp.); Reprinted with a supplementary chapter in 1968 by Hafner Publ. Co., New York (1948)Google Scholar

Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS’ 2012 (2012)Google Scholar

Lim, H.K., Keniston, L.P., Cios, K.J.: Modeling of multisensory convergence with a network of spiking neurons: a reverse engineering approach. IEEE Trans. Biomed. Eng. 58(7), 1940–1949 (2011)CrossRefGoogle Scholar

LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of IEEE, vol. 86, no. 11, pp. 2278–2324 (1998)Google Scholar

LeCun, Y., Kavukcuoglu, K., Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 253–256. IEEE (2010)Google Scholar

LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)Google Scholar

McCulloch, W.S., Pitts, W.H.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133 (1943)MathSciNetCrossRefMATHGoogle Scholar

MacGregor, R.J.: Neural and Brain Modeling. Academic Press (1987)Google Scholar

Minsky, M., Papert, S.: An Introduction to Computational Geometry. MIT Press (1969)Google Scholar

Nguyen, A., Yosinski, J., Clune, J.: Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images (2014). arXiv:1412.1897v2 [cs.CV] 18 Dec 2014

Robbins, H., Monro, S.: A stochastic approximation method. Ann. Math. Stat. 22(3), 400–407 (1951)Google Scholar

Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323, 533–536 (1986)Google Scholar

Rosenblatt, F.: The Perceptron—a perceiving and recognizing automaton. Report 85-460-1, Cornell Aeronautical Laboratory (1957)Google Scholar

Sala, D.M., Cios, K.J.: Solving graph algorithms with networks of spiking neurons. IEEE Trans. Neural Netw. 10(4), 953–957 (1999)CrossRefGoogle Scholar

Shin, J.H., Smith, D., Swiercz, W., Staley, K., Rickard, T., Montero, J., Kurgan, L., Cios, K.J.: Recognition of partially occluded and rotated images with a network of spiking neurons. IEEE Trans. Neural Netw. 21(11), 1697–1708 (2010)CrossRefGoogle Scholar

Song, S., Miller, K.D., Abbot, L.F.: Competitive Hebbian learning through spike timing-dependent synaptic plasticity. Nat. Neurosci. 3(9) (2000)Google Scholar

Strack, B., Jacobs, K., Cios, K.J.: Biological restraint on the Izhikevich neuron model essential for seizure modeling. In: Proceedings of 6th International IEEE EMBS Conference on Neural Engineering, San Diego, 6–8 Nov, pp. 395–398 (2013)Google Scholar

Strack, B., Jacobs, K., Cios, K.J.: Simulating vertical and horizontal inhibition with short term dynamics in a multi-column multi-layer model of Neocortex. Int. J. Neural Syst. 24(5), 1440002 [19 pp.] (2014)Google Scholar

Swiercz, W., Cios, K.J., Staley, K., et al.: New synaptic plasticity rule for networks of spiking neurons. IEEE Trans. Neural Netw. 17(1), 94–105 (2006)CrossRefGoogle Scholar

Szeged, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, D., Fergus, R.: Intriguing properties of neural networks. In: International Conference on Learning Representations (2014)Google Scholar

Werbos, P.: Beyond regression: new tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University (1974)Google Scholar