Abstract
Pattern recognition and classification is a central concern for modern information processing systems. In particular, one key challenge to image and video classification has been that the computational cost of image processing scales linearly with the number of pixels in the image or video. Here we present an intelligent machine (the “active categorical classifier,” or ACC) that is inspired by the saccadic movements of the eye, and is capable of classifying images by selectively scanning only a portion of the image. We harness evolutionary computation to optimize the ACC on the MNIST hand-written digit classification task, and provide a proof-of-concept that the ACC works on noisy multi-class data. We further analyze the ACC and demonstrate its ability to classify images after viewing only a fraction of the pixels, and provide insight on future research paths to further improve upon the ACC presented here.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Trier, O.D., Jain, A.K., Taxt, T.: Feature extraction methods for character recognition - a survey. Pattern Recogn. 29, 641–662 (1999)
LeCun, Y., Boser, B., Denker, J.S., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1, 541–551 (1989)
Mnih, V., Heess, N., Graves, A., Kavukcuoglu, K.: Recurrent models of visual attention. In: Advances in Neural Information Processing Systems, NIPS 2009, pp. 2204–2212 (2014)
Itti, L., Koch, C.: Computational modelling of visual attention. Nat. Rev. Neurosci. 2, 194–203 (2001)
Edlund, J., Chaumont, N., Hintze, A., et al.: Integrated information increases with fitness in the evolution of animats. PLoS Comput. Biol. 7, e1002236 (2011)
Olson, R., Hintze, A., Dyer, F., Knoester, D., Adami, C.: Predator confusion is sufficient to evolve swarming behaviour. J. Roy. Soc. Interface 10, 20130305 (2013)
Chapman, S., Knoester, D., Hintze, A., Adami, C.: Evolution of an artificial visual cortex for image recognition. In: Liò, P., et al. (eds.) Advances in Artificial Life (ECAL 2013), pp. 1067–1074. MIT Press, Cambridge (2013)
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)
Marstaller, L., Hintze, A., Adami, C.: Cognitive systems evolve complex representations for adaptive behavior. Neural Comput. 25, 2079–2105 (2013)
Eiben, A., Smith, J.: Introduction to Evolutionary Computing. Springer, Berlin (2003)
Olson, R.S., Knoester, D.B., Adami, C.: Evolution of swarming behavior is shaped by how predators attack. Artif. Life 22 (2016)
Breiman, L., Cutler, A.: Random forests - classification description, March 2016. http://www.stat.berkeley.edu/~breiman/RandomForests/cc_home.htm
Pedregosa, F., Varoquaux, G., Gramfort, A., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Wan, L., Zeiler, M., Zhang, S., LeCun, Y., Fergus, R.: Regularization of neural networks using DropConnect. In: Proceedings of the 30th International Conference on Machine Learning, ICML 2013 (2013)
Beer, R.D.: The dynamics of active categorical perception in an evolved model agent. Adapt. Behav. 11, 209–243 (2003)
Nguyen, A., Yosinski, J., Clune, J.: Neural networks are easily fooled: high confidence predictions for unrecognizable images. In: Computer Vision and Pattern Recognition (CVPR 2015). IEEE Press (2015)
Goodfellow, I.J., Shlens, J., Szegedy, C.: Explaining and harnessing adversarial examples. In: International Conference on Learning Representations (2015). http://research.google.com/pubs/ChristianSzegedy.html
Szegedy, C., Zaremba, W., Sutskever, I., et al.: Intriguing properties of neural networks. In: International Conference on Learning Representations (2014). http://research.google.com/pubs/ChristianSzegedy.html
Acknowledgments
We thank David B. Knoester, Arend Hintze, and Jeff Clune for their valuable input during the development of this project. We also thank the Michigan State University High Performance Computing Center for the use of their computing resources. This work was supported in part by the National Science Foundation BEACON Center under Cooperative Agreement DBI-0939454, and in part by National Institutes of Health grants LM009012, LM010098, and EY022300.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Olson, R.S., Moore, J.H., Adami, C. (2016). Evolution of Active Categorical Image Classification via Saccadic Eye Movement. In: Handl, J., Hart, E., Lewis, P., López-Ibáñez, M., Ochoa, G., Paechter, B. (eds) Parallel Problem Solving from Nature – PPSN XIV. PPSN 2016. Lecture Notes in Computer Science(), vol 9921. Springer, Cham. https://doi.org/10.1007/978-3-319-45823-6_54
Download citation
DOI: https://doi.org/10.1007/978-3-319-45823-6_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-45822-9
Online ISBN: 978-3-319-45823-6
eBook Packages: Computer ScienceComputer Science (R0)