Abstract
Auto Resonance Network (ARN) is a general purpose Artificial Neural Network (ANN) capable of non-linear data classification. Each node in an ARN resonates when it receives a specific set of input values. Coverage of an ARN node indicates the spread of values within which the gain is guaranteed to be above half-power point. Tuning of ARN nodes therefore refers to adjusting the coverage of an ARN node. These tuning equations of ARN nodes are complex and hence a fast hardware accelerator needs to be built to reduce performance bottlenecks. The paper discusses issues related to speed of computation of a resonating ARN node and its numerical accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Lindholm, E., Nickolls, J., Oberman, S., Montrym, J.: NVidia Telsa: a unified graphics and computing architecture. IEEE Micro 28(2), 39–55 (2008)
Halfhill, T.R.: Parallel processing with CUDA. Reed electronics group. http://www.nvidia.in/docs/IO/55972/220401_Reprint.pdf
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G., Davis, A., et al.: TensorFlow: large-scale machine learning on heterogeneous distributed systems. White paper, Google Research, November 2015
Jouppi, N.P., Young, C., Patil, N., Patterson, D., Agarwal, G., Bajwa, R., et al.: In-datacenter performance analysis of a tensor processing unit. In: 44th International Symposium on Computer Architecture (ISCA), Toronto, Canada, June 2017
Liu, S., Du, Z., Tao, J., Han, D., Luo, T., Xie, Y., et al.: Cambricon: an instruction set architecture for neural networks. In: ACM/IEEE 43rd Annual International Symposium on Computer Architecture (2016)
Neural Processor News: Kirin 970’s Neural Processing Unit and Cambricon, November 2017. https://npu.ai/2017/11/kirin-970s-neural-processing-unit-and-cambricon/
Akopyan, F., Sawada, J., Cassidy, A., Alvarez-Icaza, R., Arthur, J., Merolla, P.: TrueNorth: design and tool flow of a 65 mW 1 million neuron programmable neurosynaptic chip. IEEE Trans. Comput. Aided Des. Integrated Circuits Syst. 34, 1537–1557 (2015). https://doi.org/10.1109/TCAD.2015.2474396
Andres, R., Eden, S., Etay, M., Evarist, F., Young, J.K., Haihao, S., Barukh, Z.: Lower numerical precision Deep Learning inference and training. White paper, Intel, January 2018
Koster, U., Webb, T., Wang, X., Nassar, M., Bansal, A., Constable, W., et al.: Flexpoint: an adaptive numerical format for efficient training of Deep Neural Networks. Intel, December 2017
Schmidhuber, J.: Deep learning in Neural Networks: An overview. Neural Netw. 61, 85–117 (2015). Archieves, Cornell university library
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015). https://doi.org/10.1038/nature14539. Review paper
Mayannavar, S., Wali, U.: Performance comparison of Serial and parallel multipliers in massively parallel environment. In: ICEECCOT-2018, IEEE Xplore Digital Library (2018). (Accepted for publication)
Aparanji, V.M., Wali, U., Aparna, R.: A novel neural network structure for motion control in joints. In: ICEECCOT-2016, IEEE Xplore Digital Library, pp. 227–232, Doc no. 7955220 (2016)
Aparanji, V.M., Wali, U., Aparna, R.: Pathnet: a neuronal model for robotic motion planning. In: 3rd International Conference on Cognitive, Computing and Information Processing (CCIP 2017), Springer CCIS, December 2017
Mayannavar, S., Wali, U.: Hardware implementation of an activation function for neural network processor. In: IEEE Xplore Digital Library, January 2018. (In press)
Reif, J.H.: Complexity of the mover’s problem and generalizations. Department of Computer Science, University of Rochester, Research Report TR58, August 1979
LeCun, Y., Cortes, C., Burges, C.J.C.: The MNIST database of handwritten digits. http://yann.lecun.com/exdb/mnist/
Mayannavar, S., Wali, U.V.: Design of modular processor framework. Int. J. Technol. Sci. (IJTS) IX(1), 36–39 (2016). ISSN (Online) 2350-1111, (Print) 2350-1103
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Mayannavar, S., Wali, U. (2020). Fast Implementation of Tunable ARN Nodes. In: Abraham, A., Cherukuri, A., Melin, P., Gandhi, N. (eds) Intelligent Systems Design and Applications. ISDA 2018 2018. Advances in Intelligent Systems and Computing, vol 941. Springer, Cham. https://doi.org/10.1007/978-3-030-16660-1_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-16660-1_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-16659-5
Online ISBN: 978-3-030-16660-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)