Abstract
Artificial neural networks have a wide range of applications. In some applications, specific hardware is necessary when a PC cannot be connected or due to other factors such as speed, price and fault tolerance. The difficulty in producing hardware for neural networks is associated with price, accuracy and development time. Most users also prefer the network trained with a high-level tool without reducing resolution and simplifying the activation function for hardware implementation. This paper proposes an automatic general-purpose neural hardware generator, simple to use, with adjustable accuracy that provides direct hardware implementation for neural networks with FPGAs without further development.
Similar content being viewed by others
References
Abreu S, Freitas F, Baptista FD, Vasconcelos R, Morgado-Dias F (2013) A survey of software and hardware use in artificial neural networks. Neural Comput Appl 23(3–4):591–599
Lippmann RP (1987) An introduction to computing with neural nets. IEEE ASSP Mag 4–22
Morgado Dias F, Antunes A, Mota A (2004) Artificial neural networks: a review of commercial hardware. Eng Appl Artifi Intell 17:945–952
Stieglitz T, Meyer J (2006) Biomedical microdevices for neural implants. Biomems Microsyst 16:71–137
Ferreira P, Ribeiro P, Antunes A, Morgado F (2007) A high bit resolution FPGA implementation of a FNN with a new algorithm for the activation function. Neurocomputing 71(1–3):71–77
Leon M, Castro A, Ascenccio R (1999) An artificial neural network on a field programmable gate array as a virtual sensor. In Proceedings of the third international workshop on design of mixed-mode integrated circuits and applications, Puerto Vallarta, Mexico, pp. 114–117
Ayala JL, Lomena AG, López-Vallejo M, Fernández A (2002) Design of a pipelined hardware architecture for real-time neural network computations. IEEE Midwest Symposium on Circuits and Systems, USA
Soares AM, Pinto JOP, Bose BK, Leite LC, da Silva LEB, Romero ME (2006) Field programmable gate array (FPGA) Based neural network implementation of stator flux oriented vector control of induction motor drive. In: IEEE international conference on industrial technology
Chen X, Wang G, Zhou W, Chang S, Sun S (2006) Efficient sigmoid function for neural networks based FPGA design, ICIC 2006, LNCS 4113, Springer, Berlin p 672–677
Baptista D, Morgado-Dias F (2012) A hyperbolic tangent replacement by third order polynomial approximation. In: CONTROLO’12–10th Portuguese conference on automatic control
Ghariani M, Kharrat MW, Masmoudin N, Kamoun L (2004) Electronic implementation of a neural observer in FPGA technology: application to the control of electric vehicle. In: 16th international conference on microelectronics
Qian M (2006) Application of CORDIC algorithm to neural networks VLSI Design. In: IMACS multiconference on computational engineering in systems applications
Pérez-Suárez ST, Travieso-González CM, Alonso-Hernández JB (2013) Design methodology of an equalizer for unipolar non return to zero binary signals in the presence of additive white gaussian noise using a time delay neural network on a field programmable gate array. Sensors 13(12):16829–16850
Baptista FD, Morgado-Dias F (2013) Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks. Neural Comput Appl 23(3–4):601–607
Nascimento I, Jardim R, Morgado-Dias F (2013) Hyperbolic tangent implementation in hardware: a new solution using polynomial modeling of the fractional exponential part. Neural Comput Appl 23(2):363–369
Le Ly D, Chow P (2010) High-performance reconfigurable hardware architecture for restricted boltzmann machines. IEEE Trans Neural Netw 21(11):1780–1792
Ormondi AR, Rajapakse J (2006) FPGA implementations of neural networks. Springer, New York
Gomperts A, Ukil A, Zurfluh F (2011) Development and implementation of parameterized FPGA based general purpose neural networks for online applications. IEEE Trans Industr Inf 7(1):78–89
Orlowska-Kowalska T, Kaminski M (2011) FPGA implementation of the multilayer neural network for the speed estimation of the two-mass drive system. IEEE Trans Industr Inf 7(3):436–445
Dinu A, Cirstea MN, Cirstea SE (2010) Direct neural-network hardware-implementation algorithm. IEEE Trans Industr Electron 57(5):1845–1848
Oniga S (2005) A new method for FPGA implementation of artificial neural network used in smart devices. In: international computer science conference microCAD, p 31–36
Tisan A, Cirstea M (2013) SOM neural network design: a new simulink library based approach targeting FPGA implementation. Math Comput Simul 91:134–149
Morgado Dias F, Mota A (2009) Direct inverse control of a Kiln. In 4th Portuguese conference on automatic control
Maxfield C (2004) The design warrior’s guide to FPGAs. Elsevier, ISBN 0750676043, New York, USA
MathWorks. URL: http://www.mathworks.com/products/hdl-verifier/description3.html, August 2012
Reis L, Aguiar L, Baptista D, Morgado-Dias F (2011) ANGE-automatic neural generator. International conference on artificial neural network—ICANN’11, Espoo, Finland
Reis L, Aguiar L, Baptista FD, Morgado-Dias F (2013) A software tool for automatic generation of neural hardware. Int Arab J Inf Technol, 11(3)
Wright S, Marwala T (2007) Artificial intelligence techniques for steam generator modelling. School of Electrical and Information Engineering, P/Bag x3, Wits, South Africa
Baptista D, Morgado-Dias F (2012) On the implementation of different hyperbolic tangent solutions in FPGA. In 10th Portuguese conference on automatic control—CONTROLO’12, Funchal, Portugal
Acknowledgments
The authors would like to acknowledge the Portuguese Foundation for Science and Technology for their support for this work through project PEst-OE/EEI/LA0009/2011.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Baptista, F.D., Morgado-Dias, F. Automatic general-purpose neural hardware generator. Neural Comput & Applic 28, 25–36 (2017). https://doi.org/10.1007/s00521-015-2034-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-015-2034-5