Skip to main content

FPGA Implementation of Neuron Model Using Piecewise Nonlinear Function on Double-Precision Floating-Point Format

  • 2225 Accesses

Part of the Lecture Notes in Computer Science book series (LNAI,volume 9799)

Abstract

The artificial neurons model has been implemented in a field programmable gate array (FPGA). The neuron model can be applied to learning, training of neural networks; all data types are 64 bits, and first and second-order functions is employed to approximate the sigmoid function. The constant values of the model are tuned to provide a sigmoid-like approximate function which is both continuous and continuously differentiable. All data types of the neuron are corresponding to double precision in C language. The neuron implementation is expressed in 48-stage pipeline. Assessment with an Altera Cyclone IV predicts an operating speed of 85 MHz. Simulation of 4 neurons neural network on FPGA obtained chaotic behavior. An FPGA output chaos influenced by calculation precision and characteristics of the output function. The circuit is the estimation that above 1,000 neurons can implement in Altera Cyclone IV. It shows the effectiveness of this FPGA model to have obtained the chaotic behavior where nonlinearity infuences greatly. Therefore, this model shows wide applied possibility.

Keywords

  • Artificial neurons model
  • Field programmable gate array (FPGA)
  • Sigmoid function
  • Chaotic behavior
  • Piecewise nonlinear function

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-42007-3_54
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-319-42007-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   149.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

References

  1. Russell, B., Tom, B.: Neural Computing: An Introduction. Adam Hilger, Bristol (1990)

    Google Scholar 

  2. Fredric, M.H., Ivica, K.: Principles of Neurocomputing for Science & Engineering. McGraw-Hill, Singapore (2000)

    Google Scholar 

  3. Sandhya, S.: Neural Networks for Applied Sciences and engineering. Auerbach Publications, New York (2006)

    MATH  Google Scholar 

  4. Rafael G., Joaquin C., Joaquin C., Francisco B., Francisco B., Antonio M.S., Antonio M.S.: Artificial neural network implementation on a single FPGA of a pipelined on-line backpropagation. In: Proceedings of the 13th International Symposium on System Synthesis, pp. 225–230 (2000)

    Google Scholar 

  5. Kwan, H.K., Tang, C.Z.: Multiplierless multilayer feedforward neural network design using quantised neurons. Electron. Lett. 38(13), 645–646 (2002)

    CrossRef  Google Scholar 

  6. Basterretxea, K., Tarela, J.M., del Campo, I.: Digital design of sigmoid approximator for artificial neural networks. Electron. Lett. 38(1), 35–37 (2002)

    CrossRef  Google Scholar 

  7. Sledevic, T., Navakauskas, D.: The lattice-ladder neuron and its training circuit implementation in FPGA. In: 2014 IEEE 2nd Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–4 (2014)

    Google Scholar 

  8. Abrol, S., Mahajan, R.: Implementation of single artificial neuron using various activation functions and XOR Gate on FPGA chip. In: 2015 Second International Conference on, Advances in Computing and Communication Engineering (ICACCE), pp. 118–123 (2015)

    Google Scholar 

  9. Kawamura, S., Nakanishi, T., Yoshida, H., Ozeki, K., Fujimaki, K., Gotoh, R.: Studies on the accuracy of numerical operations with embedded CPUs. IEICE Electron. Express 3(8), 149–155 (2006)

    CrossRef  Google Scholar 

  10. Kawamura, S., Yoshida, H., Miura, M.: Minimum constituents of chaos neural network composed of conventional neurons. Electron. Commun. Jpn. Part III 86(7), 62–71 (2003)

    CrossRef  Google Scholar 

  11. Yoshida, H., Murakami, T., Zhongda, L.: High-speed and highly secure pseudo-random number generator based on chaos neural network. Front. Artif. Intell. Appl. 276, 224–237 (2015)

    Google Scholar 

  12. Rukhin, A., Soto, J., Nechvatal, J., Smid, M., Barker, E., Leigh, S., Levenson, M., Vangel, M., Banks, D., Heckert, A., Dray, J., Vo, S.: A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications, NIST SP800-22 rev.1a, Revised: July 2015 (sts-2.1.1). Lawrence E. Bassham III (2015)

    Google Scholar 

  13. Mario, M.: Introduction to Discrete Dynamical Systems and Chaos. Wiley InterScience, New York (1999)

    MATH  Google Scholar 

  14. Henry, D.I.A.: Analysis of Observed Chaotic Data. Springer, New York (1997)

    Google Scholar 

Download references

Acknowledgments

This study was supported by a grant from the Yume-Kendo Dream-Land Iwate Foundation of the Iwate Prefecture. We thanks to Dr. Takeshi Murakami for his support who participated in the experiment. The calculations in this study have partly performed with the SGI UV-100 in Iwate University Super-Computing and Information Sciences Center (ISIC). Special thanks to the stuff members of ISIC.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Satoshi Kawamura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kawamura, S., Saito, M., Yoshida, H. (2016). FPGA Implementation of Neuron Model Using Piecewise Nonlinear Function on Double-Precision Floating-Point Format. In: Fujita, H., Ali, M., Selamat, A., Sasaki, J., Kurematsu, M. (eds) Trends in Applied Knowledge-Based Systems and Data Science. IEA/AIE 2016. Lecture Notes in Computer Science(), vol 9799. Springer, Cham. https://doi.org/10.1007/978-3-319-42007-3_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42007-3_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42006-6

  • Online ISBN: 978-3-319-42007-3

  • eBook Packages: Computer ScienceComputer Science (R0)