Skip to main content
Log in

Numerical analysis and implementation of artificial neural network algorithm for nonlinear function

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Artificial Neural Network (ANN) architecture contains three main (input, hidden and output) layers. The connections are established between layers through weights and bias. The various simulators are available to implement ANN. But, a knowledge on the numerical investigation and application of ANN for arbitrary values related by a nonlinear function is essential for the better understanding of a nature-inspired algorithm. Hence, the present manuscript provides the mathematical implementation of an algorithm for known values of independent and dependent variables, with and without bias. The predictability of ANN was assessed by a statistical parameter, mean squared error (MSE). The MSE by ANN algorithm was found to be higher (0.008) without bias than with bias for arbitrary values of independent and dependent variables. Hence, it could be concluded that the bias reduces error and enhances the predictability .

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Adel A, Salah K (2016). Model order reduction using artificial neural networks. In 2016 IEEE International Conference on Electronics, Circuits and Systems (ICECS), 89–92. IEEE

  2. Ahmad F, Isa NAM, Hussain Z, Osman MK, Sulaiman SN (2015) A GA-based feature selection and parameter optimization of an ANN in diagnosing breast cancer. Pattern Anal Appl 18(4):861–870

    Article  MathSciNet  Google Scholar 

  3. Anderson JA (1972) A simple neural network generating an interactive memory. Math Biosci 14(3–4):197–220

    Article  Google Scholar 

  4. Baharev A, Domes F, Neumaier A (2017) A robust approach for finding all well-separated solutions of sparse systems of nonlinear equations. Numer Algor 76(1):163–189

    Article  MathSciNet  Google Scholar 

  5. Dudzik M, Stręk AM (2020) ANN architecture specifications for modelling of Open-Cell Aluminum under compression. Math Probl Eng 2020:2834317. https://doi.org/10.1155/2020/2834317

  6. Durbin R, Rumelhart DE (1989) Product units: A computationally powerful and biologically plausible extension to backpropagation networks. Neural Comput 1(1):133–142

    Article  Google Scholar 

  7. Farley BG, Clark WA (1954) Simulation of self-organizing systems by digital computer. IEEE Trans Inf Theory 4(4):76–84

    MathSciNet  Google Scholar 

  8. Freitas JD, Niranjan M, Gee AH, Doucet A (2000) Sequential Monte Carlo methods to train neural network models. Neural Comput 12(4):955–993

    Article  Google Scholar 

  9. Ghiassi M, Saidane H (2005) A dynamic architecture for artificial neural networks. Neurocomputing 63:397–413

    Article  Google Scholar 

  10. Grillo SA (2019) A linear relation between input and first layer in neural networks. Ann Math Artif Intel 87(4):361–372

    Article  MathSciNet  Google Scholar 

  11. Guzmán-Ramírez E, Garcia I, García-Juárez M (2019) A “learning by design” application for modeling, implementing, and evaluating hardware architectures for artificial neural networks at undergraduate level. Comput Appl Eng Educ 27(5):1236–1252

    Article  Google Scholar 

  12. Hebb D (1949) The organization of behavior. Wiley, New York

    Google Scholar 

  13. Heinze-Deml C, Peters J, Meinshausen N (2018) Invariant causal prediction for nonlinear models. J Causal Inference 6(2):20170016. https://doi.org/10.1515/jci-2017-0016

  14. Ivakhnenko AG, Lapa VG (1967) Cybernetics and forecasting techniques. American Elsevier Pub. Co., USA

    Google Scholar 

  15. Margaris A, Adamopoulos M (2007) Solving nonlinear algebraic systems using artificial neural networks. In Proceedings of the 10th International Conference on Engineering Applications of Artificial Neural Networks, 107–120

  16. McCulloch W, Pitts W (1943) A logical calculus of ideas immanent in nervous activity. Bull Math Biol 5(4):115–133

    MathSciNet  MATH  Google Scholar 

  17. Patil S, Patil KR, Patil CR, Patil SS (2018) Performance overview of an artificial intelligence in biomedics: a systematic approach. Int J Inf Technol 12:963–973

  18. Rosenblatt F (1958) The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386–408

    Article  Google Scholar 

  19. San O, Maulik R (2018) Neural network closures for nonlinear model order reduction. Adv Comput Math 44(6):1717–1750

    Article  MathSciNet  Google Scholar 

  20. Vaidyanathan S, Pehlivan I, Dolvis LG, Jacques K, Alcin M, Tuna M, Koyuncu I (2020) A novel ANN-based four-dimensional two-disk hyperchaotic dynamical system, bifurcation analysis, circuit realisation and FPGA-based TRNG implementation. Int J Comput Appl Technol 62(1):20–35

    Article  Google Scholar 

  21. Venkadesan A (2021) Harmonic current estimation of a non-linear load using artificial neural network. Intelligent paradigms for smart grid and renewable energy systems. Springer, Singapore, pp 337–359

    Chapter  Google Scholar 

  22. Vrabie D, Lewis F (2009) Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems. Neural Netw 22(3):237–246

    Article  Google Scholar 

  23. Wu HN, Luo B (2012) Neural network based online simultaneous policy update algorithm for solving the HJI equation in nonlinear H control. IEEE Trans Neural Netw Learning Syst 23(12):1884–1895

    Article  Google Scholar 

  24. Yuste R, Denk W (1995) Dendritic spines as basic functional units of neuronal integration. Nature 375(6533):682–684

    Article  Google Scholar 

  25. Zhang L (2017) Artificial neural network model design and topology analysis for FPGA implementation of Lorenz chaotic generator. In 2017 IEEE 30th Canadian conference on electrical and computer engineering (CCECE), 1–4. IEEE

Download references

Acknowledgements

We would acknowledge our heartfelt thanks to the Management of Salalah College of Technology, Oman, for the wonderful opportunity, continuing support and encouragement for writing the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Selvaraju Sivamani.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, P.S., Sivamani, S. Numerical analysis and implementation of artificial neural network algorithm for nonlinear function. Int. j. inf. tecnol. 13, 2059–2068 (2021). https://doi.org/10.1007/s41870-021-00743-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-021-00743-6

Keywords

Navigation