Advertisement

Parameter Optimization in Convolutional Neural Networks Using Gradient Descent

  • Swaleha ZubairEmail author
  • Anjani Kumar Singha
Conference paper

Abstract

The aim of the present study is to develop an algorithm by exploring the basic structure and functional operation of convolution neural network's (CNN) design as well as the features of back propagation (BP) and gradient descent (GD). The hierarchical approach employing BP and GD offers a reliable form of an algorithm. Most of the algorithms share weight to minimize the size of parameter and cost function that can be joined with the BP and the GD. Backpropagation provides an opportunity for backward feedback to enhance the reliability with minimizing error, while the gradient descent is used to solve the issues related with deep learning as well as the machine learning algorithms.

Keywords

Convolution neural networks (CNN) Backpropagation (BP) Gradient descent (GD) 

References

  1. 1.
    McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervousactivity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bottou, L.: Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’, pp. 177–186 (2010)CrossRefGoogle Scholar
  3. 3.
    LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2016)CrossRefGoogle Scholar
  4. 4.
    Chauvin, Y., Rumelhart, D.E.: Backpropagation: Theory, Architectures, and Applications. Psychology Press (2013)Google Scholar
  5. 5.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization (2014). arXiv:1412.6980
  6. 6.
    Agarwal, B., Ramampiaro, H., Langseth, H., Ruocco, M.: A deep network model for paraphrase detection in short text messages. Inf. Process. Manag. Elsevier 54(6), 922–937 (2018)CrossRefGoogle Scholar
  7. 7.
    Jain, G., Sharma, M., Agarwal, B.: Spam detection in social media using convolutional and long short term memory neural network. Ann. Math. Artif. Intell. Springer (2019).  https://doi.org/10.1007/s10472-018-9612-zCrossRefzbMATHGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Aligarh Muslim UniversityAligarhIndia

Personalised recommendations