In this chapter, we will discuss the basic architecture of neural networks including activation functions, forward propagation, and backpropagation. We will also create a simple neural network model from scratch using the sigmoid activation function. In particular, this chapter will discuss:
Neural network architecture.
Activation functions used in neural networks.
Loss function of neural networks.
© Springer Nature Singapore Pte Ltd. 2019