Abstract
After a short introduction to neural networks generally, a more detailed presentation of the structure of a feed forward neural network is done, using mathematical language, functions, matrices and vectors.
Further, emphasis has been made on perceptrons and linear regression done by using ANN. Central concepts like learning, including weight updates, error minimization with gradient descent are introduced and studied using these simple networks. Finally, multilayer perceptrons are defined with their error functions and finally backpropagation are described precisely using composite functions and the concept of error signals.Keywords: Backpropagation, Chain rule, Composite functions, Computing neurons, Feedforward, Matrices, Multiple perceptron, Neural network, Perceptron, Transfer function, Vectors.