Functions of Activation in Neural Networks
Abstract
Artificial Neural Networks are inspired from the human brain and the network of neurons present in the brain. The information is processed and passed on from one neuron to another through neuro synaptic junctions. Similarly, in artificial neural networks there are different layers of cells arranged and connected to each other. The output/information from the inner layers of the neural network are passed on to the next layers and finally to the outermost layer which gives the output. The input to the outer layer is provided non-linearity to inner layers’ output so that it can be further processed. In an Artificial Neural Network, activation functions are very important as they help in learning and making sense of nonlinear and complicated mappings between the inputs and corresponding outputs.
Keywords
Functions, Activation, Neural Networks, Mappings, One Neuron to Another Through Neuro Synaptic Junctions.