Sigmoid function is often used as an activation function in neural network. In this tutorial, we will introduce the properties and derivative of this function.
What is sigmoid function?
The equation of sigmoid function is:
The graph of sigmoid function is:
The properties of sigmoid function
There are some important properties, they are:
1. The value range
The derivative of the sigmoid function
The derivative is:
The graph of derivative is:
How to compute sigmoid value?
In tensorflow, we can use tf.sigmoid() function to compute the sigmoid value of a tensor. Here is the tutorial: