Sigmoid Function

Also known as · Sigmoid

The function σ(z)=1/(1+e−z)\sigma(z) = 1/(1+e^{-z}) that squashes any real number into the range from 0 to 1 so it can be read as a probability.

When to use

It is what turns the linear score of Logistic Regression into a probability, classified as 1 if above 0.5 (the threshold is tunable). Key values: σ(0)=0.5\sigma(0) = 0.5, σ(2)≈0.88\sigma(2) \approx 0.88, σ(−2)≈0.12\sigma(-2) \approx 0.12. In Lecture 8 it is the output-layer activation of the network.

See DS Lec 3.

Appears in