Sigmoid Activation Function $$\sigma(x) = \frac{1}{1 + e^{-x}}.$$ Tanh Activation Function $$\sigma(x) = tanh(x).$$ Linear Activation Function $$\sigma(x) = x.$$
