Expand description
Sigmoid and related activations.
Structsยง
- Logsigmoid
- Log-sigmoid activation layer:
ln(sigmoid(x)). - Sigmoid
- Sigmoid activation layer:
1 / (1 + e^-x). - Silu
- SiLU/Swish activation layer:
x * sigmoid(x).
Sigmoid and related activations.
ln(sigmoid(x)).1 / (1 + e^-x).x * sigmoid(x).