Skip to main content
Module gelu
teeny_
core
0.0.0
Module gelu
Module Items
Structs
In teeny_
core::
nn::
activation
teeny_core
::
nn
::
activation
Module
gelu
Copy item path
Source
Expand description
GELU (exact and tanh-approximate).
Structs
ยง
Gelu
GELU (Gaussian Error Linear Unit) activation layer.
Mish
Mish activation layer (
x * tanh(softplus(x))
).