Module tanh

Structs§

TanhBackward: Backward: dx = dy * (1 - y²) — sech²(x) expressed via saved output
TanhForward: Forward: y = tanh(x) = 2*sigmoid(2x) - 1 = 2/(1+exp(-2x)) - 1
TanhForwardDispatch: Forward: y = tanh(x) = 2*sigmoid(2x) - 1 = 2/(1+exp(-2x)) - 1
TanhOp
TanhshrinkBackward: Backward: dx = dy * tanh²(x) Since y = x - tanh(x), we have tanh(x) = x - y, so tanh²(x) = (x-y)².
TanhshrinkForward: Forward: y = x - tanh(x)
TanhshrinkForwardDispatch: Forward: y = x - tanh(x)
TanhshrinkOp

tanh_backward: Backward: dx = dy * (1 - y²) — sech²(x) expressed via saved output
tanh_forward: Forward: y = tanh(x) = 2*sigmoid(2x) - 1 = 2/(1+exp(-2x)) - 1
tanhshrink_backward: Backward: dx = dy * tanh²(x) Since y = x - tanh(x), we have tanh(x) = x - y, so tanh²(x) = (x-y)².
tanhshrink_forward: Forward: y = x - tanh(x)