Structs§
- Elemwise
AbsBackward - Backward: dx = sign(x) * dy where sign = 1 if x>0, -1 if x<0, 0 if x==0
- Elemwise
AbsForward - Forward: y = |x|
- Elemwise
Acos Backward - Backward: dx = -dy / sqrt(1 - x^2)
- Elemwise
Acos Forward - Forward: y = acos(x) = pi/2 - atan(x / sqrt(1 - x^2))
- Elemwise
Acosh Backward - Backward: dx = dy / sqrt(x^2 - 1)
- Elemwise
Acosh Forward - Forward: y = acosh(x) = log(x + sqrt(x^2 - 1))
- Elemwise
Asin Backward - Backward: dx = dy / sqrt(1 - x^2)
- Elemwise
Asin Forward - Forward: y = asin(x) = atan(x / sqrt(1 - x^2))
- Elemwise
Asinh Backward - Backward: dx = dy / sqrt(x^2 + 1)
- Elemwise
Asinh Forward - Forward: y = asinh(x) = log(x + sqrt(x^2 + 1))
- Elemwise
Atan Backward - Backward: dx = dy / (1 + x^2)
- Elemwise
Atan Forward - Forward: y = atan(x)
- Elemwise
Atanh Backward - Backward: dx = dy / (1 - x^2)
- Elemwise
Atanh Forward - Forward: y = atanh(x) = log((1+x)/(1-x)) / 2
- Elemwise
Ceil Forward - Forward: y = ceil(x)
- Elemwise
CosBackward - Backward: dx = -sin(x) * dy
- Elemwise
CosForward - Forward: y = cos(x)
- Elemwise
Cosh Backward - Backward: dx = sinh(x) * dy
- Elemwise
Cosh Forward - Forward: y = cosh(x) = (exp(x) + exp(-x)) / 2
- Elemwise
ErfBackward - Backward: dx = 2/sqrt(pi) * exp(-x^2) * dy where 2/sqrt(pi) ~= 1.1283791670955126
- Elemwise
ErfForward - Forward: y = erf(x)
- Elemwise
ExpBackward - Backward: dx = exp(x) * dy
- Elemwise
ExpForward - Forward: y = exp(x)
- Elemwise
Floor Forward - Forward: y = floor(x)
- Elemwise
Isnan Forward - Forward: y = 1.0 if x is NaN else 0.0
- Elemwise
LogBackward - Backward: dx = dy / x
- Elemwise
LogForward - Forward: y = log(x)
- Elemwise
NegBackward - Backward: dx = -dy
- Elemwise
NegForward - Forward: y = -x
- Elemwise
Reciprocal Backward - Backward: dx = -dy / x^2
- Elemwise
Reciprocal Forward - Forward: y = 1 / x
- Elemwise
Sign Forward - Forward: y = 1 if x > 0, -1 if x < 0, 0 if x == 0
- Elemwise
SinBackward - Backward: dx = cos(x) * dy
- Elemwise
SinForward - Forward: y = sin(x)
- Elemwise
Sinh Backward - Backward: dx = cosh(x) * dy
- Elemwise
Sinh Forward - Forward: y = sinh(x) = (exp(x) - exp(-x)) / 2
- Elemwise
Sqrt Backward - Backward: dx = dy / (2 * sqrt(x))
- Elemwise
Sqrt Forward - Forward: y = sqrt(x)
- Elemwise
TanBackward - Backward: dx = (1 + tan^2(x)) * dy
- Elemwise
TanForward - Forward: y = tan(x) = sin(x) / cos(x)
Functions§
- elemwise_
abs_ backward - Backward: dx = sign(x) * dy where sign = 1 if x>0, -1 if x<0, 0 if x==0
- elemwise_
abs_ forward - Forward: y = |x|
- elemwise_
acos_ backward - Backward: dx = -dy / sqrt(1 - x^2)
- elemwise_
acos_ forward - Forward: y = acos(x) = pi/2 - atan(x / sqrt(1 - x^2))
- elemwise_
acosh_ backward - Backward: dx = dy / sqrt(x^2 - 1)
- elemwise_
acosh_ forward - Forward: y = acosh(x) = log(x + sqrt(x^2 - 1))
- elemwise_
asin_ backward - Backward: dx = dy / sqrt(1 - x^2)
- elemwise_
asin_ forward - Forward: y = asin(x) = atan(x / sqrt(1 - x^2))
- elemwise_
asinh_ backward - Backward: dx = dy / sqrt(x^2 + 1)
- elemwise_
asinh_ forward - Forward: y = asinh(x) = log(x + sqrt(x^2 + 1))
- elemwise_
atan_ backward - Backward: dx = dy / (1 + x^2)
- elemwise_
atan_ forward - Forward: y = atan(x)
- elemwise_
atanh_ backward - Backward: dx = dy / (1 - x^2)
- elemwise_
atanh_ forward - Forward: y = atanh(x) = log((1+x)/(1-x)) / 2
- elemwise_
ceil_ forward - Forward: y = ceil(x)
- elemwise_
cos_ backward - Backward: dx = -sin(x) * dy
- elemwise_
cos_ forward - Forward: y = cos(x)
- elemwise_
cosh_ backward - Backward: dx = sinh(x) * dy
- elemwise_
cosh_ forward - Forward: y = cosh(x) = (exp(x) + exp(-x)) / 2
- elemwise_
erf_ backward - Backward: dx = 2/sqrt(pi) * exp(-x^2) * dy where 2/sqrt(pi) ~= 1.1283791670955126
- elemwise_
erf_ forward - Forward: y = erf(x)
- elemwise_
exp_ backward - Backward: dx = exp(x) * dy
- elemwise_
exp_ forward - Forward: y = exp(x)
- elemwise_
floor_ forward - Forward: y = floor(x)
- elemwise_
isnan_ forward - Forward: y = 1.0 if x is NaN else 0.0
- elemwise_
log_ backward - Backward: dx = dy / x
- elemwise_
log_ forward - Forward: y = log(x)
- elemwise_
neg_ backward - Backward: dx = -dy
- elemwise_
neg_ forward - Forward: y = -x
- elemwise_
reciprocal_ backward - Backward: dx = -dy / x^2
- elemwise_
reciprocal_ forward - Forward: y = 1 / x
- elemwise_
sign_ forward - Forward: y = 1 if x > 0, -1 if x < 0, 0 if x == 0
- elemwise_
sin_ backward - Backward: dx = cos(x) * dy
- elemwise_
sin_ forward - Forward: y = sin(x)
- elemwise_
sinh_ backward - Backward: dx = cosh(x) * dy
- elemwise_
sinh_ forward - Forward: y = sinh(x) = (exp(x) - exp(-x)) / 2
- elemwise_
sqrt_ backward - Backward: dx = dy / (2 * sqrt(x))
- elemwise_
sqrt_ forward - Forward: y = sqrt(x)
- elemwise_
tan_ backward - Backward: dx = (1 + tan^2(x)) * dy
- elemwise_
tan_ forward - Forward: y = tan(x) = sin(x) / cos(x)