Skip to main contentModule hard
Source - HardshrinkBackward
- Backward: dx = dy if |x| > lambda else 0
- HardshrinkForward
- Forward: y = x if |x| > lambda else 0
- HardshrinkForwardDispatch
- Forward: y = x if |x| > lambda else 0
- HardshrinkOp
- HardsigmoidBackward
- Backward: dx = dy/6 if |x| < 3 else 0
- HardsigmoidForward
- Forward: y = clamp((x + 3) / 6, 0, 1)
- HardsigmoidForwardDispatch
- Forward: y = clamp((x + 3) / 6, 0, 1)
- HardsigmoidOp
- HardswishBackward
- Backward:
dx = 0 if x <= -3
dx = dy if x >= 3
dx = dy*(2x+3)/6 otherwise
- HardswishForward
- Forward: y = x * clamp((x + 3) / 6, 0, 1)
- HardswishForwardDispatch
- Forward: y = x * clamp((x + 3) / 6, 0, 1)
- HardswishOp
- HardtanhBackward
- Backward: dx = dy if min_val < x < max_val else 0
- HardtanhForward
- Forward: y = clamp(x, min_val, max_val)
- HardtanhForwardDispatch
- Forward: y = clamp(x, min_val, max_val)
- HardtanhOp
- Relu6Backward
- Backward: dx = dy if 0 < x < 6 else 0
- Relu6Forward
- Forward: y = clamp(x, 0, 6)
- Relu6ForwardDispatch
- Forward: y = clamp(x, 0, 6)
- Relu6Op
- hardshrink_backward
- Backward: dx = dy if |x| > lambda else 0
- hardshrink_forward
- Forward: y = x if |x| > lambda else 0
- hardsigmoid_backward
- Backward: dx = dy/6 if |x| < 3 else 0
- hardsigmoid_forward
- Forward: y = clamp((x + 3) / 6, 0, 1)
- hardswish_backward
- Backward:
dx = 0 if x <= -3
dx = dy if x >= 3
dx = dy*(2x+3)/6 otherwise
- hardswish_forward
- Forward: y = x * clamp((x + 3) / 6, 0, 1)
- hardtanh_backward
- Backward: dx = dy if min_val < x < max_val else 0
- hardtanh_forward
- Forward: y = clamp(x, min_val, max_val)
- relu6_backward
- Backward: dx = dy if 0 < x < 6 else 0
- relu6_forward
- Forward: y = clamp(x, 0, 6)