Expand description
“Hard” (piecewise-linear) activation approximations: hardtanh, hardsigmoid, hardswish.
Structs§
- Hardshrink
- Hardshrink activation layer: zeroes values in
[-lambda, lambda]. - Hardsigmoid
- Hard-sigmoid activation layer: a piecewise-linear sigmoid approximation.
- Hardswish
- Hard-swish activation layer: a piecewise-linear swish approximation.
- Hardtanh
- Hardtanh activation layer: clamps input to
[min_val, max_val]. - Relu6
- ReLU6 activation layer:
min(max(0, x), 6).