activation_softshrink: Softshrink
Description
Soft shrink function.
Usage
activation_softshrink(x, lower = -0.5, upper = 0.5)
Arguments
x
A `Tensor`. Must be one of the following types: `float16`, `float32`, `float64`.
lower
`float`, lower bound for setting values to zeros.
upper
`float`, upper bound for setting values to zeros. Returns: A `Tensor`. Has the same type as `x`.
Value
A `Tensor`. Has the same type as `x`.
Computes soft shrink function
`x - lower if x < lower, x - upper if x > upper else 0`.
Details
Computes soft shrink function:
`x - lower if x < lower, x - upper if x > upper else 0`.