torch (version 0.3.0)

nn_leaky_relu: LeakyReLU module

Description

Applies the element-wise function:

Usage

nn_leaky_relu(negative_slope = 0.01, inplace = FALSE)

Arguments

negative_slope

Controls the angle of the negative slope. Default: 1e-2

inplace

can optionally do the operation in-place. Default: FALSE

Shape

• Input: $(N,\ast )$ where * means, any number of additional dimensions

• Output: $(N,\ast )$, same shape as the input

Details

$$\text{LeakyReLU}(x)=max(0,x)+\text{negative\_slope}\ast min(0,x)$$ or

$$\text{LeakyRELU}(x)=\{\begin{array}{ll}x,& \text{ if }x\ge 0\\ \text{negative\_slope}\times x,& \text{ otherwise }\end{array}$$

Examples

# NOT RUN {
if (torch_is_installed()) {
m <- nn_leaky_relu(0.1)
input <- torch_randn(2)
output <- m(input)

}
# }