ggmlR (version 0.6.1)

ag_batch_norm: Create a Batch Normalisation layer

Description

Normalises each feature (row) over the batch dimension. Learnable scale gamma [F,1] and shift beta [F,1].

Usage

ag_batch_norm(num_features, eps = 1e-05, momentum = 0.1)

Value

An ag_batch_norm environment

Arguments

num_features

Number of features (rows of input)

eps

Numerical stability constant (default 1e-5)

momentum

Running-stats momentum (default 0.1)

Details

Training mode: use batch statistics; update running mean/var. Eval mode: use stored running statistics.

Examples

# \donttest{
bn <- ag_batch_norm(16L)
x  <- ag_tensor(matrix(rnorm(16 * 32), 16, 32))
out <- bn$forward(x)
# }