ggmlR (version 0.6.1)

optimizer_adam: Create an Adam optimizer

Description

Create an Adam optimizer

Usage

optimizer_adam(params, lr = 0.001, beta1 = 0.9, beta2 = 0.999, eps = 1e-08)

Value

An optimizer environment

Arguments

params

Named list of ag_param tensors

lr

Learning rate (default 1e-3)

beta1

First moment decay (default 0.9)

beta2

Second moment decay (default 0.999)

eps

Stability constant (default 1e-8)

Examples

# \donttest{
w <- ag_param(matrix(runif(4), 2, 2))
opt <- optimizer_adam(list(w = w), lr = 1e-3)
# }