luz_callback_mixed_precision

This callback will enable <code>torch::local_autocast()</code> training model forward
and during loss computation. It will then disable autocast and scale the loss
before <code>backward()</code> and <code>opt$step()</code>. See <a href="https://torch.mlverse.org/docs/articles/amp.html">here</a>
for more information.

A high level interface for 'torch' providing utilities to reduce the
the amount of code needed for common tasks, abstract away torch details and
make the same code work on both the 'CPU' and 'GPU'. It's flexible enough to
support expressing a large range of models. It's heavily inspired by 'fastai' by
Howard et al. (2020) <doi:10.48550/arXiv.2002.04688>, 'Keras' by Chollet et al. (2015) and
'PyTorch Lightning' by Falcon et al. (2019) <doi:10.5281/zenodo.3828935>.

Daniel Falbel

Higher Level 'API' for 'torch'

Christophe Regouby

 RStudio

luz_callback_mixed_precision function

<dl><dt>...</dt>
<dd>Passed to <code>torch::cuda_amp_grad_scaler()</code>.</dd></dl>

Arguments

This callback will enable <code>torch::local_autocast()</code> training model forward
and during loss computation. It will then disable autocast and scale the loss
before <code>backward()</code> and <code>opt$step()</code>. See <a href='https://torch.mlverse.org/docs/articles/amp.html'>here</a>
for more information.

Automatic Mixed Precision callback — luz_callback_mixed_precision

<dl>

<dt>...</dt>
<dd>Passed to <code>torch::cuda_amp_grad_scaler()</code>.</dd>

</dl>

luz_callback_mixed_precision: Automatic Mixed Precision callback

Description

Usage

Value

Arguments

See Also