pivot_scores

Pivots a set of scores into a matrix with one row per forecast unit
(excluding the <code>compare</code> column) and one column per comparator. Entries
are the values of <code>metric</code> and are <code>NA</code> where a comparator did not
provide a forecast for a given forecast unit.
The function is used by <code>pairwise_comparison_one_group()</code> to align the
scores of all comparators once, rather than once per pair of comparators.
Exact duplicate rows are dropped silently; rows that share a forecast
unit and comparator but are not otherwise identical raise an error, as
the scores could then not be pivoted unambiguously.

internal

Facilitate the evaluation of forecasts in a convenient
framework based on data.table. It allows user to to check their forecasts
and diagnose issues, to visualise forecasts and missing data, to transform
data before scoring, to handle missing forecasts, to aggregate scores, and
to visualise the results of the evaluation. The package mostly focuses on
the evaluation of probabilistic forecasts and allows evaluating several
different forecast types and input formats. Find more information about the
package in the Vignettes as well as in the accompanying paper,
<doi:10.48550/arXiv.2205.07090>.

Nikos Bosse

scoringutils

Utilities for Scoring and Assessing Predictions

Sam Abbott

Hugo Gruson

Johannes Bracher

Toshiaki Asakura 

James Mba Azam

Sebastian Funk

Michael Chirico

pivot_scores function

<dl><dt>scores</dt>
<dd>An object of class <code>scores</code> (a data.table with
scores and an additional attribute <code>metrics</code> as produced by <code>score()</code>).</dd>
<dt>compare</dt>
<dd>Character vector with a single colum name that defines the
elements for the pairwise comparison. For example, if this is set to
"model" (the default), then elements of the "model" column will be
compared.</dd>
<dt>metric</dt>
<dd>A string with the name of the metric to pivot. Unlike in
<code>get_pairwise_comparisons()</code>, there is no default: the caller must
supply a single metric present in <code>scores</code>.</dd></dl>

Arguments

Pivot scores into a forecast unit by comparator matrix — pivot_scores

<dl>

<dt>scores</dt>
<dd>An object of class <code>scores</code> (a data.table with
scores and an additional attribute <code>metrics</code> as produced by <code>score()</code>).</dd>


<dt>compare</dt>
<dd>Character vector with a single colum name that defines the
elements for the pairwise comparison. For example, if this is set to
"model" (the default), then elements of the "model" column will be
compared.</dd>


<dt>metric</dt>
<dd>A string with the name of the metric to pivot. Unlike in
<code>get_pairwise_comparisons()</code>, there is no default: the caller must
supply a single metric present in <code>scores</code>.</dd>

</dl>

Pivot scores into a forecast unit by comparator matrix

pivot_scores: Pivot scores into a forecast unit by comparator matrix

Description

Usage

Value

Arguments