generate_data.Heatmaps: Nevergrad-dashboard based algorithm comparison
Description
This procedure calculates the fraction of times algorithm A is better than
algorithm B according to their mean on each function,dimension,target tuple
Usage
generate_data.Heatmaps(dsList, which = "by_FV", target_dt = NULL)
Value
A matrix containing the pairwise win-ratios.
Arguments
dsList
The DataSetList, can contain multiple functions and dimensions, but should have the
same algorithms for all of them. For functions/dimensions where this is not the case,
all algorithms are considered tied.
which
Whether to use fixed-target ('by_FV') or fixed-budget ('by_RT') perspective
target_dt
Custom data.table target value to use. When NULL, this is selected automatically.