irace (version 3.1)

target.evaluator.default: target.evaluator.default

Description

target.evaluator.default is the default targetEvaluator function that is invoked if targetEvaluator is a string (by default targetEvaluator is NULL and this function is not invoked). You can use it as an advanced example of how to create your own targetEvaluator function.

Usage

target.evaluator.default(experiment, num.configurations, all.conf.id, scenario,
  target.runner.call)

Arguments

experiment

A list describing the experiment. It contains at least:

  • id.configurationAn alphanumeric string that uniquely identifies a configuration;

  • id.instanceAn alphanumeric string that uniquely identifies an instance;

  • seedSeed for the random number generator to be used for this evaluation, ignore the seed for deterministic algorithms;

  • instanceString giving the instance to be used for this evaluation;

  • bound(only when capping is enabled) Time bound for the execution;

  • configuration1-row data frame with a column per parameter name;

  • switchesVector of parameter switches (labels) in the order of parameters used in configuration.

num.configurations

Number of configurations alive in the race.

all.conf.id

Vector of configuration IDs of the alive configurations.

scenario

Options passed when invoking irace.

target.runner.call

String describing the call to targetRunner that corresponds to this call to targetEvaluator. This is used for providing extra information to the user, for example, in case targetEvaluator fails.

Value

The function targetEvaluator must return a list with one element "cost", the numerical value corresponding to the cost measure of the given configuration on the given instance.

The return list may also contain the following optional elements that are used by irace for reporting errors in targetEvaluator:

  • erroris a string used to report an error;

  • outputRawis a string used to report the raw output of calls to an external program or function;

  • callis a string used to report how targetRunner called an external program or function.