exprso (version 0.1.7)

calcMonteCarlo: Calculate plMonteCarlo Performance

Description

calcMonteCarlo calculates a single performance measure for the results of a plMonteCarlo function call.

Usage

calcMonteCarlo(pl, colBy)

Arguments

pl
Specifies the ExprsPipeline object returned by plMonteCarlo.
colBy
A character vector or string. Specifies column(s) to use when summarizing classifier performance. Listing multiple columns will calculate performance as a product of those listed performances.

Value

A numeric scalar. The cross-validation accuracy.

Details

For each dataset split (i.e., bootstrap), calcMonteCarlo averages the validation set performance for the "best" model (where "best" is defined as the model with the maximum "internal" cross-validation accuracy, max($train.plCV)). The validation set performance ultimately averaged depends on the supplied colBy argument.