MachineShop (version 2.0.0)

performance_curve: Performance Curves

Description

Curves for the analysis of tradeoffs between metrics for assessing performance in classifying binary outcomes over the range of possible cutoff probabilities. Available curves include receiver operating characteristic (ROC) and precision recall.

Usage

performance_curve(x, ...)
# S3 method for default
performance_curve(
  x,
  y,
  metrics = c(MachineShop::tpr, MachineShop::fpr),
  na.rm = TRUE,
  ...
)
# S3 method for Resamples
performance_curve(
  x,
  metrics = c(MachineShop::tpr, MachineShop::fpr),
  na.rm = TRUE,
  ...
)

Arguments

x

observed responses or resample result containing observed and predicted responses.

...

arguments passed to other methods.

y

predicted responses if not contained in x.

metrics

list of two performance metrics for the analysis [default: ROC metrics]. Precision recall curves can be obtained with c(precision, recall).

na.rm

logical indicating whether to remove observed or predicted responses that are NA when calculating metrics.

Value

Curves class object that inherits from data.frame.

See Also

auc, c, plot, summary

Examples

# NOT RUN {
library(MASS)

res <- resample(type ~ ., data = Pima.tr, model = GBMModel)

## ROC curve
roc <- performance_curve(res)
plot(roc)
auc(roc)

# }