exreport (version 0.4.1)

testPaired: Paired Wilcoxon statistical test

Description

This function performs a Wilcoxon paired test to compare the methods of an experiment consisting exactly on two of them. If more methods are present, then a multiple comparison test must be applied.

Usage

testPaired(e, output, rankOrder = "max", alpha = 0.05)

Arguments

e

Input experiment

output

The output for which the tet will be performed.

rankOrder

The optimization strategy, can be either maximizing "max" or minimizing "min" the target output variable.

alpha

The significance level used for the whole testing procedure.

Value

a testPaired object

Examples

# First we create an experiment from the wekaExperiment problem and prepare
# it to apply the test, we must subset it to only two methods:
experiment <- expCreate(wekaExperiment, name="test", parameter="fold")
experiment <- expSubset(experiment, list(method = c("J48", "NaiveBayes")))
experiment <- expSubset(experiment, list(featureSelection = c("no")))
experiment <- expReduce(experiment, "fold", mean)
experiment <- expInstantiate(experiment, removeUnary=TRUE)

# Then we perform a Wilcoxon test procedure
test <- testPaired(experiment, "accuracy", "max")

summary(test)