Learn R Programming
⚠️There's a newer version (0.2.55) of this package.Take me there.

scmamp (version 0.2.3)

Statistical Comparison of Multiple Algorithms in Multiple Problems

Description

Given a matrix with results of different algorithms for different problems, the package uses statistical tests and corrections to assess the differences between algorithms.

Copy Link

Version

Install

install.packages('scmamp')

Monthly Downloads

12

Version

0.2.3

License

GPL-2

Maintainer

Borja Calvo

Last Published

October 1st, 2015

Functions in scmamp (0.2.3)

friedmanAlignedRanksPost

Friedman's Aligned Ranks post hoc raw p-values
summarizeData

Summarization of data
tukeyPost

Tukey post hoc test for ANOVA.
data.gh.2008

Example in Garcia and Herrera (2008)
drawAlgorithmGraph

Hypotheses represented as a graph
scmamp

Statistical comparison of multiple algorithms
exhaustiveSets

Complete set of exhaustive sets.
data.blum.2015

Comparison of optimization algorithms in Blum et al. (2015)
data.gh.2010

Example in Garcia and Herrera (2010)
filterData

Expression based row filtering
plotDensities

Kernel based density estimation of the samples
adjustFinner

Finner correction of p-values
friedmanAlignedRanksTest

Friedman's Aligned Ranks test
nemenyiTest

Nemenyi test
postHocTest

Post hoc tests for multiple comparison analises
readExperimentFile

Read data from an experiment-like file
plotPvalues

Plotting the p-value matrix
readExperimentDir

Read data from an experiment-like files in a directory
rankMatrix

Get the ranking matrix.
adjustLi

Li correction of p-values.
adjustRom

Rom correction of p-values
multipleComparisonTest

Tests for multiple comparisons
imanDavenportTest

Iman Davenport's modification of Friedman's test
readComparisonDir

Read data from a directory of comparison-like files
friedmanTest

Friedman's test
quadeTest

Quade's test
plotRanking

Ranking Plots
readComparisonFile

Read data from a comparison file
plotCD

Critical difference plot
booleanMatrix

Creation of boolean matrices for highlighting results
qqplotGaussian

Gaussian distribution quantile-quantile plot
writeTabular

Write a table in LaTeX format
friedmanPost

Friedman's post hoc raw p-values
anovaTest

ANOVA test for multiple comparisons
quadePost

Quade post hoc raw p-values
adjustHolland

Holland correction of p-values.
customPost

Function to use custom tests to perform post hoc comparisons.
adjustBergmannHommel

Bergmann and Hommel dynamic correction of p-values.
adjustShaffer

Shaffer's correction of p-values in pairwise comparisons. .
wilcoxonSignedTest

Wilcoxon signed-rank est
contrastEstimationMatrix

Contrast estimation based on medians
tukeyTest

Tukey test