benchmark (version 0.3-5)

warehouse: Benchmark experiment warehouse

Description

warehouse is the constructor function for a benchmark experiment warehouse.

Usage

warehouse(datasets, B, algorithms = NULL,
    performances = NULL, characteristics = NULL,
    tests = NULL)

Arguments

datasets

Names of the datasets

B

Number of benchmark runs

algorithms

Names of the candidate algorithms

performances

Names of the performance measures

characteristics

Names of the dataset characteristics

tests

Names of the monitored test measures

Value

• Proto object with different views (see Details).

Details

A benchmark experiment warehouse collects all data during the execution of a benchmark experiment; see benchmark. Different views (based on the collected data) provide cleaned parts of the data for further analyses.

Implemented views:

1. viewAlgorithmPerformance(): returns a data frame (S3 classAlgorithmPerformance) with columnssamples, datasets, algorithms, performances(factors with the corresponding levels) and the columnvaluewith the corresponding performance value.
2. viewDatasetCharacterization(): returns a data frame (S3 classDatasetCharacterization) with columnssamples, datasets, characteristics, value.
3. viewDatasetBasisCharacterization(): returns a data frame (S3 classDatasetBasisCharacterization) with columnsdatasets, characteristics, value.
4. viewTestResult(): returns a data frame (S3 classTestResult) with columnssamples, datasets, tests, value.

See Also

benchmark, as.warehouse