benchmark (version 0.3-3)

warehouse: Benchmark experiment warehouse.

Description

Benchmark experiment warehouse.

Usage

warehouse(datasets, B, algorithms, performances, characteristics, tests)

Arguments

datasets

Names of the datasets

B

Number of benchmark runs

algorithms

Names of the candidate algorithms

performances

Names of the performance measures

characteristics

Names of the dataset characteristics

tests

Names of the monitored test measures

Value

• Proto object with different views (see Details).

Details

warehouse is the constructor function for a benchmark experiment warehouse. A benchmark experiment warehouse collects all data during a benchmark experiment (benchmark is a proof-of-concept implementation). Different views (based on the collected data) provide cleaned parts of the data for further analyses. Implemented views:

1. viewAlgorithmPerformance(): returns a data frame (S3 classAlgorithmPerformance) with columnssamples, datasets, algorithms, performances(factors with the corresponding levels) and the columnvaluewith the corresponding performance value.
2. viewDatasetCharacterization(): returns a data frame (S3 classDatasetCharacterization) with columnssamples, datasets, characteristics, value.
3. viewDatasetBasisCharacterization(): returns a data frame (S3 classDatasetBasisCharacterization) with columnsdatasets, characteristics, value.
4. viewTestResult(): returns a data frame (S3 classTestResult) with columnssamples, datasets, tests, value.

See Also

benchmark, as.warehouse