Learn R Programming

RoughSets (version 1.0-0)

X.entropy: The information gain measure function

Description

It is an auxiliary function for qualityF parameter in the FS.greedy.heuristic.reduct.RST and FS.greedy.heuristic.superreduct.RST functions. It is based on entropy as a measure of information(C. E. Shannon, 1948).

Usage

X.entropy(decisionDistrib)

Arguments

decisionDistrib
a distribution of values on the decision attribute.

Value

  • qualityF.

References

C. E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, p. 379 - 423, 623 - 656 (1948).