RoughSets (version 1.3-7)

X.entropy: The entropy measure

Description

An auxiliary function for the qualityF parameter in the FS.greedy.heuristic.reduct.RST, FS.DAAR.heuristic.RST and FS.greedy.heuristic.superreduct.RST functions. It is based on entropy as a measure of information(Shannon, 1948).

Usage

X.entropy(decisionDistrib)

Value

a numeric value indicating entropy of an attribute.

Arguments

decisionDistrib

an integer vector corresponding to a distribution of attribute values

Author

Andrzej Janusz

References

C. E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, p. 379 - 423, 623 - 656 (1948).