Learn R Programming

biogram (version 1.1)

criterions: Critetions

Description

Permutation test implemented in biogram uses several criterions to filter important features. Each can be used by test_features by specifying criterion parameter.

Arguments

Information gain

The information gain term is used here (improperly) as a synonym of mutual information. It is defined as: $$IG(X; Y) = \sum_{y \in Y} \sum_{x \in X} p(x, y) \log \left(\frac{p(x, y)}{p(x) p(y)} \right)$$

In biogram package information gain is calculated using following relationship: $IG = E(S) - E(S|F)$

Details

Possible criterions are: [object Object]

References

Cover TM, Thomas JA Elements of Information Theory, 2nd Edition Wiley, 2006.