gdverse (version 1.3-3)

F_informationloss: measure information loss by information entropy

Description

Function for measure information loss by shannon information entropy.

Usage

F_informationloss(xvar, xdisc)

Value

A numeric value of information loss measured by information entropy.

Arguments

xvar

The original undiscretized vector.

xdisc

The discretized vector.

Author

Wenbo Lv

Details

The information loss measured by information entropy formula is \(F = -\sum\limits_{i=1}^N p_{(i)}\log_2 p_{(i)} - \left(-\sum\limits_{h=1}^L p_{(h)}\log_2 p_{(h)}\right)\)

Examples

F_informationloss(1:7,c('x',rep('y',3),rep('z',3)))