biogram (version 1.3)

calc_kl: Calculate KL divergence of features

Description

Computes Kullback-Leibler divergence between features and target vector.

Usage

calc_kl(feature, target_b, len_target, pos_target)

Arguments

feature

feature vector.

target_b

target in bits (as per as.bit).

len_target

length of the target vector.

pos_target

number of positive cases in the target vector.

Value

A numeric vector of length 1 representing Kullback-Leibler divergence value.

References

Kullback S, Leibler RA On information and sufficiency. Annals of Mathematical Statistics 22 (1):79-86, 1951.

See Also

test_features. Kullback-Leibler divergence is calculated using KL.plugin.

Examples

tar <- sample(0L:1, 100, replace = TRUE)
feat <- sample(0L:1, 100, replace = TRUE)
library(bit) # used to code vector as bit
calc_kl(feat, as.bit(tar), 100, sum(tar))