flexmix (version 0.9-0)

KLdiv: Kullbach Leibler Divergence

Description

Estimate the Kullbach Leibler divergence of several distributions.

Usage

KLdiv(object, ...)
## S3 method for class 'matrix':
KLdiv(object, eps=1e-4, ...)

Arguments

object

see Methods section below

eps

probabilities below this treshold are discarded for numerical stability

...

Passed to the matrix method.

Value

• A matrix of of KL divergences where the rows correspond to using the respective distribution as $f()$ in the formula above.

Details

Estimates $$\int f(x) (\log f(x) - \log g(x)) dx$$ for distributions with densities $f()$ and $g()$.

References

Friedrich Leisch. Exploring the structure of mixture model components. In Compstat 2004 -- Proceedings in Computational Statistics, 2004. Accepted for publication.

Examples

x = (1:100)/100
## Gaussian and Student t are much closer to each other than
## to the uniform:
KLdiv(cbind(u=dunif(x), n=dnorm(x), t=dt(x, df=10)))