This package implements various estimators of the Shannon entropy. Most estimators in this package can be applied in ``small n, large p'' situations, i.e. when there are many more bins than counts.
The main function of this package is entropy
, which provides
a unified interface to various entropy estimators. Other functions included in this package are
estimators of Kullback-Leibler divergence (KL.plugin
) and of mutual information (mi.plugin
).
If you use this package please cite: Jean Hausser and Korbinian Strimmer. 2009. Entropy inference and the James-Stein estimator, with application to nonlinear gene association networks. J. Mach. Learn. Res. 10: 1469-1484. Available online from http://jmlr.csail.mit.edu/papers/v10/hausser09a.html.
This paper contains a detailed statistical comparison of the estimators available
in this package. It also describes the shrinkage entropy estimator entropy.shrink
.
See website: http://strimmerlab.org/software/entropy/