entropy (version 1.0.0)

entropy.plugin: Plug-in entropy estimator

Description

entropy.plugin computes the Shannon entropy H of a discrete random variable from the specified bin frequencies.

Usage

entropy.plugin(freqs, unit=c("log", "log2", "log10"))

Arguments

freqs

bin frequencies.

unit

the unit in which entropy is measured.

Value

• entropy.plugin returns the Shannon entropy.

Details

The Shannon entropy of a discrete random variable is defined as $H = -\sum p(x_i) \log( p(x_i) )$, where $p(x_i)$ are the bin probabilities.

See Also

entropy.Dirichlet, entropy.empirical.

Examples

# load entropy library 
library("entropy")

# some frequencies
freqs = c(0.2, 0.1, 0.15, 0.05, 0, 0.3, 0.2)  

# and corresponding entropy
entropy.plugin(freqs)