Learn R Programming

rinform (version 1.0.2)

shannon_entropy: Shannon Entropy

Description

Compute the base-b Shannon entropy of the distribution p.

Usage

shannon_entropy(p, b = 2)

Arguments

p

Dist specifying the distribution.

b

Numeric giving the base of the logarithm.

Value

Numeric giving the Shannon entropy of the distribution.

Examples

Run this code
# NOT RUN {
d <- Dist(c(1, 1, 1, 1))
shannon_entropy(d)          # 2.0
shannon_entropy(d, 4)       # 1.0

d <- Dist(c(2, 1))
shannon_entropy(d)          # 0.9182958
shannon_entropy(d, b = 3)   # 0.5793802
# }

Run the code above in your browser using DataLab