rinform (version 1.0.2)

shannon_conditional_entropy: Shannon Conditional Entropy

Description

Compute the base-b conditional entropy given joint p_xy and marginal p_y distributions.

Usage

shannon_conditional_entropy(p_xy, p_y, b = 2)

Arguments

p_xy

Dist specifying the joint distribution.

p_y

Dist specifying the y-marginal distribution.

b

Numeric giving the base of the logarithm.

Value

Numeric giving the Shannon conditional entropy.

Examples

# NOT RUN {
xy <- Dist(c(10, 70, 15, 5))
x  <- Dist(c(80, 20))
y  <- Dist(c(25, 75))
shannon_conditional_entropy(xy, x)              # 0.5971072
shannon_conditional_entropy(xy, y)              # 0.5077571
shannon_conditional_entropy(xy, x, b = 3)       # 0.3767327
shannon_conditional_entropy(xy, y, b = 3)       # 0.3203591


# }