tidyposterior (version 0.0.1)

summary.posterior_diff: Summarize Posterior Distributions of Model Differences

Description

Credible intervals are created for the differences. Also, region of practical equivalence (ROPE) statistics are computed when the effective size of a difference is given.

Usage

# S3 method for posterior_diff
summary(object, prob = 0.9, size = 0, ...)

Arguments

object

An object produced by contrast_models().

prob

A number p (0 < p < 1) indicating the desired probability mass to include in the intervals.

size

The size of an effective difference. For example, a 5% increase in accuracy between two models might be considered a "real" difference.

...

Not currently used

Value

A data frame with interval and ROPE statistics for each comparison.

Details

The ROPE estimates included in the results are the columns pract_neg, pract_equiv, and pract_pos. pract_neg integrates the portion of the posterior below -size (and pract_pos is the upper integral starting at size). The interpretation depends on whether the metric being analyzed is better when larger or smaller. pract_equiv integrates between [-size, size]. If this is close to one, the two models are unlikely to be practically different relative to size.

Examples

Run this code
# NOT RUN {
# Example objects from the "Getting Started" vignette at
#  https://topepo.github.io/tidyposterior/articles/Getting_Started.html

file <- system.file("examples", "glm_v_nnet.RData", package = "tidyposterior")
load(file)

summary(glm_v_nnet, size = 0.02)

# }

Run the code above in your browser using DataCamp Workspace