grizbayr (version 1.2.3)

estimate_win_prob_vs_baseline_given_posterior: Estimate Win Probability vs. Baseline Given Posterior

Description

Calculates the win probability of the best option compared to a single other option given a posterior distribution.

Usage

estimate_win_prob_vs_baseline_given_posterior(
  posterior_samples,
  distribution,
  wrt_option
)

Arguments

posterior_samples

Tibble returned from sample_from_posterior with 3 columns `option_name`, `samples`, and `sample_id`.

distribution

String: the distribution name

wrt_option

String: the option to compare against the best option.

Value

Tibble of each option_name and the win probability expressed as a percentage and a decimal `raw`

Examples

# NOT RUN {
# Requires posterior_samples dataframe. See `sample_from_posterior()`
# for an example.
# }
# NOT RUN {
estimate_win_prob_vs_baseline_given_posterior(
    posterior_samples = posterior_samples,
    distribution = "conversion_rate",
    wrt_option = "A")
# }
# NOT RUN {
# }