calc_sample_size: Power Analysis for Search Strategy Evaluation
Description
Power Analysis for Search Strategy Evaluation
Usage
calc_sample_size(
effect_size = 0.1,
alpha = 0.05,
power = 0.8,
baseline_f1 = 0.7
)
Value
Required sample size
Arguments
- effect_size
Expected effect size (difference in F1 scores)
- alpha
Significance level
- power
Desired statistical power
- baseline_f1
Baseline F1 score