Learn R Programming

CalibratR (version 0.1.2)

Mapping ML Scores to Calibrated Predictions

Description

Transforms your uncalibrated Machine Learning scores to well-calibrated prediction estimates that can be interpreted as probability estimates. The implemented BBQ (Bayes Binning in Quantiles) model is taken from Naeini (2015, ISBN:0-262-51129-0). Please cite this paper: Schwarz J and Heider D, Bioinformatics 2019, 35(14):2458-2465.

Copy Link

Version

Install

install.packages('CalibratR')

Monthly Downloads

367

Version

0.1.2

License

LGPL-3

Maintainer

Dominik Heider

Last Published

August 19th, 2019

Functions in CalibratR (0.1.2)

hist_binning_CV

hist_binning_CV
get_Brier_score

get_Brier_score
compare_models_visual

compare_models_visual
get_MCE_equal_width

get_MCE_equal_width
get_CLE_class

get_CLE_class
predict_model

predict_model
rd_multiple_runs

rd_multiple_runs
get_ECE_equal_width

get_ECE_equal_width
get_CLE_comparison

get_CLE_comparison
predict_calibratR

predict_calibratR
predict_hist_binning

predict_hist_binning
reliability_diagramm

reliability_diagramm
getMCE

getMCE
getRMSE

getRMSE
plot_model

plot_model
statistics_calibratR

statistics_calibratR
plot_class_distributions

plot_class_distributions
visualize_calibrated_test_set

visualize_calibrated_test_set
predict_BBQ

predict_BBQ
example

example
evaluate_discrimination

evaluate_discrimination
scale_me

scale_me
visualize_distribution

visualize_distribution
transform_me

transform_me
visualize_error_boxplot

visualize_error_boxplot
predict_GUESS

predict_GUESS
visualize_calibratR

visualize_calibratR
format_values

format_values
uncalibrated_CV

uncalibrated_CV
getECE

getECE
binom_for_histogram

binom_for_histogram
calibrate

calibrate
calibrate_me

calibrate_me
calibrate_me_CV_errors

calibrate_me_CV_errors
BBQ_CV

BBQ_CV
build_GUESS

build_GUESS
build_hist_binning

build_hist_binning
GUESS_CV

GUESS_CV
build_BBQ

build_BBQ