verification (version 1.02)

measurement.error: Skill score with measurement error.

Description

Skill score that incorporates measurement error. This function allows the user to incorporate measurement error in an observation in a skill score.

Usage

measurement.error( obs, frcs = NULL, theta = 0.5, t = 1, u
= 0, h = NULL, ...)

Arguments

obs

Information about a forecast and observation can be done in one of two ways. First, the results of a contingency table can be entered as a vector containing c(n11, n10, n01, n00), where n11 are the number of correctly predicted events an

frcs

If obs is entered as a contingency table, this agrument is null. If obs is a vector of outcomes, this column is a vector of probablistic forecasts.

theta

Loss value (cost) of making a incorrect forecast by a non-event. Defaults to 0.5.

t

Probability of forecasting an event, when an event occurs. A perfect value is 1.

u

Probability of forecasting that no event will occur, when and event occurs. A perfect value is 0.

h

Threshold for converting a probablistic forecast into a binary forecast. By default, this value is NULL and the theta is used as this threshold.

...

Optional arguments.

Value

• G
  Likelihood ratio statistic
• p
  p-value for the null hypothesis that the forecast contains skill.
• K
  Skill score.

References

W.M. Briggs, 2004. Incorporating Cost in the Skill Score Technical Report, wm-briggs.com/public/skillocst.pdf.

W.M. Briggs and D. Ruppert, 2004. Assessing the skill of yes/no forecasts. Submitting to Biometrics.

J.P. Finley, 1884. Tornado forecasts. {Amer. Meteor. J. 85-88. (Tornado data used in example.) }

[object Object]

file

Examples

DAT<- data.frame( obs = round(runif(50)), frcs = runif(50))

 measurement.error(DAT$obs, DAT$frcs)

### Finley Data

measurement.error(c(28, 23, 72, 2680)) ## assuming perfect observation,