ridge.tune: Cross validation for the ridge regression

Description

Cross validation for the ridge regression is performed using the TT estimate of bias (Tibshirani and Tibshirani, 2009). There is an option for the GCV criterion which is automatic.

Usage

ridge.tune(y, x, M = 10, lambda = seq(0, 2, by = 0.1), seed = FALSE, ncores = 2,
graph = TRUE)

Arguments

A numeric vector containing the values of the target variable. If the values are proportions or percentages, i.e. strictly within 0 and 1 they are mapped into R using the logit transformation.

A numeric matrix containing the variables. Rows are samples and columns are features.

The number of folds. Set to 10 by default.

lambda

A vector with the a grid of values of $\lambda$ to be used.

seed

A boolean variable. If it is TRUE the results will always be the same.

ncores

The number of cores to use. If it is more than 1 parallel computing is performed.

graph

If graph is set to TRUE the performances for each fold as a function of the $\lambda$ values will appear.

Value

A list including:
mspThe performance of the ridge regression for every fold.
mspeThe values of the mean prediction error for each value of $\lambda$.
lambdaThe value of $\lambda$ which corresponds to the minimum MSPE.
performanceThe minimum bias corrected MSPE along with the estimate of bias.

Details

A k-fold cross validation is performed and the estimated performance is bias corrected as suggested by Tibshirani and Tibshirani (2009). This function is used by alfaridge.tune.

References

Hoerl A.E. and R.W. Kennard (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1):55-67. Brown P. J. (1994). Measurement, Regression and Calibration. Oxford Science Publications. Tibshirani R.J., and Tibshirani R. (2009). A bias correction for the minimum error rate in cross-validation. The Annals of Applied Statistics 3(2): 822-829.

Examples

Run this code

y <- iris[, 1]
x <- iris[, 2:4]
ridge.tune(y, x, M = 10, lambda = seq(0, 2, by = 0.1), seed = FALSE, ncores = 1, graph = TRUE)

Run the code above in your browser using DataLab