f3st

Given the standard linear model the traditional way of deciding whether to include the jth covariate is to apply the F-test to decide whether the corresponding beta coefficient is zero. The Gaussian covariate method is completely different. The question as to whether the beta coefficient is or is not zero is replaced by the question as to whether the covariate is better or worse than i.i.d. Gaussian noise. The P-value for the covariate is the probability that Gaussian noise is better. Surprisingly this can be given exactly and it is the same a the P-value for the classical model based on the F-distribution. The Gaussian covariate P-value is model free, it is the same for any data set. Using the idea it is possible to do covariate selection for a small number of covariates 25 by considering all subsets. Post selection inference causes no problems as the P-values hold whatever the data. The idea extends to stepwise regression again with exact probabilities. In the simplest version the only parameter is a specified cut-off P-value which can be interpreted as the probability of a false positive being included in the final selection. For more information see the web site below and the accompanying papers: L. Davies and L. Duembgen, "Covariate Selection Based on a Model-free Approach to Linear Regression with Exact Probabilities", 2022, <arxiv:2202.01553>. L. Davies, "Linear Regression, Covariate Selection and the Failure of Modelling", 2022, <arXiv:2112.08738>.

Laurie Davies

gausscov

The Gaussian Covariate Method for Variable Selection

f3st function

<dl><dt>y</dt>
<dd>Dependent variable</dd>
<dt>x</dt>
<dd>Covariates</dd>
<dt>m</dt>
<dd>The number of iterations</dd>
<dt>kexmx</dt>
<dd>The maximum number of covariates in an approximation</dd>
<dt>p0</dt>
<dd>The P-value cut-off</dd>
<dt>nu</dt>
<dd>The order statistic of Gaussian covariates used for comparison</dd>
<dt>kmn</dt>
<dd>The minimum number of included covariates irrespective of cut-off P-value</dd>
<dt>kmx</dt>
<dd>The maximum number of included covariates irrespective of cut-off P-value.</dd>
<dt>mx</dt>
<dd>The maximum number covariates for an all subset search</dd>
<dt>lm</dt>
<dd>The maximum number of approximations.</dd>
<dt>kex</dt>
<dd>The excluded covariates</dd>
<dt>sub</dt>
<dd>Logical if TRUE best subset selected</dd>
<dt>inr</dt>
<dd>Logical if TRUE include intercept if not present</dd>
<dt>xinr</dt>
<dd>Logical if TRUE intercept already present</dd>
<dt>qq</dt>
<dd>The number of covariates to choose from. If qq=0 the number of covariates of x is used.</dd></dl>

Arguments

Stepwise selection of covariates — f3st

<dl>

<dt>y</dt>
<dd>Dependent variable</dd>


<dt>x</dt>
<dd>Covariates</dd>


<dt>m</dt>
<dd>The number of iterations</dd>


<dt>kexmx</dt>
<dd>The maximum number of covariates in an approximation</dd>


<dt>p0</dt>
<dd>The P-value cut-off</dd>


<dt>nu</dt>
<dd>The order statistic of Gaussian covariates used for comparison</dd>


<dt>kmn</dt>
<dd>The minimum number of included covariates irrespective of cut-off P-value</dd>


<dt>kmx</dt>
<dd>The maximum number of included covariates irrespective of cut-off P-value.</dd>


<dt>mx</dt>
<dd>The maximum number covariates for an all subset search</dd>


<dt>lm</dt>
<dd>The maximum number of approximations.</dd>


<dt>kex</dt>
<dd>The excluded covariates</dd>


<dt>sub</dt>
<dd>Logical if TRUE best subset selected</dd>


<dt>inr</dt>
<dd>Logical if TRUE include intercept if not present</dd>


<dt>xinr</dt>
<dd>Logical if TRUE intercept already present</dd>


<dt>qq</dt>
<dd>The number of covariates to choose from. If qq=0 the number of covariates of x is used.</dd>

</dl>

f3st: Stepwise selection of covariates

Description

Usage

Value

Arguments

Examples