sparseSEM (version 4.0)

enSEM_stability_selection_parallel: Parallel Stability Selection for the Elastic Net penalized SEM

Description

Fit the elastic-net penalized structureal Equation Models (SEM) with input data (X, Y): Y = BY + fX + e. Perform Stability Selection (STS) on the input dataset. This function implements STS described in Meinshausen N. and Buhlmann P (2010) and Shah R. and Samworth R (2013).

Underlying the function, the program obtains the performs n rounds of boostraping each with half of the original sample size, and run the selection path of hyperparameter (alpha, lambda). The following stability selection scores are calculated:
1. E(v): the upper bound of the expected number of falsely selected variables
2. pre-comparison error rate = E(v)/p where p is the total number of model parameters (in SEM, p = M*M -M)
3. E(v)_ShaR the expected number of falsely selected variables described in Shah R. and Samworth R (2013)
4. FDR: False discovery rate = E(v)/nSelected
5. FDR_ShaR: FDR described in Shah R. and Samworth R (2013)

The final output is based on Scores described in described in Shah R. and Samworth R (2013), and original scores described in Meinshausen N. and Buhlmann P (2010) are provided for reference.

This function `enSEM_stability_selection_parallel` performs the same computation as that in function `enSEM_stability_selection` with the only difference of setting up the bootstrapping in parallel leveraging the `parallel` package.

Usage

enSEM_stability_selection_parallel(Y,X, Missing,B,
                                    alpha_factors, 
                                    lambda_factors, 
                                    kFold,
                                    nBootstrap,
                                    verbose,
                                    clusters)

Value

STS

The stable effects are those effects selected by STS, i.e., the non-zero values in matrix B.

statistics

the final STS scores with components of:
1. threshold: denoted as pi in Meinshausen N. and Buhlmann P (2010)
2. pre-comparison error rate
3. E(v)
4. E(v)_ShahR
5. nSTS: final number of stable effects with pi that leads to minimum FDR
6. FDR
7. FDR_ShahR

STS data

Bootstrapping details.

call

the call that produced this object

Arguments

Y

The observed node response data with dimension of M (nodes) by N (samples). Y is normalized inside the function.

X

The network node attribute matrix with dimension of M by N. Theoretically, X can be L by N matrix, with L being the total node attributes. In current implementation, each node only allows one and only one attribute.
If you have more than one attributes for some nodes, please consider selecting the top one by either correlation or principal component methods.
If for some nodes there is no attribute available, fill in the rows with all zeros. See the yeast data `yeast.rda` for example.
X is normalized inside the function.

Missing

Optional M by N matrix corresponding to elements of Y. 0 denotes not missing, and 1 denotes missing. If a node i in sample j has the label missing (Missing[i,j] = 1), then Y[i,j] is set to 0.

B

Optional input. For a network with M nodes, B is the M by M adjacency matrix. If data is simulated/with known true network topology (i.e., known adjacency matrix), the Power of detection (PD) and False Discovery Rate (FDR) is computed in the output parameter 'statistics'.

If the true network topology is unknown, B is optional, and the PD/FDR in output parameter 'statistics' should be ignored.

alpha_factors

The set of candidate alpha values. Default is seq(start = 0.95, to = 0.05, step = -0.05)

lambda_factors

The set of candidate lambda values. Default is 10^seq(start =1, to = 0.001, step = -0.2)

kFold

k-fold cross validation, default k=3. Note STS result is not based on CV. However, fitting l1/l2 regularized SEM will run the first step described in elasticNetSEM() function: Step 1. SEM-ridge regression (L2 penalty) with k-fold CV: this step find the optimal ridge hyperparameter rho to provide an initial values for l1/l2 regularized SEM.

nBootstrap

bootstrapping parameter. default nBootstrap = 100.

verbose

describe the information output from -1 - 10, larger number means more output

clusters

snow clusters

Author

Anhui Huang

Details

the function perform STS

References

[1]: Meinshausen, N. and Buhlmann, P., 2010. Stability selection. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 72(4), pp.417-473.

[2] Shah, R.D. and Samworth, R.J., 2013. Variable selection with error control: another look at stability selection. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 75(1), pp.55-80.

Examples

	library(sparseSEM)
	library(parallel)
	data(B);
	data(Y);
	data(X);
	data(Missing);
	#Example
	# \donttest{

  cl<-makeCluster(2)
  clusterEvalQ(cl,{library(sparseSEM)})
  output = enSEM_stability_selection_parallel(Y,X, Missing,B,
                                            alpha_factors = seq(1,0.05, -0.05), 
                                            lambda_factors =10^seq(-0.2,-4,-0.2), 
                                            kFold = 3,
                                            nBootstrap = 100,
                                            verbose = -1,
                                            clusters = cl)
  stopCluster(cl)	
  # }