Trevor Hastie

Trevor Hastie

21 packages on CRAN

1 packages on Bioconductor

gam

cran
99.99th

Percentile

Functions for fitting and working with generalized additive models, as described in chapter 7 of "Statistical Models in S" (Chambers and Hastie (eds), 1991), and "Generalized Additive Models" (Hastie and Tibshirani, 1990).

gamsel

cran
99.99th

Percentile

Using overlap grouped-lasso penalties, 'gamsel' selects whether a term in a 'gam' is nonzero, linear, or a non-linear spline (up to a specified max df per variable). It fits the entire regularization path on a grid of values for the overall penalty lambda, both for gaussian and binomial families.

glmnet

cran
99.99th

Percentile

Extremely efficient procedures for fitting the entire lasso or elastic-net regularization path for linear regression, logistic and multinomial regression models, Poisson regression and the Cox model. Two recent additions are the multiple-response Gaussian, and the grouped multinomial regression. The algorithm uses cyclical coordinate descent in a path-wise fashion, as described in the papers listed in the URL below.

ISLR

cran
99.99th

Percentile

We provide the collection of data-sets used in the book 'An Introduction to Statistical Learning with Applications in R'.

lars

cran
99.99th

Percentile

Efficient procedures for fitting an entire lasso sequence with the cost of a single least squares fit. Least angle regression and infinitesimal forward stagewise regression are related to the lasso, as described in the paper below.

mda

cran
99.99th

Percentile

Mixture and flexible discriminant analysis, multivariate adaptive regression splines (MARS), BRUTO, ...

ProDenICA

cran
99.99th

Percentile

A direct and flexible method for estimating an ICA model. This approach estimates the densities for each component directly via a tilted gaussian. The tilt functions are estimated via a GAM poisson model. Details can be found in "Elements of Statistical Learning (2nd Edition)" Section 14.7.4

softImpute

cran
99.99th

Percentile

Iterative methods for matrix completion that use nuclear-norm regularization. There are two main approaches.The one approach uses iterative soft-thresholded svds to impute the missing values. The second approach uses alternating least squares. Both have an "EM" flavor, in that at each iteration the matrix is completed with the current estimate. For large matrices there is a special sparse-matrix class named "Incomplete" that efficiently handles all computations. The package includes procedures for centering and scaling rows, columns or both, and for computing low-rank SVDs on large sparse centered matrices (i.e. principal components)

sparsenet

cran
99.99th

Percentile

Efficient procedure for fitting regularization paths between L1 and L0, using the MC+ penalty of Zhang, C.H. (2010)<doi:10.1214/09-AOS729>. Implements the methodology described in Mazumder, Friedman and Hastie (2011) <DOI: 10.1198/jasa.2011.tm09738>. Sparsenet computes the regularization surface over both the family parameter and the tuning parameter by coordinate descent.

svmpath

cran
99.99th

Percentile

Computes the entire regularization path for the two-class svm classifier with essentially the same cost as a single SVM fit.

99.99th

Percentile

Customized training is a simple technique for transductive learning, when the test covariates are known at the time of training. The method identifies a subset of the training set to serve as the training set for each of a few identified subsets in the training set. This package implements customized training for the glmnet() and cv.glmnet() functions.

dpglasso

cran
99.99th

Percentile

fits the primal graphical lasso, via one-at-a-time block-coordinate descent.

elasticnet

cran
99.99th

Percentile

Efficient procedures for fitting an entire elastic net sequence. The elastic net methodology is described in the paper below. The package also implements the sparse PCA algorithm based on the elastic net/lasso.

FLLat

cran
99.99th

Percentile

Fits the Fused Lasso Latent Feature model, which is used for modeling multi-sample aCGH data to identify regions of copy number variation (CNV). Produces a set of features that describe the patterns of CNV and a set of weights that describe the composition of each sample. Also provides functions for choosing the optimal tuning parameters and the appropriate number of features, and for estimating the false discovery rate.

glasso

cran
99.99th

Percentile

Estimation of a sparse inverse covariance matrix using a lasso (L1) penalty. Facilities are provided for estimates along a path of values for the regularization parameter.

glinternet

cran
99.99th

Percentile

Group-Lasso INTERaction-NET. Fits linear pairwise-interaction models that satisfy strong hierarchy: if an interaction coefficient is estimated to be nonzero, then its two associated main effects also have nonzero estimated coefficients. Accommodates categorical variables (factors) with arbitrary numbers of levels, continuous variables, and combinations thereof. Implements the machinery described in the paper "Learning interactions via hierarchical group-lasso regularization" (JCGS 2015, Volume 24, Issue 3). Michael Lim & Trevor Hastie (2015) <DOI:10.1080/10618600.2014.938812>.

glmpath

cran
99.99th

Percentile

A path-following algorithm for L1 regularized generalized linear models and Cox proportional hazards model.

impute

bioconductor
99.99th

Percentile

Imputation for microarray data (currently KNN only)

npmr

cran
99.99th

Percentile

Fit multinomial logistic regression with a penalty on the nuclear norm of the estimated regression coefficient matrix, using proximal gradient descent. Reference: Powers S, Hastie T and Tibshirani R (2018) <doi:10.1177/1471082X18777669>.

SGL

cran
99.99th

Percentile

Fit a regularized generalized linear model via penalized maximum likelihood. The model is fit for a path of values of the penalty parameter. Fits linear, logistic and Cox models.

stepPlr

cran
99.99th

Percentile

L2 penalized logistic regression for both continuous and discrete predictors, with forward stagewise/forward stepwise variable selection procedure.

TrioSGL

cran
99.99th

Percentile

Fit a trio model via penalized maximum likelihood. The model is fit for a path of values of the penalty parameter. This package is based on Noah Simon, et al. (2011) <doi:10.1080/10618600.2012.681250>.